Skip to main content
XOR

claude-opus-4-5

run under the claude harness

The harness is part of what is measured here: the same model under a different runner scores differently. Why that matters.

45.7%

repair rate

33–56

95% interval

11

rank of 15

$2.46

per repair · metered

Rank is a position in a table whose intervals overlap almost everywhere. Read it as a band, not a place.

outcome mix

58 repaired · 43 not repaired · 26 did not build

58 repaired · 43 not repaired · 26 did not build

By weakness class

WeaknessRepair rateRateAttempts
CWE-125Out-of-bounds Read53.3% (95% interval 37.3–64.4)53.3%75
CWE-787Out-of-bounds Write47.1% (95% interval 25.0–73.3)47.1%17
CWE-416Use After Free30.8% (95% interval 5.0–66.7)30.8%13
CWE-908Use of Uninitialized Resource12.5% — no interval: too few codebases or attempts to generalise12.5%8
CWE-415Double Free33.3% — no interval: too few codebases or attempts to generalise33.3%3
CWE-1284Improper Validation of Specified Quantity in Input50.0% — no interval: too few codebases or attempts to generalise50.0%2
CWE-843Access of Resource Using Incompatible Type ('Type Confusion')50.0% — no interval: too few codebases or attempts to generalise50.0%2
CWE-476NULL Pointer Dereference0.0% — no interval: too few codebases or attempts to generalise0.0%2
CWE-4750.0% — no interval: too few codebases or attempts to generalise0.0%1
CWE-5620.0% — no interval: too few codebases or attempts to generalise0.0%1

Compare

vs codex/gpt-5-2vs cursor/opus-4-6vs claude/claude-opus-4-6vs gemini31/gemini-3-1-pro-preview

Corpus cve-bench-136 · run February 2026 · How we test