Skip to main content

claude-opus-4-5

run under the opencode harness

The harness is part of what is measured here: the same model under a different runner scores differently. Why that matters.

36.8%

repair rate

25–49

95% interval

15

rank of 15

$36.89

per repair · estimated

Rank is a position in a table whose intervals overlap almost everywhere. Read it as a band, not a place.

outcome mix

46 repaired · 29 not repaired · 50 did not build

46 repaired · 29 not repaired · 50 did not build

By weakness class

WeaknessRepair rateRateAttempts
CWE-125Out-of-bounds Read41.9% (95% interval 23.1–56.1)41.9%74
CWE-787Out-of-bounds Write41.2% (95% interval 20.0–62.5)41.2%17
CWE-416Use After Free23.1% (95% interval 5.0–50.0)23.1%13
CWE-908Use of Uninitialized Resource25.0% — no interval: too few codebases or attempts to generalise25.0%8
CWE-415Double Free33.3% — no interval: too few codebases or attempts to generalise33.3%3
CWE-1284Improper Validation of Specified Quantity in Input50.0% — no interval: too few codebases or attempts to generalise50.0%2
CWE-843Access of Resource Using Incompatible Type ('Type Confusion')0.0% — no interval: too few codebases or attempts to generalise0.0%2
CWE-4750.0% — no interval: too few codebases or attempts to generalise0.0%1
CWE-5620.0% — no interval: too few codebases or attempts to generalise0.0%1
CWE-476NULL Pointer Dereference0.0% — no interval: too few codebases or attempts to generalise0.0%1