Benchmarks
Compare systems
Pick up to five systems from one evaluation and compare their results.
Side by side3 of 18 systems on the Vulnerability repair · Patch leaderboard
Each bar is the share of vulnerabilities where the system's patch passed the grader. The reasoning effort for these runs is not recorded.
RankSystemPass rate
1
Codex GPT-5.5
86.3%80.5–90.6211 completed runs
1
OpenCode GPT-5.5
85.3%78.3–90.8211 completed runs
1
OpenCode GPT-5.3 Codex
84.0%78.0–88.6212 completed runs
Leaderboard: Vulnerability repair, Patch· Open the leaderboard