Skip to main content
XOR

Cyber AI Evals

XOR is a security lab that evaluates and improves the cyber capabilities of coding systems.

See the results

Standards our researchers helped write

What we measure

A coding system meets a vulnerability with no public fix, and is set to attack it, repair it, or both. Code decides the outcome, and every result is published.

Benchmarks

Unpatched

0.0%Full exploit rateThe flaw fired at 63.5%; none cleared the bar for the full result.

Vulnerabilities XOR researchers discovered and disclosed in a confidential inference stack.

Unpatched benchmark →

Cryptography

68.2%Full fix rate

Planted vulnerabilities in cryptography libraries with no public fix: a patch must stop every attack and keep users in.

Cryptography benchmark →

Method

Systems attack or defend. How we measure.