Read-only copy. This public copy of trans-bench is read-only: it shows the published campaigns. Clone the repository to run benchmarks or to edit systems. github.com/Sirneij/trans-bench, branch verified-rerun-2026
Results

Campaigns

Verified benchmark campaigns under results/. Every run in them was executed in its own process with a time limit and checked against an independently computed closure.

Plan a campaign

verified_2026_v2

latest memory measured analyzed

Verified campaign with memory measurements, September 2026

2026-09-29 → 2026-09-30
9 series
Executed
12,289
Completed
12,215
Failed
74
Skipped after a failure
528
completed 23 timeout13 out of memory36 unsupported2 iteration limit skipped

verified_2026

analyzed

Verified campaign, September 2026

2026-09-26 → 2026-09-28
9 series
Executed
12,279
Completed
12,205
Failed
74
Skipped after a failure
530
completed 23 timeout11 out of memory36 unsupported2 iteration limit2 error skipped