Read-only copy. This public copy of trans-bench is read-only: it shows the published campaigns. Clone the repository to run benchmarks or to edit systems. github.com/Sirneij/trans-bench, branch verified-rerun-2026
trans-bench · 11 systems · 15 topologies

Every path,
every system,
verified.

The same recursive query on logic engines and databases, over graphs that grow until something breaks. Every answer is checked against the true closure.

New experiment Watch the race
hover a node
Systems
11
Topologies
15
Verified runs
12,215
Campaigns
2

Fastest at the largest graphs

verified_2026_v2 →
#SystemWins · podiumsTime as n growsDone
A contest is one structured topology with left or right recursion at its largest n; the fastest completed system wins it. The line is the geometric mean time over topologies as n grows.

Latest campaign

verified_2026_v2 →
99.4%
verified
Executed runs12,289
Timeout23
Out of memory13
Unsupported36
Iteration limit2
Skipped after a failure528

Topologies

hover a card to see what its closure adds · all 15 →

Barabási-Albert (Scale-Free)

40 edges → |TC| 74

Binary Tree

14 edges → |TC| 34

Complete Graph

36 edges → |TC| 36

Cycle Graph

10 edges → |TC| 100

Cycle with Shortcuts

120 edges → |TC| 144

Grid Graph

24 edges → |TC| 84

Max Acyclic Graph

15 edges → |TC| 15

Multi-Path Graph

30 edges → |TC| 60

Path Graph

6 edges → |TC| 21

Reverse Binary Tree

14 edges → |TC| 34

Scale-Free Directed

29 edges → |TC| 55

Star Graph

8 edges → |TC| 8

W Graph

25 edges → |TC| 25

X Graph

15 edges → |TC| 65

Y Graph

14 edges → |TC| 95

Systems

Manage

From the command line

Linux 6.18.15+deb13-cloud-amd64 · 48 CPUs · Python 3.12.15
$./virtualenv/bin/python benchmark.py --systems duckdb postgres --sizes 100 200 300 --campaign results/my_campaign
$./virtualenv/bin/python transitive.py --systems duckdb --sizes 100 301 100 --campaign results/my_campaign

Both commands, and the Start button of the wizard, run the same engine. A campaign directory holds one runs.jsonl per system, and its tables and figures appear under Campaigns when the run ends.