Community compilation

What public tests say about AI app builders.

BuildOff compiles real head-to-heads other people already ran — blogs, research papers, X threads — and links every source. These are their tests, not ours. Our automated Playwright / Lighthouse / security harness is coming later.

Some outbound builder links may become affiliate links once we're approved. Rankings and tallies never change for affiliates. Tools without affiliate programs stay on the roster. Full disclosure →

Community tally

Across 8 tests with a declared ranking (of 11 sources we opened). “1st / top-3 / last” are among the builders on our roster that appeared in that test's ranking — not among every tool the author mentioned.

Browse all tests
Builder Ranked 1st Top 3 Last Appearances Sources
Replit 2 5 1 5 view tests →
Lovable 2 4 2 5 view tests →
v0 1 4 1 5 view tests →
Emergent 1 1 1 2 view tests →
Firebase Studio 1 1 0 1 view tests →
Converge 1 1 0 1 view tests →
Bolt 0 6 4 8 view tests →
Base44 0 2 0 2 view tests →

Vendor-published or self-preferencing tests are kept in the dataset and flagged on each card (e.g. Converge's Slack clone, Emergent's own bakeoff). Read the conflict notes before weighting them.

Builders on the roster

Our own automated tests

Coming later

BuildOff automated scores — not published yet

Spec #1 and the Playwright / Lighthouse / security harness already live in the repo. We are not running paid builder plans yet, so there are no BuildOff scores to show. Until then, use the community tests we compile and link.

Community tests See Spec #1 Planned scoring

Spec #1 (habit tracker) and the scoring harness already live in the repo under specs/ and harness/ — we are not publishing BuildOff scores until we run them for real.

New community tests in your inbox

Occasional email when we add sourced head-to-heads — and later, when BuildOff's own harness scores ship. No spam, unsubscribe anytime.

Or subscribe on buttondown.com/buildoff.