X: 'I ranked 14 AI app builders by strength'
Roxo (@alexhalescoder) · 2026-10-15 · opinion
Task: Opinion ranking 'by strength' — not a single shared build prompt.
Tools: Replitv0BoltEmergentlindynxcodetaskadeopenai-agent-buildersame-newgrok-buildframergoogle-stitchantigravitysticklight
Result (as stated):
Ranked by strength: 1 Replit Agent 3; 2 v0 by Vercel; 3 Lindy; 4 NxCode; 5 Taskade Genesis; 6 OpenAI Agent Builder; 7 Bolt.new; 8 Same.new; 9 Emergent AI; 10 Grok Build Mode; 11 Framer AI Agents; 12 Google Stitch; 13 Antigravity; 14 Sticklight. Quick takes: backend-heavy → Replit; beautiful UI → v0 or Google Stitch; landing page → Framer; clone a site → Same.new.
Places we recorded: #1 Replit (#1 of 14) · #2 v0 (#2 of 14) · #7 Bolt (#7 of 14) · #9 Emergent (#9 of 14)
Conflict of interest: Author bio: 'AI Educator… DM Open for collaboration'. Not a controlled same-prompt test.
Counted in tallies with method=opinion so readers can filter. Lovable/Base44 not in the 14.
X: same e-commerce prompt → Northform product page (5 builders)
Theo Reed (@TheoReednp) · 2026-09-03 · hand excluded from tallies
Task: Exact same e-commerce prompt; default settings; complete product page for fictional brand Northform.
Tools: LovableBoltReplitBase44Emergent
Result (as stated):
NO DECLARED RANKING in the opened post text or readable image content. Author asks 'Which one wins?'. Follow-up search from:TheoReednp for a winner post returned 0 results.
Conflict of interest: Independent tester bio; no vendor link stated.
Verified attempt including Base44 + Emergent; excluded from tallies until a declared result is found.
2026 vibe coding tool comparison (Vandelay Industries ops dashboard)
Justin Gage (technically.dev) · 2026-08-25 · hand
Task: Internal ops dashboard for Vandelay Industries: inventory/CRM table of potato-chip shipments, analytics/charts, map of shipments. Iterated with bug-fix prompts.
Tools: Replitv0LovableBolt
Result (as stated):
TL;DR as written: 'Replit was the most feature rich, well thought out, and powerful'; 'v0 was the best if you’re already a developer and want a technical interface'; 'Lovable and Bolt were pretty much objectively worse than the other two.' Final pick: 'If I were starting a new project from scratch I’d use Replit or v0.'
Places we recorded: #1 Replit (most feature rich / best finished app (qualitative)) · #2 v0 (best for developers (qualitative)) · #3 Lovable (objectively worse (tied qualitative)) · #3 Bolt (objectively worse (tied qualitative))
Conflict of interest: None stated for any vendor.
No numeric scores. Places 3 tied for Lovable and Bolt per author's wording.
Bolt vs Base44 vs Emergent — same waitlist app + follow-up
Anupam (Emergent), reviewed by Anmol · 2026-08-25 · hand
Task: Waitlist landing page with email capture, DB, admin signup count; then follow-up: add company name field to form + admin.
Tools: BoltBase44Emergent
Result (as stated):
Author final: 'Emergent is still where I'd start for a real production app'; Base44 'genuinely the fastest to a demo'; Bolt 'honesty when things go wrong' but free-tier tokens burned on fixes. Explicit winners by category: Speed → Base44; Complex logic / testing evidence → Emergent; Code ownership → Bolt; Mobile → Emergent.
Places we recorded: #1 Emergent (author's production pick) · #2 Base44 (fastest demo) · #3 Bolt (code ownership; preview issues)
Conflict of interest: Strong — published on emergent.sh (vendor content).
Useful timings (Base44 ~2–5 min publish; Emergent ~16 min; Bolt ~19 min with fixes).
X: same frontend prompt → Founder OS dashboard (5 builders)
Evan Cole (@Promptleague13) · 2026-08-18 · hand excluded from tallies
Task: Exact same frontend prompt; default settings; one attempt; each builds a Founder OS dashboard. Post asks 'Which one wins?'
Tools: LovableBoltv0ReplitBase44
Result (as stated):
NO DECLARED RANKING in the opened post text or readable image content. Author asks the audience which wins. Follow-up search from:Promptleague13 for a winner post returned 0 results.
Conflict of interest: Independent tester bio; no vendor link stated.
Included as a verified same-prompt attempt; excluded from tallies until a declared result is found.
Base44 vs Lovable vs Bolt — same client management app
Walter Akolo (HostAdvice) · 2026-07-01 · hand
Task: Complex client project management system: multi-user auth, RBAC, dashboard analytics, projects, time logging, invoices/PDF, Stripe, client portals.
Tools: Base44LovableBolt
Result (as stated):
Overall winner: Lovable. Stated metrics include build time Base44 6 min / Lovable 10 min / Bolt 4–5 min*; first-build success rate Base44 100% / Lovable 90% / Bolt 30%. Author: 'Avoid Bolt for now' due to preview/deploy failures. Category winners: Pricing Base44; AI capabilities Base44; Speed/quality split (Base44 faster, Lovable better quality); Ease Base44; Integrations Lovable.
Places we recorded: #1 Lovable (overall winner) · #2 Base44 (speed / ease / pricing winner) · #3 Bolt (30% first-build success; avoid)
Conflict of interest: Affiliate/review site; HostAdvice often monetizes tool reviews (exact affiliate status for these three UNVERIFIED on the opened page).
Detailed timed metrics. Overall ranking uses author's stated overall winner.
Agent UI Generation Benchmark (React + Tailwind dashboard)
SMF Clearinghouse · 2026-06-16 · hand
Task: Responsive React dashboard: sidebar, metric cards, line chart placeholder, recent activity table, mobile responsiveness, Tailwind.
Tools: v0LovableBoltclaude-code
Result (as stated):
Scores: v0 91 (8m, ~$0.75, Pass); Lovable 86 (11m, ~$0.95, Pass); Bolt.new 82 (14m, ~$1.10, Pass); Claude Code 74 (26m, ~$2.10, Pass). Winner: v0.
Places we recorded: #1 v0 (91) · #2 Lovable (86) · #3 Bolt (82)
Conflict of interest: None stated.
UI-only task; Claude Code included but not an AI app builder in our roster.
Prompt-to-App Benchmark (task tracker with auth + DB)
SMF Clearinghouse · 2026-06-10 · hand
Task: Build a task tracker app. Users sign up, sign in, add tasks, mark them complete, and delete them. Store tasks in a real database. Deploy it. (single prompt, no follow-ups)
Tools: LovableBoltReplitv0
Result (as stated):
Scores: Lovable 88 (14m, ~$8, Pass); Bolt.new 82 (18m, ~$12, Pass); Replit Agent 74 (25m, ~$5.50, Pass); v0 65 (35m, $0, Fail). Winner: Lovable.
Places we recorded: #1 Lovable (88) · #2 Bolt (82) · #3 Replit (74) · #4 v0 (65 (Fail))
Conflict of interest: None stated. Site says 'Not sponsored. Not cherry-picked.'
Strongest independent same-prompt full-stack scorecard found.
Vibe Coding Benchmark: Building a Slack Clone
Dan Cleary (Converge) · 2026-01-23 · hand
Task: Slack-like app with 13 checklist features (auth, channels, messages, profile photo storage, search, typing indicators, private channels, unread badges, pins, realtime, etc.).
Tools: ConvergeLovableBoltReplitv0
Result (as stated):
Final scores (highest → lowest): Converge — 13/13; Replit — 5/13; v0 — 3/13; Bolt — 2/13; Lovable — 0/13.
Places we recorded: #1 Converge (13/13) · #2 Replit (5/13) · #3 v0 (3/13) · #4 Bolt (2/13) · #5 Lovable (0/13)
Conflict of interest: Strong — Converge is the author's product and finished 13/13 while competitors scored ≤5. Treat as vendor-adjacent.
Useful checklist detail; tallies still counted but COI flagged on the site.
From Prompt to Product: Human-Centered Benchmark (Replit, Bolt, Firebase Studio)
Marcos Ortiz, Justin Hill, Collin Overbay, Ingrida Semenec, Frederic Sauve-Hoover, Jim Schwoebel, Joel Shor · 2025-12 · mixed
Task: 96 prompts spanning domains/difficulty; 288 generated apps; 205 human raters; 1,071 pairwise comparisons after quality filtering.
Tools: ReplitBoltFirebase Studio
Result (as stated):
Pairwise win rates (Table 2): Firebase highest on all four metrics (Ease 42.5%, Trust 41.2%, Visual Appeal 45.5%, Visual Appropriateness 45.1%); Bolt second; Replit third. Authors' hierarchy: 'Firebase > Bolt > Replit'. Composite scores stated: Firebase 1.933, Bolt 1.561, Replit 1.302.
Places we recorded: #1 Firebase Studio (composite 1.933 / top win rates) · #2 Bolt (composite 1.561) · #3 Replit (composite 1.302)
Conflict of interest: Study funded by Quome Inc. (acknowledgements). Quome Cloud used for deployment.
Largest academic human study found. Does not include Lovable/v0/Base44.
WebApp Study: Evaluating AI-Native Web Application Builders
Deccan.ai research team (multiple annotators) · hand excluded from tallies
Task: 53 curated real-world tasks across Easy/Medium/Hard; seven rubrics (functionality, visual appeal, error handling, responsiveness, content quality, navigation, data consistency).
Tools: LovableBoltv0Firebase StudioReplit
Result (as stated):
No numeric leaderboard table was readable in the fetched HTML (Table 1.1 / charts are images). Qualitative claims on the page: 'Lovable stands out for its reliability, functional consistency, and polished design'; 'v0 maintains the highest functional testing and navigation scores across all complexities'; 'Replit underperforms across most metrics'; 'Lovable and Bolt excel visually but lack backend robustness'; 'Firebase GenAI Studio's full-stack support' highlighted. 'No single tool demonstrates comprehensive reliability.'
Conflict of interest: Independent research firm; no vendor sponsorship stated on the opened page.
Included for methodology/quotes only — NOT counted in 1st/top-3/last tallies because numeric/place rankings were not extractable from opened text.
Reddit r/vibecoding: same booking app prompt across 6 builders
unknown (page blocked) · hand not verified excluded from tallies
Task: Appointment booking app with customer accounts, staff page, DB, email API that must fail visibly, public deploy (per search-snippet summary — NOT verified from page body).
Tools: EmergentLovableBoltReplitv0Base44
Result (as stated):
NOT VERIFIED. Search snippets suggest no single clear winner and situational guidance; do not treat as scored.
Conflict of interest: Unknown.
Listed so we don't pretend it was read. Excluded from tallies.