Qwen3.5 27b [Q4_K_M]

LM Studio

262K context<$0.01/M input<$0.01/M output

1361peak 1362

Avg Score

63.1

Avg Cost

$0.18

Score/$

342.2

Runs

117

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

frontendhard

1816

debuggingmedium

1815

refactoringexpert

1635

frontendexpert

1532

frontend

1442

frontendeasy

1425

debugging

1423

backendmedium

1421

full-stackmedium

1420

full-stack

1395

frontendmedium

1379

code-reviewmedium

1371

code-review

1361

full-stackhard

1361

backend

1345

backendhard

1341

refactoring

1334

debuggingexpert

1319

from-scratcheasy

1314

from-scratchmedium

1303

debugginghard

1301

refactoringmedium

1263

from-scratch

1229

backendexpert

1211

code-reviewhard

1175

from-scratchhard

1118

multi-language

1070

backendeasy

683

multi-languageexpert

535

multi-languagehard

296

from-scratchexpert

194

All Results

Task	Category	Score	Duration	Cost
Implement background job scheduler with persistence	backend	53.0	7m 54s	$0.06
Fix data integrity bugs in denormalized e-commerce schema	debugging	71.8	14m 44s	$0.10
Build RAG pipeline with vector search	backend	42.6	25m 40s	$0.16
Migrate callback-hell Express app to async/await	refactoring	54.1	3m 56s	$0.10
Build terminal UI dashboard	from-scratch	60.4	2m 24s	$0.02
Build real-time portfolio risk calculator	backend	56.6	18m 5s	$0.12
Implement multi-tenant row-level security in Postgres	backend	40.3	7m 18s	$0.12
Build production website with auth and members area	frontend	67.3	19m 19s	$0.11
Optimize bloated React bundle under 500KB	frontend	70.8	4m 50s	$0.06
Fix auth bypass vulnerability	debugging	28.0	28m 17s	$0.27
Add file upload with S3 presigned URLs	backend	80.9	4m 2s	$0.11
Write Kubernetes manifests for Node.js microservice	full-stack	81.1	2m 3s	$0.05
Fix React hydration mismatch	frontend	73.9	30m 57s	$0.27
Write tests for untested legacy Flask service	code-review	50.9	5m 47s	$0.05
Write complex SQL report with window functions	backend	50.1	5m 27s	$0.05
Build CLI tool with subcommands and config	from-scratch	42.3	4m 14s	$0.04
Fix N+1 query in dashboard	backend	55.9	12m 34s	$0.08
Optimize slow Postgres queries in Flask app	backend	74.1	1m 44s	$0.02
Implement Stripe webhook handler	backend	78.7	1m 43s	$0.09
Add i18n with locale routing to Next.js app	full-stack	63.8	5m 36s	$0.07
Build codebase indexer for LLM context windows	from-scratch	38.8	4m 15s	$0.05
Build distributed node cluster with gossip protocol	from-scratch	37.4	14m 49s	$0.09
Add streaming SSE endpoint for LLM chat	backend	85.3	2m 10s	$0.10
Add retry logic and dead letter queue to Python task queue	backend	9.6	48m 32s	$0.29
Add rate limiting middleware	backend	44.3	1m 54s	$0.02
Remove AI slop and over-engineering from codebase	refactoring	78.3	1m 29s	$0.04
Debug and fix 6 broken database triggers and constraints	debugging	75.5	3m 1s	$0.04
Fix flaky test suite	debugging	89.8	1m 7s	<$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	78.7	1m 39s	$0.02
Add slash commands and moderation to Discord bot	backend	69.8	16m 22s	$0.10
Build REST API from scratch	from-scratch	75.1	1m 6s	<$0.01
Write integration tests for payment flow	code-review	66.0	6m 54s	$0.12
Harden insecure Docker setup with 12 vulnerabilities	code-review	83.5	1m 16s	$0.05
Add caching layer to eliminate slow SSR page loads	full-stack	82.4	2m 17s	$0.06
Zero-downtime schema migration	full-stack	70.5	58.4s	$0.01
Fix broken responsive layout	frontend	71.3	1m 58s	$0.06
Implement JWT auth middleware	backend	45.7	1m 44s	$0.10
Add WebSocket real-time updates	full-stack	73.9	2m 18s	$0.10
Build SaaS admin dashboard from scratch	from-scratch	47.5	11m 16s	$0.08
Build MCP server for database management	backend	55.8	3m 5s	$0.03
Add GraphQL layer over REST API	multi-language	62.7	18m 1s	$0.21
Fix hallucination and context window bugs in RAG agent	backend	63.0	24m 34s	$0.14
Fix Node.js stream backpressure causing OOM on large files	backend	79.3	17m 44s	$0.21
Fix deadlocking transaction patterns in Flask app	backend	72.8	2m 36s	$0.02
Implement transformer inference engine with KV cache	from-scratch	43.0	30m 12s	$0.16
Replace console.log with structured logging	refactoring	36.4	29m 30s	$0.27
Find and patch all OWASP Top 10 vulnerabilities	debugging	66.3	4m 6s	$0.06
Add Google OAuth2 login to Express app	full-stack	66.3	4m 27s	$0.11
Debug race condition in worker pool	debugging	82.4	17.1s	<$0.01
Fix race conditions in order matching engine	backend	56.4	3m 47s	$0.04
Build materialized view refresh pipeline for analytics	backend	74.8	4m 16s	$0.03
Add Redis caching layer to Express API	backend	81.7	3m 9s	$0.10
Add cursor-based pagination to REST API	backend	47.3	27m 35s	$0.27
Dockerize Node.js monorepo	full-stack	66.6	2m 19s	$0.06
Split 1100-line god file into proper modules	refactoring	50.3	5m 45s	$0.07
Fix memory leak in event handler	debugging	44.9	29m 19s	$0.28
Fix broken GitHub Actions CI pipeline	debugging	93.0	58.2s	$0.05
Fix 12 WCAG accessibility violations in checkout form	frontend	83.3	4m 1s	$0.06
Convert React app to PWA with offline support	frontend	75.9	16m 37s	$0.21
Add virtual scrolling to table rendering 5000 rows	frontend	45.5	16m 50s	$0.22
Implement zero-trust API authentication layer	backend	28.0	5m 31s	$0.07
Port Python CLI to Rust	multi-language	35.5	25m 29s	$0.15
Code review: identify security vulns	code-review	49.1	3m 1s	$0.10
Add GraphQL layer over REST API	multi-language	44.5	34m 12s	$3.59
Migrate callback-hell Express app to async/await	refactoring	75.4	13m 54s	$1.30
Implement multi-tenant row-level security in Postgres	backend	75.8	28m 52s	$1.35
Optimize bloated React bundle under 500KB	frontend	71.5	20m 9s	$0.77
Convert React app to PWA with offline support	frontend	44.2	40m 13s	$0.47
Fix broken responsive layout	frontend	64.7	7m 11s	$0.21
Dockerize Node.js monorepo	full-stack	67.9	1m 41s	$0.05
Harden insecure Docker setup with 12 vulnerabilities	code-review	89.6	1m 25s	$0.03
Build codebase indexer for LLM context windows	from-scratch	35.8	41m 31s	$0.71
Replace console.log with structured logging	refactoring	54.2	32m 45s	$0.83
Find and patch all OWASP Top 10 vulnerabilities	debugging	70.2	20m 23s	$0.84
Split 1100-line god file into proper modules	refactoring	71.9	22m 4s	$1.04
Implement JWT auth middleware	backend	77.5	13m 30s	$0.36
Add caching layer to eliminate slow SSR page loads	full-stack	81.2	4m 34s	$0.14
Add i18n with locale routing to Next.js app	full-stack	67.3	19m 46s	$0.68
Implement zero-trust API authentication layer	backend	73.2	18m 27s	$0.83
Remove AI slop and over-engineering from codebase	refactoring	80.0	10m 30s	$0.55
Write Kubernetes manifests for Node.js microservice	full-stack	84.9	3m 10s	$0.08
Build distributed node cluster with gossip protocol	from-scratch	60.0	44m 11s	$0.63
Build MCP server for database management	backend	58.8	2m 1s	$0.01
Build CLI tool with subcommands and config	from-scratch	41.5	8m 55s	$0.03
Build production website with auth and members area	frontend	60.0	17m 27s	$0.06
Implement background job scheduler with persistence	backend	20.5	5m 40s	$0.02
Fix hallucination and context window bugs in RAG agent	backend	67.8	2m 54s	$0.02
Build LLM evaluation harness with structured grading	backend	47.8	4m 16s	$0.02
Implement transformer inference engine with KV cache	from-scratch	12.7	43m 48s	$0.14
Build real-time portfolio risk calculator	backend	79.0	7m 14s	$0.03
Fix race conditions in order matching engine	backend	84.3	4m 38s	$0.02
Fix data integrity bugs in denormalized e-commerce schema	debugging	70.5	6m 17s	$0.03
Build materialized view refresh pipeline for analytics	backend	52.0	8m 3s	$0.03
Fix deadlocking transaction patterns in Flask app	backend	50.6	6m 20s	$0.03
Debug and fix 6 broken database triggers and constraints	debugging	47.4	3m 59s	$0.02
Write complex SQL report with window functions	backend	58.4	6m 46s	$0.03
Find and fix 4 hidden backdoors in Flask app	debugging	91.5	3m 19s	$0.01
Write tests for untested legacy Flask service	code-review	60.4	8m 36s	$0.03
Add Google OAuth2 login to Express app	full-stack	62.9	3m 40s	$0.02
Optimize slow Postgres queries in Flask app	backend	62.9	2m 46s	$0.01
Add slash commands and moderation to Discord bot	backend	44.8	3m 40s	$0.01
Add retry logic and dead letter queue to Python task queue	backend	68.9	26m 32s	$0.08
Fix Node.js stream backpressure causing OOM on large files	backend	70.9	2m 24s	$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	78.5	3m 17s	$0.02
Fix 12 WCAG accessibility violations in checkout form	frontend	77.8	5m 44s	$0.03
Fix auth bypass vulnerability	debugging	94.5	1m 24s	$0.01
Write integration tests for payment flow	code-review	60.8	6m 17s	$0.03
Zero-downtime schema migration	full-stack	66.5	1m 38s	<$0.01
Add rate limiting middleware	backend	38.6	2m 11s	<$0.01
Fix flaky test suite	debugging	91.8	23m 30s	$0.07
Fix N+1 query in dashboard	backend	63.4	3m 5s	$0.01
Fix memory leak in event handler	debugging	71.5	52.9s	<$0.01
Refactor monolithic handler to CQRS	refactoring	67.6	2m 43s	$0.01
Debug race condition in worker pool	debugging	81.7	37.2s	<$0.01
Fix React hydration mismatch	frontend	76.5	45.3s	<$0.01
Build terminal UI dashboard	from-scratch	48.0	4m 6s	$0.01
Build REST API from scratch	from-scratch	79.8	1m 14s	<$0.01