GLM 5

Z.ai

200K context$1.00/M input$3.20/M output

1549peak 1550

Avg Score

73.2

Avg Cost

$0.15

Score/$

493.0

Runs

124

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

refactoringexpert

2422

backendeasy

2110

from-scratchexpert

2052

multi-languagehard

1963

frontendexpert

1921

frontendeasy

1748

full-stackhard

1705

debugginghard

1672

full-stack

1643

debuggingmedium

1609

backendmedium

1604

debugging

1592

frontendmedium

1584

debuggingexpert

1577

full-stackmedium

1569

from-scratchhard

1565

backend

1562

frontend

1558

refactoring

1551

backendhard

1544

from-scratch

1540

code-reviewhard

1521

backendexpert

1470

refactoringmedium

1456

multi-language

1402

from-scratcheasy

1386

code-review

1335

code-reviewmedium

1266

from-scratchmedium

1235

frontendhard

1147

multi-languageexpert

465

All Results

Task	Category	Score	Duration	Cost
Build codebase indexer for LLM context windows	from-scratch	50.1	4m 35s	$0.06
Fix N+1 query in dashboard	backend	57.2	5m 28s	$0.06
Fix deadlocking transaction patterns in Flask app	backend	70.0	5m 2s	$0.06
Fix 12 WCAG accessibility violations in checkout form	frontend	72.6	5m 7s	$0.14
Add rate limiting middleware	backend	82.5	4m 17s	$0.04
Convert React app to PWA with offline support	frontend	60.5	10m 42s	$0.29
Dockerize Node.js monorepo	full-stack	77.0	51.1s	$0.05
Fix flaky test suite	debugging	86.7	1m 44s	$0.01
Add Redis caching layer to Express API	backend	85.8	3m 8s	$0.11
Optimize bloated React bundle under 500KB	frontend	83.0	4m 27s	$0.07
Debug and fix 6 broken database triggers and constraints	debugging	88.8	1m 5s	$0.02
Fix broken GitHub Actions CI pipeline	debugging	82.9	2m 36s	$0.10
Replace console.log with structured logging	refactoring	57.2	3m 36s	$0.11
Refactor monolithic handler to CQRS	refactoring	81.0	3m 41s	$0.12
Fix data integrity bugs in denormalized e-commerce schema	debugging	79.7	2m 54s	$0.04
Add Google OAuth2 login to Express app	full-stack	84.6	3m 25s	$0.11
Port Python CLI to Rust	multi-language	34.3	6m 50s	$0.06
Build CLI tool with subcommands and config	from-scratch	68.3	12m 50s	$0.14
Build terminal UI dashboard	from-scratch	58.8	3m 18s	$0.04
Fix Node.js stream backpressure causing OOM on large files	backend	89.8	3m 47s	$0.11
Fix memory leak in event handler	debugging	82.4	2m 11s	$0.10
Harden insecure Docker setup with 12 vulnerabilities	code-review	73.3	2m 14s	$0.06
Zero-downtime schema migration	full-stack	81.9	2m 49s	$0.02
Add retry logic and dead letter queue to Python task queue	backend	76.5	4m 59s	$0.05
Add file upload with S3 presigned URLs	backend	85.2	2m 17s	$0.10
Debug race condition in worker pool	debugging	91.8	33.2s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	82.4	4m 3s	$0.12
Add caching layer to eliminate slow SSR page loads	full-stack	82.0	3m 54s	$0.08
Implement transformer inference engine with KV cache	from-scratch	85.5	2m 30s	$0.02
Implement zero-trust API authentication layer	backend	52.8	7m 33s	$0.14
Build MCP server for database management	backend	83.6	2m 8s	$0.02
Fix hallucination and context window bugs in RAG agent	backend	64.8	15m 5s	$0.15
Add streaming SSE endpoint for LLM chat	backend	84.2	2m 44s	$0.10
Migrate callback-hell Express app to async/await	refactoring	69.2	3m 50s	$0.07
Build LLM evaluation harness with structured grading	backend	79.7	4m 60s	$0.05
Fix race conditions in order matching engine	backend	79.2	5m 1s	$0.06
Add WebSocket real-time updates	full-stack	79.5	36.6s	$0.05
Remove AI slop and over-engineering from codebase	refactoring	84.5	1m 14s	$0.04
Write Kubernetes manifests for Node.js microservice	full-stack	84.8	1m 26s	$0.05
Build REST API from scratch	from-scratch	77.3	1m 33s	$0.02
Add i18n with locale routing to Next.js app	full-stack	73.5	4m 17s	$0.08
Write complex SQL report with window functions	backend	62.6	6m 42s	$0.08
Fix auth bypass vulnerability	debugging	88.8	2m 23s	$0.10
Implement JWT auth middleware	backend	53.0	3m 47s	$0.11
Add cursor-based pagination to REST API	backend	81.8	2m 27s	$0.10
Optimize slow Postgres queries in Flask app	backend	88.0	2m 30s	$0.03
Add GraphQL layer over REST API	multi-language	80.9	1m 57s	$0.10
Implement multi-tenant row-level security in Postgres	backend	55.2	5m 6s	$0.12
Find and fix 4 hidden backdoors in Flask app	debugging	91.3	57.0s	$0.01
Build distributed node cluster with gossip protocol	from-scratch	70.8	2m 16s	$0.02
Implement Stripe webhook handler	backend	78.3	2m 37s	$0.10
Build real-time portfolio risk calculator	backend	71.0	16m 41s	$0.18
Find and patch all OWASP Top 10 vulnerabilities	debugging	70.0	3m 25s	$0.07
Build materialized view refresh pipeline for analytics	backend	70.3	4m 36s	$0.06
Fix broken responsive layout	frontend	77.0	2m 25s	$0.12
Build production website with auth and members area	frontend	72.1	22m 29s	$0.32
Split 1100-line god file into proper modules	refactoring	60.5	6m 1s	$0.11
Add slash commands and moderation to Discord bot	backend	74.3	4m 25s	$0.05
Implement background job scheduler with persistence	backend	71.7	6m 55s	$0.08
Build RAG pipeline with vector search	backend	60.1	4m 30s	$0.05
Fix React hydration mismatch	frontend	82.2	1m 34s	$0.10
Write tests for untested legacy Flask service	code-review	59.5	9m 34s	$0.12
Code review: identify security vulns	code-review	27.1	2m 17s	$0.10
Build SaaS admin dashboard from scratch	from-scratch	61.1	9m 55s	$0.12
Write integration tests for payment flow	code-review	71.2	4m 58s	$0.13
Implement zero-trust API authentication layer	backend	71.8	17m 41s	$1.40
Optimize bloated React bundle under 500KB	frontend	75.0	13m 10s	$1.07
Add caching layer to eliminate slow SSR page loads	full-stack	81.5	10m 41s	$0.58
Write Kubernetes manifests for Node.js microservice	full-stack	88.4	4m 0s	$0.10
Dockerize Node.js monorepo	full-stack	83.5	2m 42s	$0.05
Find and patch all OWASP Top 10 vulnerabilities	debugging	73.7	12m 45s	$0.48
Harden insecure Docker setup with 12 vulnerabilities	code-review	78.8	3m 34s	$0.07
Convert React app to PWA with offline support	frontend	3.0	6m 46s	$0.02
Fix broken responsive layout	frontend	77.2	3m 47s	$0.09
Remove AI slop and over-engineering from codebase	refactoring	82.9	4m 8s	$0.26
Build codebase indexer for LLM context windows	from-scratch	49.8	13m 20s	$1.47
Replace console.log with structured logging	refactoring	47.0	13m 51s	$0.99
Implement multi-tenant row-level security in Postgres	backend	75.2	18m 6s	$1.38
Split 1100-line god file into proper modules	refactoring	66.3	16m 43s	$1.20
Implement JWT auth middleware	backend	79.2	4m 46s	$0.14
Add i18n with locale routing to Next.js app	full-stack	75.0	15m 41s	$0.74
Add streaming SSE endpoint for LLM chat	backend	78.4	10m 38s	$1.26
Build CLI tool with subcommands and config	from-scratch	69.3	6m 14s	$0.05
Build production website with auth and members area	frontend	77.4	9m 57s	$0.14
Build MCP server for database management	backend	82.4	4m 27s	$0.04
Implement background job scheduler with persistence	backend	45.5	3m 37s	$0.03
Build SaaS admin dashboard from scratch	from-scratch	75.8	6m 46s	$0.06
Implement transformer inference engine with KV cache	from-scratch	87.7	9m 19s	$0.07
Add cursor-based pagination to REST API	backend	71.2	2m 31s	$0.02
Fix data integrity bugs in denormalized e-commerce schema	debugging	77.6	4m 47s	$0.05
Add retry logic and dead letter queue to Python task queue	backend	43.3	7m 16s	$0.06
Write complex SQL report with window functions	backend	83.5	4m 2s	$0.04
Add slash commands and moderation to Discord bot	backend	69.1	3m 31s	$0.03
Build LLM evaluation harness with structured grading	backend	63.5	7m 17s	$0.10
Fix hallucination and context window bugs in RAG agent	backend	57.0	5m 2s	$0.06
Implement Stripe webhook handler	backend	79.7	1m 51s	$0.02
Build real-time portfolio risk calculator	backend	74.0	3m 23s	$0.04
Debug and fix 6 broken database triggers and constraints	debugging	80.7	4m 59s	$0.05
Fix deadlocking transaction patterns in Flask app	backend	73.0	3m 37s	$0.04
Find and fix 4 hidden backdoors in Flask app	debugging	91.7	3m 52s	$0.04
Write tests for untested legacy Flask service	code-review	45.9	8m 15s	$0.08
Add Redis caching layer to Express API	backend	82.2	1m 52s	$0.03
Optimize slow Postgres queries in Flask app	backend	86.7	7m 3s	$0.05
Fix broken GitHub Actions CI pipeline	debugging	93.3	3m 41s	$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	81.6	4m 37s	$0.05
Fix 12 WCAG accessibility violations in checkout form	frontend	82.5	2m 41s	$0.04
Fix Node.js stream backpressure causing OOM on large files	backend	89.8	1m 20s	$0.02
Build distributed node cluster with gossip protocol	from-scratch	63.3	5m 28s	$0.02
Fix flaky test suite	debugging	82.5	11m 17s	$0.02
Write integration tests for payment flow	code-review	37.2	3m 14s	$0.04
Fix auth bypass vulnerability	debugging	93.7	1m 7s	$0.02
Add GraphQL layer over REST API	multi-language	75.5	1m 14s	$0.02
Zero-downtime schema migration	full-stack	72.2	1m 47s	$0.02
Add rate limiting middleware	backend	87.5	2m 25s	$0.03
Fix N+1 query in dashboard	backend	88.4	3m 2s	$0.03
Fix React hydration mismatch	frontend	69.5	3m 28s	<$0.01
Build terminal UI dashboard	from-scratch	70.9	2m 2s	$0.02
Refactor monolithic handler to CQRS	refactoring	66.0	1m 50s	$0.02
Code review: identify security vulns	code-review	65.5	52.3s	$0.01
Fix memory leak in event handler	debugging	60.9	32.7s	<$0.01
Add WebSocket real-time updates	full-stack	78.2	25.2s	<$0.01
Debug race condition in worker pool	debugging	90.3	38.9s	<$0.01
Fix race conditions in order matching engine	backend	69.8	4m 24s	$0.05
Build REST API from scratch	from-scratch	67.9	58.4s	<$0.01