ModelGuide demo

Model Guide

The five best ways to do this job with AI this month, tested by Redrob on real work from the profession. Pick one to use it in the chat.

I work as

I want to

Top 5 for a lawyer drafting contracts

Redrob Leaderboard · September 2026 · Updated monthly · Priced for about 12 contracts drafted a month

#1 for draft contractsBest pick

Claude Opus 5.5 on Redrob Desk

High effort

$16/moPriced for about 12 contracts drafted a month.

Drafts from the term sheet, your templates and past deals in the folder, and keeps defined terms consistent.

What it was asked

Draft a master services agreement from the attached term sheet (Seorin Construction, KRW 2.1bn over 24 months) on our MSA template. Keep our standard liability and IP positions and flag anything the term sheet leaves open.

What it wroteSample output, illustrative

MASTER SERVICES AGREEMENT between [Client] ("Customer") and Seorin Construction Co., Ltd. ("Supplier") 1. Definitions "Fees" means the fees in Schedule 1, KRW 2,100,000,000 over the Term. "Term" means 24 months from the Effective Date, unless ended earlier under clause 18. "Customer Materials" means any data, drawings or specifications the Customer provides. 2. Services. The Supplier shall provide the Services in Schedule 2 to the standard in Schedule 3. 6. Payment. The Customer shall pay undisputed invoices within thirty (30) days of receipt. 11. Confidentiality. Obligations survive for five (5) years after the Term. 14. Limitation of liability 14.1 Each party's total liability shall not exceed the Fees paid in the twelve (12) months before the claim. 14.2 Nothing limits liability for fraud, death or personal injury, or breach of clause 11. 15. Intellectual property. Customer Materials and all deliverables made from them belong to the Customer. 18. Termination. Either party may end this Agreement for convenience on ninety (90) days' notice, subject to clause 18.3. Open points from the term sheet (3) 1. Acceptance testing: the term sheet is silent. We have used our standard 10-day test in Schedule 4. 2. Data residency: not addressed. Bracketed option in clause 12. 3. Step-in rights: not addressed. Not included; confirm whether wanted.

How this score was calculated

Dimension	Measured	Score	Weight	Points
Quality	rubric 9.0 / 10 (experts 9.2, judges 8.8)	90.0	× 0.55	49.5
Reliability	96 of 100 runs passed	96.0	× 0.25	24.0
Speed	median 5.0 min a task	89.4	× 0.05	4.5
Cost	$16 a month	63.8	× 0.15	9.6
Score	95% interval ±1.2			87.5

Score = 0.55 Quality + 0.25 Reliability + 0.05 Speed + 0.15 Cost. Speed = 100 x sqrt(fastest median / this median). Cost = 100 x sqrt(cheapest month / this month).

Model ID: claude-opus-5-5
Effort setting: effort: "high"
Harness: Redrob Desk
Runs: 20 prompts x 5 runs
Tokens a task: 150k in, 25k out, x1.5 at High effort
Price per 1M tokens: $4 in, $20 out
Graders: 2 lawyers, 3 model judges
Judge agreement: kappa 0.74

Graders’ note Used the house template and kept every standard position; defined terms consistent throughout.

See the full run

How Redrob tests and ranks

Draft method. Each monthly edition runs every combination of model, harness and effort Redrob can reach on 20 prompts per task, five times each. The prompts are written with people who do the work, from the task’s own profession.

Quality: two professionals grade every output blind against the task’s rubric, and three model judges from makers other than the one being graded grade it too. Quality is 60% the professionals and 40% the judges, shown with how far the judges agreed (Cohen’s kappa).

Reliability is the share of the 100 runs that reached 7 out of 10 on the rubric. Speed and cost are scored against the best in the task on a square root, so a cheap or fast model cannot win on that alone. Weights differ by task and are shown with every score.

The interval is a 95% bootstrap over prompts and runs; where two intervals overlap, the order between them is not settled. Prices are a typical month of this task at each maker’s published API price, before discounts, in the currency of the page’s language.

In this edition the figures and the output excerpts are sample content written for the design system, not real runs. Check every citation and clause before you rely on it.