Cline

Sources#

What it is#

An open-source coding agent distributed primarily as a VS Code extension, model-agnostic by design: users bring their own provider keys (OpenRouter, Anthropic, OpenAI, local) rather than being tied to one lab's model. That model-agnosticism is the product position — Cline competes on harness quality rather than on owning the weights, and it markets specific model/harness pairings ("Cline is the best harness to run Kimi K3"). It ships ClinePass, a $9.99/month subscription giving subsidized inference on curated open-weight models (Kimi K3, DeepSeek, GLM, MiniMax, Qwen) at 2–5× standard rate limits with no separate provider keys — an open-weight-first commercial bet, distinct from the frontier-lab subscriptions it sits alongside.

Cline is also an MCP client: it is one of the two clients (v3.35.0) used in the MCP tool-poisoning benchmark documented in MCP Tool Poisoning, so it appears in this corpus both as an attack surface and as a benchmarking party.

Hill climbing as a published practice#

What makes Cline unusual as a source is that it treats benchmark hill-climbing as a documented methodology rather than a marketing output, and publishes the losing experiments alongside the winning ones.

Jan 2026 — took Opus 4.5 from 47% → 57% on Terminal-Bench. Four engineers, roughly two weeks, by hand: reading model traces, forming hypotheses, testing fixes.
Feb 2026 — published the resulting playbook ("A Practical Guide to Hill Climbing").
Jul 2026 — ran the same climb autonomously: one prompt, GPT-5.6-Sol as leader model, 17 unattended hours, ~1B tokens and ~$680, moving Cline + Kimi K3 from 77.5% ($79) to 88.8% ($49.8) on Terminal-Bench 2.1 and matching Moonshot's own vendor-reported SOTA of 88.3%. The full account is in Agent-Authored Harness Optimization.

Cline says it is making this a standard release ritual: a baseline run on every new model, then an autonomous optimization campaign against it.

The 77.5% → 88.8% claim is contested as of 2026-08-04, and the numbers are not in dispute — the attribution is. Wang et al. (arXiv 2607.12227, Ai2 / UW, empirical) run budget-matched baselines on the same benchmark, Terminal-Bench 2.1, with Claude Opus 4.6 and GPT-5.4. Give plain parallel sampling the same inference budget an evolution loop would spend and it beats automatic harness evolution on every model tested (72.3 vs 67.4 average pass@1 without unit-test feedback; 86.0 vs 75.8 with), and an evolved harness transfers +0.6pp to held-out tasks from the same suite. Cline's campaign reports no budget-matched baseline and no held-out split, so it cannot separate "the harness got better" from "we spent 17 hours and ~1B tokens searching." Two qualifications in Cline's favour: Wang et al. never ran Cline's harness or Cline's model, and Cline's five fixes were repairs to genuine defects in a mature production harness — a different task from improving an already-adequate minimal one, and the one place this critique has least purchase. The full three-way weighing is on Agent-Authored Harness Optimization.

How to weight Cline as a source#

case-study. Cline benchmarks its own harness, publishes its own scores, and does so on a suite it has been optimizing against since at least January 2026. Traces, cost breakdowns and the merged PR are posted publicly, which is more disclosure than most vendors offer and still not third-party replication. The July 2026 post also reports its own negative results — an experiment that got no causal credit, a fix that only partially worked, two runs invalidated and thrown out — which is the main reason to extend it credit. Comparisons it draws against other models' benchmark costs are not harness-controlled (Compute-Controlled Benchmarking).

The missing control now has a name and a measurement behind it. What Cline never ran is a budget-matched baseline — the same compute spent sampling repeatedly instead of rewriting the scaffold — and an empirical third party has since shown that on this exact benchmark the baseline wins. That does not make the 88.8% wrong; it makes the causal story ("the harness improved") unsupported by Cline's own design. Read the campaign as a build log with a score attached, not as evidence about what harness evolution buys.

An outside observation of Anthropic's fallback#

Cline attempted the same autonomous campaign with Claude Fable 5 as leader model and abandoned it: the safety classifier "kept downgrading the model to Opus-4.8." One vendor's passing remark rather than a measurement, but it is a third-party instance of the routing mechanism in Capability-Gated Model Fallback biting a real workload — AI evals research on a coding harness, with no cyber or bio framing.

Connections#

Agent-Authored Harness Optimization — Cline's July 2026 campaign is the corpus's first end-to-end instance, and the page that weighs the result
Agent Harness Engineering — Cline's competitive position is harness quality on top of other labs' models; the five bugs its agent fixed are textbook harness defects
Kimi (Moonshot AI) — the open-weight model Cline pairs itself with, both in the benchmark campaign and in ClinePass
Capability-Gated Model Fallback — Cline is the outside party that reports abandoning Fable 5 for evals research because of classifier downgrades
MCP Tool Poisoning — Cline v3.35.0 as one of the two MCP clients in the tool-poisoning benchmark
The Open-Weight Frontier Gap — ClinePass is a commercial bet that curated open-weight models are good enough for daily coding work at subscription prices

Sources#

Recursive Self Improvement for Coding Agents — Ara Khan, Cline blog, 2026-07-24 (case-study): the autonomous campaign, the Jan-2026 four-engineer contrast, ClinePass pricing, and the abandoned Fable 5 arm
ShareLock: A Stealthy Multi-Tool Threshold Poisoning Attack Against MCP — Cline v3.35.0 as one of the two evaluated MCP clients (§5)