Sources and claims #

Snapshot date: September 8, 2026, America/New_York. Retrieval timestamps use UTC, so September 9 UTC is still September 8 locally. Publication dates are not invented for mutable documents. This register exposes each interpretation and its limitations; detailed evaluation settings remain in the CSVs. No independent human review or original benchmark was performed.

Sources #

SR01 — GPT-6 Astra model #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:09Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR02 — Model guidance: GPT-6 Astra #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:27Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR03 — Claude Fable: availability, safeguards, retention #

Anthropic · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:09Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR04 — Claude Fable 5.1 overview #

Anthropic · official · opened. Published: 2026-09-01; updated: unknown; effective: 2026-09-01. Retrieved: 2026-09-09T01:15:31Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR05 — What is new in Claude Fable 5.1 #

Anthropic · official · opened. Published: 2026-09-01; updated: unknown; effective: 2026-09-01. Retrieved: 2026-09-09T01:15:31Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR06 — Introducing Fable 5.1 and Mythos 5.1 #

Anthropic · official · opened. Published: 2026-09-01; updated: unknown; effective: 2026-09-01. Retrieved: 2026-09-09T01:14:57Z. Revision: unknown. Launch page says September2026; exact release date confirmed in model overview. Vendor experiments and selected early-access testimonials.

SR07 — Introducing Claude Opus 5 #

Anthropic · official · opened. Published: 2026-07-24; updated: unknown; effective: 2026-07-24. Retrieved: 2026-09-09T01:14:27Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR08 — Prompt caching: pricing #

Anthropic · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:12Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR09 — Introducing Gemini 3.8 Flash and Flash Cyber #

Google · official · opened. Published: 2026-09-02; updated: unknown; effective: 2026-09-02. Retrieved: 2026-09-09T01:14:27Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR10 — Gemini Developer API pricing #

Google · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:31Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR11 — What is new in Gemini 3.8 Flash #

Google · official · opened. Published: 2026-09-02; updated: unknown; effective: 2026-09-02. Retrieved: 2026-09-09T01:15:31Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR12 — Gemini API Additional Terms of Service #

Google · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:12Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR13 — DeepSeek change log: August 13 and July 31 #

DeepSeek · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:12Z. Revision: unknown. Dated entries support July31/August13/August16 changes; page itself has no publication date.

SR14 — Integrate DeepSeek with Codex #

DeepSeek · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:57Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR15 — GPT-5.6 Sol model and promotional pricing #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:44Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR16 — Claude Sonnet 5 overview #

Anthropic · official · opened. Published: 2026-06-30; updated: unknown; effective: 2026-06-30. Retrieved: 2026-09-09T01:16:12Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR17 — DeepSeek Models & Pricing #

DeepSeek · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:24:02.264Z. Revision: unknown. Web extractor failed or returned wrong page; direct public HTTPS fetch succeeded with HTTP200. Model Details table inspected. No access control bypass. Exact effective start supported separately by August release note.

SR18 — DeepSeek Privacy Policy #

DeepSeek · official · opened. Published: unknown; updated: 2026-02-10; effective: unknown. Retrieved: 2026-09-09T01:24:27Z. Revision: unknown. Policy last updated2026-02-10. Scope excludes rules for downstream end-user personal-data processing.

SR19 — DeepSeek Open Platform Terms of Service #

DeepSeek · official · opened. Published: 2026-04-22; updated: unknown; effective: 2026-04-29. Retrieved: 2026-09-09T01:24:36Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SR20 — DeepSeek Responses compatibility details #

DeepSeek · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:24:36Z. Revision: unknown. Mutable source observed September 8 America/New_York (September 9 UTC); no hour-exact historical archive.

SGL01 — GLM-5.3 model card #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL02 — GLM-5.3 License #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: 3033303. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL03 — Qwen3.8-27B model card #

Qwen · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL04 — Kimi K3 model card #

Moonshot AI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL05 — MiniMax M3 model card #

MiniMax · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL06 — Kimi K3 License #

Moonshot AI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: c5d1dd4. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL07 — Z.ai model and tool API pricing #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Reopened at end of batch. Flash discount has explicit expiry 2026-09-09 24:00 UTC+8; report durable list rates separately. No separate cache-write price stated; storage temporarily free is not a cache-write token tariff.

SGL08 — GLM Coding Plan overview #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Reopened at end of batch. The public starting price is USD 18/month; exact Pro/Max checkout prices and campaign dates were not verified. Tier capacity estimates depend on cache mix, output mix and time of use.

SGL09 — Qwen3.5-4B model card #

Qwen · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL10 — Qwen3.5-9B model card #

Qwen · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL11 — GLM-5.3-Flash model card #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL12 — MiniMax Community License #

MiniMax · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL13 — Qwen3.8-Flash-Next model card #

Qwen · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL14 — GLM-5.3 model and migration documentation #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL15 — GLM-5.3-Flash MIT License #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL16 — Qwen Community License 1.0 #

Qwen · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Read during 2026-09-09 01:13–01:16 UTC batch; timestamp is batch-completion capture. Mutable page; no historical snapshot. No post-cutoff development knowingly used.

SGL17 — Z.ai release notes #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Release-note entries are dated August 18 for GLM-5.3 and August 26 for Flash. August 18 is not asserted as the first public announcement; discovery snippets dated August 14 were not adopted as primary evidence.

SGL18 — GLM-5.3 announcement blog #

Z.ai · official · blocked. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. Web extraction returned zero lines; model docs and official HF card used instead.

SGL19 — Qwen3.8-27B raw license attempt #

Qwen · official · blocked. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:21Z. Revision: unknown. The tool returned a non-retryable safe-open error. The Apache 2.0 designation is supported by the opened official model card; full license text was not inspected.

SH01 — GitHub Copilot in VS Code, August 2026 releases #

GitHub · official · opened. Published: 2026-08-31; updated: unknown; effective: 2026-08-31. Retrieved: 2026-09-09T01:13:56Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH02 — GPT-6 Astra is generally available in GitHub Copilot #

GitHub · official · opened. Published: 2026-09-04; updated: unknown; effective: 2026-09-04. Retrieved: 2026-09-09T01:13:56Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH03 — Copilot code review can now approve pull requests #

GitHub · official · opened. Published: 2026-09-01; updated: unknown; effective: 2026-09-01. Retrieved: 2026-09-09T01:13:56Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH04 — Content exclusions generally available in Copilot app and CLI #

GitHub · official · opened. Published: 2026-09-02; updated: unknown; effective: 2026-09-02. Retrieved: 2026-09-09T01:13:56Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH05 — Data usage #

Anthropic · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:21Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH06 — Usage-based billing for organizations and enterprises #

GitHub · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:21Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH07 — Data controls in the OpenAI platform #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:33Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH08 — Data Use & Privacy Overview #

Cursor · official · opened. Published: unknown; updated: 2026-09-03; effective: unknown. Retrieved: 2026-09-09T01:14:33Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH09 — Privacy and Data Governance #

Cursor · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:33Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH10 — Hosting of models for GitHub Copilot #

GitHub · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:33Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH11 — Team Pricing #

Cursor · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:05Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH12 — Models & Pricing #

Cursor · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:05Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH13 — Providers #

OpenCode · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:39Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH14 — External Agents #

Zed · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:39Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH15 — Pricing #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:39Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH16 — Claude Fable 5.1 is generally available in GitHub Copilot #

GitHub · official · opened. Published: 2026-09-01; updated: unknown; effective: 2026-09-01. Retrieved: 2026-09-09T01:15:39Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH17 — Admin rollout guide #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:10Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH18 — Agent approvals & security #

OpenAI · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:10Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SH19 — Plans for GitHub Copilot #

GitHub · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:23Z. Revision: unknown. First-party documentation; live page. Publication unknown unless recorded; no hands-on verification.

SO01 — We are Changing our Developer Productivity Experiment Design #

METR · research · opened. Published: 2026-02-24; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:18Z. Revision: unknown. Independent evaluator. Retains the early-2025 trial and reports severe selection and time-measurement limitations in its late-2025 follow-up. July’s full report already covered this follow-up.

SO02 — Measuring the Self-Reported Impact of Early-2026 AI on Technical Worker Productivity #

METR · research · opened. Published: 2026-05-11; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:18Z. Revision: unknown. Convenience sample recruited February–April 2026. Same organization as SO01, different study; not an independent replication.

SO03 — Terminal-Bench 4.0 #

Terminal-Bench / Harbor · official · opened. Published: 2026-08-28; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:25Z. Revision: unknown. Publication date established by the maintainer’s benchmarks index. The announcement says 19 tasks fixed; the Snorkel contributor page says 20 revised. Use the maintainer’s 19 and record this discrepancy.

SO04 — Release v4.0.0 #

Harbor Framework · official · opened. Published: 2026-08-26; updated: unknown; effective: 2026-08-26. Retrieved: 2026-09-09T01:15:25Z. Revision: v4.0.0 / 452bf30. GitHub release precedes the August 28 announcement. Contains removed and modified task lists; code release and announcement dates differ.

SO05 — Terminal-Bench 4.0 leaderboard #

Snorkel AI · research · opened. Published: 2026-08-29; updated: 2026-09-04; effective: 2026-09-08. Retrieved: 2026-09-09T01:14:59Z. Revision: 4.0.0; observed HTML sha256:8725f738659552aa5a46872a21cbc323471d78fbc0e3ae79894b92df45649add. Snorkel is a task author, data partner and funder; its page presents the Harbor evaluation, not a second replication. Direct HTML metadata gives publication August 29 and modification September 4. Two schema blocks differ by seven hours but agree on dates. Current table observed September 8 America/New_York; exact evaluation dates remain unknown. Reported error bars are described only as margins reflecting run-to-run variance, not verified 95% confidence intervals. Exact harness versions, trial counts and resource budgets are absent. Final recheck: 2026-09-09T01:28:27Z.

SO06 — Agent Security League #

Endor Labs · research · opened. Published: unknown; updated: unknown; effective: 2026-09-04. Retrieved: 2026-09-09T01:14:18Z. Revision: unknown. Security vendor evaluating third-party coding agents, with a commercial interest in security tooling. Rechecked 2026-09-09T01:28:27Z (September 8 America/New_York): Fable 5.1 row remains dated September 4 and reports 87.2% FuncPass, 37.4% SecPass. No post-cutoff row date was observed. Direct HTML supplies no publication/modification metadata. The landing page says 200 tasks while the whitepaper specifies 179 feasible cases; exact September row denominator remains unknown.

SO07 — Agent Security League: Evaluating the Security of AI-Coded Software #

Endor Labs · research · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:46Z. Revision: unknown. Primary evaluator whitepaper; same experiment family as SO06. Specifies 179 feasible cases out of 200, with adjusted scores after cheating detection. Exact September run settings are not established.

SO08 — GitInject: Real-World Prompt Injection Attacks in AI-Powered CI/CD Pipelines #

Isbarov et al. / arXiv · research · opened. Published: 2026-06-07; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:14:46Z. Revision: arXiv:2606.09935v1. Primary preprint, version 1. Tested specific CI/CD workflow configurations and older model versions through real ephemeral GitHub workflows. No September frontier comparison.

SO09 — The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers #

Cui et al. / Microsoft Research · research · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:01Z. Revision: unknown. Page labeled June 2025; exact day unknown. Vendor-affiliated randomized field studies of a code-completion assistant, rather than current autonomous agents. A later 2026 journal publication was discovered but not opened.

SO10 — Astra vs. Fable 5.1 on real ML tasks: tradeoffs, strengths, shortcomings #

u/returnity / Reddit · first-hand · opened. Published: unknown; updated: unknown; effective: 2026-09-08. Retrieved: 2026-09-09T01:15:25Z. Revision: unknown. One student’s first-hand comparison, observed by September 8 America/New_York. The search index says September 5, but the opened page has an inconsistent relative header. Direct public HTML contains no creation timestamp; public JSON returns 403 and the old view redirects to login, so the exact publication date remains unknown. The same content is crossposted in r/OpenAI and r/ArtificialInteligence and is deduplicated. No affiliation is disclosed; outcomes were not independently reproduced. Rechecked 2026-09-09T01:28:27Z.

SO11 — Fable 5.1 vs GPT-6 Astra: same price, different output compliance #

3h4x · first-hand · opened. Published: 2026-09-07; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:25Z. Revision: unknown. Original six-task, two-run experiment with raw traces opened. Author alias; affiliation unknown. Secondary aggregate benchmark and pricing claims in the post are not used.

SO12 — Raw results: Fable 5.1 vs GPT-6 Astra #

3h4x · first-hand · opened. Published: 2026-09-07; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:32Z. Revision: file path dated2026-09-07; commit unknown. Same author and experiment as SO11. Raw records confirm the arithmetic output-format failure. Harnesses differ, so the records do not isolate raw model capability.

SO13 — What’s the Best Coding Agent? 2026 Edition #

Tim Sehn / DoltHub · first-hand · opened. Published: 2026-08-05; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:15:25Z. Revision: unknown. DoltHub CEO describes his own embedded-C database project; commercial interest in DoltLite. Subjective ratings and personal subscription use, without a controlled task denominator. Predates Astra and Fable 5.1; personal prices are not used as September prices.

SO14 — Reflections: 6 months of Agentic Engineering #

David Vujic · first-hand · opened. Published: 2026-06-28; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:16:49Z. Revision: unknown. Developer and Polylith Python tooling maintainer describes his team workflow. A positive counterexample to a universal review-bottleneck claim, without causal measurement. Only the June 28 post is used.

SO15 — (Im)Paired Programming: Coding Agents Improve Productivity but Harm Understanding #

Balepur et al. / arXiv · research · opened. Published: 2026-07-29; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:17:00Z. Revision: arXiv:2607.26375v1. Primary July 29 preprint with 54 analyzed students at two US colleges. Both systems used GPT-4.1-2025-04-14; the agent used Aider editing and the comparison used a chatbot. Newly published since the baseline, but older tool vintage. Not a production-developer or September-model trial.

SGLP01 — Privacy Policy and Data Processing Addendum for API Services #

Z.ai · official · opened. Published: unknown; updated: 2025-09-29; effective: unknown. Retrieved: 2026-09-09T01:40:41Z. Revision: Live legal page; displayed Last Update September 29, 2025; separate DPA revision not stated. Read individual-policy scope and API DPA sections 1, 3 and 4. Retrieval timestamp records completion of this bounded legal-page review.

SGLP02 — Terms of Use and Additional Terms for API Services #

Z.ai · official · opened. Published: unknown; updated: 2026-04-14; effective: unknown. Retrieved: 2026-09-09T01:40:41Z. Revision: Live legal page; displayed Last Update April 14, 2026. Read individual-versus-API content provisions, Third-Party Services and Additional Terms for API Services.

SGLP03 — Subscriptions, Fees, and Payment #

Z.ai · official · opened. Published: unknown; updated: unknown; effective: unknown. Retrieved: 2026-09-09T01:40:41Z. Revision: Live subscription terms; no publication, update or effective date displayed. Section 4 distinguishes supported-tool GLM Coding Plan use from general-purpose API access and limits the subscription to one individual natural person.

Claims #

CR01 #

Astra standard API rates per MTok: input 10, cache-read 1, cache-write 12.5, output 50 USD; >272K input doubles input/cache and multiplies output 1.5 for full request; Fast2x, Batch/Flex50%.

Scope: gpt-6-astra standard direct API; September snapshot. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR01 — Pricing, lines852–878.

Limits: Rates exclude tools, taxes and negotiated terms. Mutable page has no effective date; cutoff boundary uncertainty. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR02 #

Astra supports async tools, mid-turn steering and cache-preserving effort updates; client must implement the orchestration. No none effort; EU-residency Fast unavailable.

Scope: GPT-6 Astra Responses API. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR02 — Using GPT-6 Astra / What is new and behavior guidance, lines834–857.

Limits: Documentation establishes behavior, not measured task advantage. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR03 #

Fable 5.1 released September 1; 1M context/128K output, adaptive thinking always on, High default. API input 10/output 50/cache-read 0.25/5m-write12.5/1h-write20 USD per MTok.

Scope: claude-fable-5-1 native API. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR04 — Overview, Specifications/Pricing, Availability.

Limits: Documentation establishes behavior, not measured task advantage. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR04 #

Fable 5.1 rejects forced tool_choice any/tool; older models discard its thinking blocks. Prefix edits can invalidate blocks; enforcement differs for accounts created before August 31.

Scope: Custom Messages API clients migrating to Fable 5.1. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR05 — Breaking changes, lines68–92.

Limits: Official clients preserve prefixes; protocol similarity does not establish seamless model switching. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR05 #

Fable 5.1 generally available on paid Claude plans and listed clouds; default 30-day safety retention. Eligible enterprise temporary ZDR pending EFS; cyber/biology safeguards can route to Opus 4.8/Opus 5. US-only input/output inference has a 1.1x premium.

Scope: Fable 5.1 product routes; native API fallback requires configuration. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR03 — Availability and pricing; Safeguards; Data retention; fallback FAQ.

Limits: Eligibility and intermediary policies matter; EFS rollout is prospective. No blanket enterprise ZDR conclusion. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR06 #

Anthropic reports Fable 5.1 improvements with production safeguards; benchmark tasks can use fallback models. Vendor workload savings estimates and launch testimonials do not establish independent coding ROI.

Scope: Fable 5.1 launch evaluation and testimonials. supported; medium confidence (Opened primary support for this narrowly scoped statement.). Evidence: vendor-experiment. Verified: 2026-09-09. Recommendation-critical: no.

Support: SR06 — A new performance frontier; benchmark footnotes; Cost and availability.

Limits: Task sets, effort, routing and selected partner samples limit generalization. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR07 #

Opus 5 launched July 24 as everyday Claude candidate; vendor reports effort-dependent coding gains. Fable 5.1 docs recommend starting with Opus 5 for most workloads.

Scope: Claude Opus 5; vendor guidance. supported; medium confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR07 — Opus5 Performance and cost-effectiveness; Fable5.1 Overview; SR04 — Opus5 Performance and cost-effectiveness; Fable5.1 Overview.

Limits: Vendor positioning supports an evaluation starting point, not a cross-provider quality winner. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR08 #

Gemini3.8Flash launched September 2, GA; Antigravity managed agent defaults to it. 1M context/64K output, medium default; FlashCyber requires trusted access. Google warns complex tasks may use more tokens.

Scope: gemini-3.8-flash; Google native tools. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR09 — Launch / long-horizon coding; Latest-model New model and What is new; SR11 — Launch / long-horizon coding; Latest-model New model and What is new.

Limits: Vendor performance claims not independently measured here. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR09 #

Gemini3.8Flash paid standard USD/MTok input 0.75/output 3.75/cache 0.075 plus cache storage0.50/MTok/hour through December31; announced January1 rates double.

Scope: Gemini Developer API; introductory offer. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR10 — Gemini3.8Flash / Standard, lines134–154.

Limits: Thinking included in output; grounding charged separately; do not generalize to Vertex or Antigravity subscriptions. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR10 #

Gemini paid API prompts/responses excluded from product improvement; limited-period abuse logs retained. Unpaid use outside EEA/CH/UK can improve models and receive human review. Grounding retains context/output 30 days.

Scope: Google Gemini Developer API paid billing-linked project; scoped regional exceptions. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: no.

Support: SR12 — Unpaid Services and Paid Services / How Google Uses Your Data; Grounding.

Limits: Base abuse-retention duration unspecified; residency not guaranteed by paid status; feedback and third-party paths separate. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR11 #

DeepSeekV4Pro GA August 13; Flash0731 update July 31. Responses support and Codex setup documented; peak/offpeak rates effective August 16 with offpeak half peak.

Scope: DeepSeek hosted API; vendor integration docs. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: no.

Support: SR13 — Change Log Date2026-08-13 and2026-07-31; Codex configuration and session history; SR14 — Change Log Date2026-08-13 and2026-07-31; Codex configuration and session history.

Limits: Integration not exercised; provider switch separates displayed session-history groups. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR12 #

DeepSeek V4-Pro peak USD/MTok input 1.32/output 3.96/cache 0.044; Flash0.44/1.32/0.014. Offpeak halves each. Peak Mon–Fri01:00–04:00 and06:00–10:00 UTC.

Scope: DeepSeek direct hosted API; Pro0813 and Flash0731. supported; high confidence (Direct public HTML pricing table inspected after web extractor failure.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR17 — Model Details pricing table and footnote1.

Limits: No separate cache-write tariff verified; model/tool tokens and time schedule affect bill. Counterevidence: Cached search snippets reflected older preview tariffs and were rejected.

CR13 #

Sol direct API promotional USD/MTok input 4/output 20/cache-read 0.4; cache-write 1.25x input. Promotion at least through November21; >272K request has2x input/1.5x output.

Scope: gpt-5.6-sol; gpt-5.6 alias. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR15 — Model identity, Pricing, lines838–890.

Limits: Current source differs from July 5/30 table; promotion effective start not verified, so do not invent announcement date. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR14 #

Sonnet 5 released June30; API USD/MTok input 2/output 10/cache-read 0.2/5m-write2.5/1h-write4, 1M context/128K output.

Scope: claude-sonnet-5 native API. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: no.

Support: SR16 — Specifications / Pricing and Availability.

Limits: Existing June option, not a September launch. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR15 #

Illustration:1MTok uncached input+1M5m cache writes+10M cache reads+0.1M output costs Fable 5.1 USD 30 versus Fable 5 USD 37.50, a 20% reduction; Astra USD 37.50 and Sol USD 15 at listed standard rates.

Scope: Aggregate token budget; each request below272K; identical counts; no tool fees, labor or taxes. supported; high confidence (Arithmetic from listed rates with disclosed assumptions.). Evidence: estimate. Verified: 2026-09-09. Recommendation-critical: no.

Support: SR01 — Pricing tables; author calculation Ipi+Wpw+Rpr+Opo; SR08 — Pricing tables; author calculation Ipi+Wpw+Rpr+Opo; SR15 — Pricing tables; author calculation Ipi+Wpw+Rpr+Opo.

Limits: Not identical text across tokenizers, actual session, accepted task, or measured quality. All cached reads assumed hits. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR16 #

Opus 5 API USD/MTok input 5/output 25/cache-read 0.5/5m-write6.25/1h-write10. Fable 5 remains10/50/1/12.5/20.

Scope: Anthropic direct API, cache durations explicit. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR08 — Pricing table Opus5 and Fable5 rows.

Limits: Cache mix changes total bills; no task-cost inference. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR17 #

DeepSeek personal-data policy permits training and opt-out but excludes downstream-user processing rules; platform terms5.5 repeats that boundary. A blanket no-training API promise was not established.

Scope: Personal account data versus downstream API data. supported; medium confidence (Opened primary support for this narrowly scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SR18 — Privacy Introduction/How We Use/Your Rights; Open Platform5.5; SR19 — Privacy Introduction/How We Use/Your Rights; Open Platform5.5.

Limits: API prompt training/retention classification unknown for downstream route; do not substitute chatbot policy or stateless endpoint behavior. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CR18 #

DeepSeek Responses ignores unsupported fields: background, previous_response_id and conversation unavailable; file_search/code_interpreter/computer_use/MCP built-ins ignored; developer role treated as user.

Scope: DeepSeek Responses compatible endpoint. supported; high confidence (Opened primary support for this narrowly scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: no.

Support: SR20 — Compatibility Details / Top-level Request Parameters, Input Items, Tools.

Limits: Client-hosted tools differ from API built-ins. Stateless conversation handling is not a contractual zero-retention promise. Counterevidence: Comparative advantage not inferred; operating and access caveats retained.

CGL01 #

GLM-5.3 is text-only, supports 1M context and 128K output, requires reasoning, and accepts low/high/max effort with max as the default. Requests with thinking.type=disabled fail.

Scope: GLM-5.3 API migration through cutoff. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL14 — Feature Changes, lines 38–45.

Limits: Migration behavior is documented for the Z.ai model API; no request was executed against a user account. Context and output figures are model limits. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL02 #

Z.ai reports that GLM-5.3 shares GLM-5.2’s base; its Terminal-Bench 3.0 score rises from 4.6 to 28.3. The 5.3 run uses Claude Code 2.1.207 at max effort, 400K context, 128K output, avg@3,600 turns, a 10-hour timeout, isolated containers and no Tool Search.

Scope: Vendor benchmark, not independent model-only ranking. supported; medium confidence (Primary vendor result with explicit scope; independent replication unavailable.). Evidence: vendor-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL01 — Overview; Benchmark table; Terminal-Bench 3.0 footnote, lines 195–202, 235–236.

Limits: Sample size, uncertainty, contamination audit and matched GLM-5.2 run details are unreported; the result stays outside ranked comparison groups. Counterevidence: Card shows remaining failures and task-dependent outcomes. Fable/Astra were not compared in this edition under identical setups.

CGL03 #

GLM-5.3 uses a custom license. A Model as a Service operator whose aggregate group revenue exceeds USD 10 billion over any 12 consecutive months must pass Z.ai security review before commercial use. Copyright-notice and legal-compliance conditions also apply.

Scope: Released GLM-5.3 weights/code license; exact business definitions in source. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL02 — Clauses 1–2, lines 3–6.

Limits: The threshold concerns aggregate revenue of the licensee and affiliates, not only model-service revenue. The license defines Model as a Service and excludes embedded end-user features and mere relaying; no specific business was assessed. Counterevidence: The separate GLM-5.3-Flash license is MIT; it does not replace these GLM-5.3 terms.

CGL04 #

GLM-5.3 list API rates are USD 1.40 for input, 0.26 for cached input and 4.40 for output per million tokens; cached-input storage is temporarily free.

Scope: Z.ai standard API as read at cutoff; no regional quote. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL07 — Latest Models table, lines 38–46.

Limits: Cache-write tariff, region, taxes and accepted-task economics unknown. Counterevidence: Pricing was reopened at the end of the batch; no conflicting official tariff was found. Third-party hosting and subscription prices are separate.

CGL05 #

GLM-5.3-Flash list API rates are USD 0.15 for input, 0.03 for cached input and 0.50 for output per million tokens. A 50% discount ends on 2026-09-09 at 24:00 UTC+8; storage is temporarily free.

Scope: Z.ai Flash API list versus time-limited offer. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL07 — Latest Models table and expiry, lines 38–46.

Limits: Promotion is not a durable comparison price; cache-write tariff and task-cost denominator unknown. Counterevidence: The same official table displays both list and promotional prices. Main comparison columns retain list rates so the expiring offer does not become a permanent price claim.

CGL06 #

Coding Plan supports GLM-5.3 and GLM-5.3-Flash. Requests naming 5.2 or 5.1 route to 5.3; requests naming 4.7 route to Flash. Lite/Pro/Max caps are 2,000/12,000/28,000 credits per 5 hours and 10,000/60,000/140,000 credits weekly. The public starting price is USD 18/month.

Scope: Z.ai Coding Plan; account-specific legacy terms not inspected. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL08 — Advantages; Supported Models; Usage Credit Allowance, lines 61, 73–102.

Limits: Checkout price for Pro/Max and applicable promotions unknown. Alias behavior is plan-specific, not asserted for every API provider. Counterevidence: The model API documentation separately limits protocols for accounts with prior Coding Plan subscriptions; plan support does not establish unrestricted access through every protocol.

CGL07 #

Plan token credits equal (input×input-multiplier+cached-input×cache-multiplier+output×output-multiplier)/10,000. GLM-5.3 multipliers are 6.9/1.7/24; Flash multipliers are 2.3/0.56/8. Off-peak usage costs 50% of the standard credits; peak hours are Mon–Fri, 14:00–18:00 UTC+8.

Scope: GLM Coding Plan token quota accounting. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL08 — Credit Calculation, lines 107–123.

Limits: Input categories should be mutually exclusive as billed; published total-token allowance is cache-mix-dependent. MCP calls have separate multipliers. Counterevidence: Official estimated token allowances vary with cache hit rate and time of use; they are not fixed token bundles.

CGL08 #

GLM-5.3-Flash has a distinct native multimodal base: 320B total and 18B active parameters, hybrid sparse/linear attention, and max effort as the reasoning default. Its released license is MIT.

Scope: GLM-5.3-Flash weights and documentation. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL11 — Introduction and Note, lines 245–263; SGL15 — MIT grant and notice, lines 0–11.

Limits: Vendor quality and efficiency claims are not measured deployment value; the official HF tensor total rounds to 321B. MIT applies to this released Flash repository, not the GLM-5.3 flagship. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL09 #

Qwen3.8-27B has 27B language parameters (HF full tensors round to 28B), native context of 262,144 tokens extensible to 1M, and an official Apache 2.0 designation. Thinking and history preservation default to on; serving docs name vLLM, SGLang and TokenSpeed.

Scope: Qwen3.8-27B released model; quantization not assessed. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL03 — License; Model Overview; Serving; Preserved Thinking, lines 54, 256–276, 333–340, 539–542.

Limits: The hosted Qwen Cloud version is described as coming soon. Native context is a model limit, not measured usable context on 24 GB. The raw license fetch failed; the opened official card supplies the Apache 2.0 designation. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL10 #

Qwen reports 73.0 on Terminal-Bench 2.1 with Terminus for Qwen3.8-27B, versus 63.4 for Qwen3.6-27B.

Scope: Vendor score for the supplied system; not a tested 4-bit, 24 GB setup. supported; medium confidence (Primary vendor result with explicit scope; independent replication unavailable.). Evidence: vendor-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL03 — Text Performance, lines 279–285.

Limits: Harness version, uncertainty, sample, budgets and quantization not fully reported; outside ranked comparison groups. Counterevidence: Vendor result does not validate a local quant or justify July’s consensus/60–80%-of-tasks claims.

CGL11 #

Qwen3.8-Flash-Next is an experimental architecture preview with 125B core parameters, 6B activated parameters, 51B additional n-gram embedding parameters and 4B MTP parameters. Total weight storage is not limited to the 6B activated parameters.

Scope: Open-weight architecture preview; no local deployment tested. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL13 — Highlights and Model Overview, lines 246–286.

Limits: Offloading changes accelerator demand, not total weight storage; the full model is roughly 180B. No end-to-end latency was measured. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL12 #

Qwen3.8-Flash-Next’s custom license requires a separate license for commercial use by Model as a Service or AI Work Assistant businesses, with a defined internal-use exception. Large commercial products also have model-name display conditions.

Scope: Qwen Community License 1.0; separate from the Apache 2.0 designation for Qwen3.8-27B. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL16 — Clauses 1–2 and definitions, lines 5–9.

Limits: The license defines Model as a Service and AI Work Assistant, including exclusions. The internal-use exception requires that the model, outputs and capabilities not be available to third parties. No specific business was assessed. Counterevidence: Qwen3.8-27B has an Apache 2.0 designation; that does not extend to Flash-Next.

CGL13 #

Kimi K3 has 2.8T total and 104B active parameters, 1,048,576-token context, MXFP4 weights and MXFP8 activations. It documents OpenAI/Anthropic APIs, vLLM/SGLang/TokenSpeed and Kimi Code. Multi-turn callers must preserve complete assistant messages, including reasoning_content and tool_calls.

Scope: Kimi K3 released weights and API integration. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL04 — Model Summary; Deployment; Model Usage, lines 233–254, 343–358.

Limits: Vendor long-session claims unreplicated here; hardware, rate limits and exact API price not verified in this packet. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL14 #

The Kimi K3 license requires a separate agreement for commercial use by Model as a Service operators above USD 20 million in aggregate group revenue over any 12 consecutive months. Defined internal-use, official-product and certified-partner exceptions and large-product branding rules apply.

Scope: Kimi K3 weights/code license. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL06 — Clauses 2–4, lines 248–271.

Limits: The USD 20 million threshold is aggregate licensee-and-affiliate revenue over consecutive 12-month periods. Clauses 2–4 define the service, exceptions and separate branding thresholds; no specific business was assessed. Counterevidence: The license expressly exempts defined internal use and use through official products or certified inference partners from clauses 2 and 3; earlier Kimi licenses were not substituted.

CGL15 #

The MiniMax M3 released card supplies approximately 428B total and 23B active parameters, 1M context, multimodal input and enabled/adaptive/disabled reasoning modes. vLLM and SGLang are documented deployment routes.

Scope: MiniMax M3; added coverage, not claimed as a new September launch. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL05 — Model description; How to Use; Local Deployment, lines 240–279.

Limits: The HF tensor count rounds to 427B; no practical server benchmark or current API price was verified. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL16 #

The MiniMax M3 custom license requires commercial attribution plus a one-time notice. Above USD 20 million in yearly revenue for the relevant products or services, it requires prior written authorization. The prohibited-use appendix also applies.

Scope: MiniMax M3 Community License. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL12 — Clauses 2–3 and Appendix, lines 4–16.

Limits: Commercial Use is defined broadly, including relevant API-based operations and modified models. The revenue test concerns the relevant products or services; no specific deployment was assessed. Counterevidence: The license distinguishes a one-time notice from prior authorization above the threshold; neither open weight availability nor another MiniMax model license removes these conditions.

CGL17 #

Qwen3.5-4B/9B official cards list Apache 2.0, 4B/9B language parameters and full tensor totals rounded to 5B/10B. Qwen-Agent documents local OpenAI-compatible vLLM/SGLang endpoints with MCP.

Scope: Small local candidate roster, not proof of task reliability. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL09 — License; Model Overview; Agentic Usage; Model size; SGL10 — License; Model Overview; Agentic Usage lines 630–686; Model size.

Limits: Older candidates are retained because small memory tiers still matter; no newer 4B/9B successor was established in the bounded search. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL18 #

Illustrative weights-only floor = N×bits/8: rounded 5B at 4-bit ≈ 2.5 GB; 10B at 8-bit ≈ 10 GB; 28B at 4-bit ≈ 14 GB or 8-bit ≈ 28 GB; 753B at 4-bit ≈ 376.5 GB; 321B at 8-bit ≈ 321 GB; 2.8T at 4-bit ≈ 1,400 GB.

Scope: Decimal GB arithmetic; lower-bound storage illustration, not runtime VRAM. supported; medium confidence (Transparent arithmetic from stated parameter counts; runtime fit remains unverified.). Evidence: estimate. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL01 — Official parameter/tensor-size fields; researcher arithmetic N×bits/8; SGL03 — Official parameter/tensor-size fields; researcher arithmetic N×bits/8; SGL04 — Official parameter/tensor-size fields; researcher arithmetic N×bits/8; SGL09 — Official parameter/tensor-size fields; researcher arithmetic N×bits/8; SGL10 — Official parameter/tensor-size fields; researcher arithmetic N×bits/8; SGL11 — Official parameter/tensor-size fields; researcher arithmetic N×bits/8.

Limits: Excludes scales, mixed precision, KV/recurrent state, vision, MTP handling, activations, serving buffers, OS and concurrency. Quantization quality, availability and runtime demand remain unknown. Counterevidence: Active MoE parameter counts do not remove total weight storage. No tested fit or latency is inferred.

CGL19 #

Z.ai release notes date the GLM-5.3 entry August 18 and the Flash entry August 26, 2026.

Scope: Documentation dates establish pre-cutoff changes; not exact first announcement date. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL17 — Release notes Models entries, lines 31–43.

Limits: Search-only secondary announcement dates differ; not used to replace primary entry dates. Counterevidence: No contrary primary evidence found within bounded search; no empirical validation inferred.

CGL20 #

GLM-5.3 docs list Chat Completions, Responses and Anthropic protocols, but warn that accounts with prior Coding Plan subscriptions, even expired subscriptions, currently have model API access only through the Chat Completions-compatible protocol.

Scope: Z.ai model API account restriction as documented. supported; high confidence (Direct official documentation for this scoped statement.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL14 — How to Use, lines 65–76.

Limits: Public docs and plan harness support statements have scope ambiguity; verify intended route on account before migration. No live interoperability test. Counterevidence: The plan overview names Claude Code, Cline and OpenCode, while the model API note restricts protocols for subscribed accounts. Both statements are retained; universal compatibility is not assumed.

CGL21 #

Proposed local pilots are Qwen3.5-4B at 4-bit on 8 GB, Qwen3.5-9B at 8-bit on 16 GB, Qwen3.8-27B at 4-bit on 24 GB, and Qwen3.8-27B at 8-bit on 64 GB of unified memory. These screen capacity; they are not verified hardware recommendations.

Scope: Researcher proposed pilot configurations for tightly scoped local tasks. supported; low confidence (Transparent arithmetic from stated parameter counts; runtime fit remains unverified.). Evidence: estimate. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGL03 — Model size/serving support; explicit researcher memory arithmetic; SGL09 — Model size/serving support; explicit researcher memory arithmetic; SGL10 — Model size/serving support; explicit researcher memory arithmetic.

Limits: Practical context, latency, quantization degradation, tool reliability and true memory demand require measurements. Start with bounded prompts and short tasks before enlarging context. Counterevidence: No exact 8/16/24 GB runtime evidence was retrieved. July’s broad local success percentages and consensus claims were not carried forward.

CH01 #

VS Code 1.132–1.135 adds /btw side conversations, Agent Plugins 1.0 portability, continuation of external Copilot/Claude sessions, provider switching in Claude sessions and per-model token details.

Scope: VS Code August 2026 releases; experimental features remain experimental… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH01 — Agent sessions and workflows; Chat and review, lines36–62.

Limits: Documents establish advertised behavior, not reliability or comparative task outcomes. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH02 #

Astra is GA in Copilot Pro+, Max, Business and Enterprise, with gradual rollout across listed IDE, CLI, app, cloud-agent and web surfaces; usage is billed at provider list pricing. Administrators control model access.

Scope: GPT-6 Astra through GitHub Copilot, September 4… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH02 — Availability in GitHub Copilot; Enabling access, lines36–58.

Limits: GitHub’s quality assessment is internal testing without public task-level methods; GA does not guarantee every account has access. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH03 #

Copilot review approval is public preview and off by default. An assessment alone does not satisfy merge requirements; an enabled approval can satisfy required approvals, and new commits dismiss it. Repository administrators may restrict approval paths.

Scope: Copilot code review September 1; Pro, Pro+, Max, Business, Enterprise… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH03 — Approval assessments; Turning on approvals, lines31–44.

Limits: No defect recall, false-positive rate or reviewer independence measurement is supplied. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH04 #

Copilot app and CLI respect administrator-configured content exclusions for Business and Enterprise customers.

Scope: GitHub-hosted Copilot app/CLI September 2… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH04 — Release body, lines22–24.

Limits: This scoped announcement does not establish equivalent protection for every IDE agent, shell/tool path or external connector. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH05 #

Claude Code consumer accounts permit a training choice: data-sharing on gives five-year retention, off gives 30 days. Commercial Team/Enterprise/API prompts and code are not training data by default; standard retention is 30 days. Qualified Enterprise ZDR requires separate organization-level enablement.

Scope: Claude Code first-party consumer versus commercial account routes… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH05 — Data training policy; Data retention, lines87–131.

Limits: Model-specific retention requirements such as Fable must also be checked; generic Enterprise is not automatically ZDR. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH06 #

Claude Code local transcripts are plaintext, normally 30 days, with Desktop/Cowork exceptions. Feedback transcripts are retained five years; optional survey transcript sharing can retain six months. Web execution clones a repository to a VM; WebFetch hostname checks and telemetry create additional paths.

Scope: Claude Code local/web; account and feature-specific data flows… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH05 — Feedback and surveys; Data retention; Cloud execution; WebFetch, lines101–132,160–189,227–229.

Limits: Retention is layered across local client, service, optional feedback and tools. This is not a security audit. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH07 #

Copilot Business/Enterprise credits pool per billing entity. Standard allowances are 1,900/3,900 credits per user monthly at $0.01/credit; the June 1–September 1 promotion was 3,000/7,000. Overages are enabled by default; disable paid usage to stop beyond the pool. Individual caps can stop users; no cheaper-model fallback occurs.

Scope: Copilot Business/Enterprise usage billing as of September 8… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH06 — AI Credits; promotional amounts; exceed included credits; budgets, lines35–82.

Limits: Token costs do not measure accepted tasks; user budgets and overage spending limits apply differently. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH08 #

OpenAI API data is not training data unless opted in. Default abuse monitoring retains content up to 30 days with legal/harm exceptions. Approved ZDR/MAM changes abuse logs; Responses can retain state 30 days by default, and endpoint/cache/background-mode exceptions remain.

Scope: Direct OpenAI API, standard versus approved retention controls… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH07 — Types of data; retention controls; endpoint table and Responses exceptions, lines842–863,879–924.

Limits: Do not transfer this policy to consumer ChatGPT or assume store=false disables all logs. No human-access or regional guarantee established here. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH09 #

Cursor Privacy Mode prohibits training; provider ZDR has abuse-investigation and designated non-ZDR exceptions. BYO-key requests still traverse Cursor, and encrypted file caching is temporary. With Privacy Mode off, Cursor may store code and use it for training.

Scope: Cursor editor Privacy Mode; September 3 data-use policy… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH08 — Data handling choices and Other notes, lines9–22.

Limits: No blanket no-storage claim; provider policies and model-specific exceptions remain. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH10 #

Cursor Fable 5/5.1 requires retention-policy opt-in for Privacy Mode/Enterprise accounts; Anthropic performs automated and human harm-prevention reviews without training. Opt-in applies to the team, and triggered safeguards route requests to Opus. Cloud Agents separately store encrypted repository copies during execution.

Scope: Cursor-hosted Fable and Cloud Agent routes… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH09 — Two data flows; Models with data retention, lines127–150.

Limits: Generic Privacy Mode does not override this model exception; exact Anthropic retention duration is not stated on this page. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH11 #

Cursor US residency is per-team Enterprise enrollment covering eligible inference, processing and storage at 10% model-price uplift. BYOK, custom gateways, external MCP/web services and several integration paths are excluded.

Scope: Cursor Enterprise US-only residency… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH09 — Data residency; model availability; pricing; What might leave region, lines184–264.

Limits: No blanket organization or worldwide coverage. EU/Iceland inference-only availability on request is narrower than full residency. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH12 #

GitHub does not train on Copilot Business/Enterprise data. Astra uses OpenAI/GitHub Azure hosting with a provider ZDR agreement. Fable 5/5.1 defaults to Anthropic retention; approved enterprises may request temporary ZDR through 2026 under internal-operations restrictions. GitHub still filters content.

Scope: GitHub Copilot Business/Enterprise; Astra versus Fable routes… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH10 — OpenAI models; Anthropic models; Business/Enterprise data, lines28–75,125–126.

Limits: Provider ZDR does not establish GitHub service retention or all external-tool paths; exact region and deletion duration remain unknown. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH13 #

Cursor Teams Standard costs $40/user/month; Premium $120 with 5 x Standard usage. Usage has two per-user pools; Enterprise can pool users. Third-party input/output/cache tokens incur $0.25/MTok Cursor Token Rate, including BYOK and Auto. Teams on-demand is enabled by default; team spending caps and Enterprise per-member caps exist.

Scope: Cursor Teams current documented subscription and usage terms… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH11 — Seat types; Included usage; On-demand; Cursor Token Rate; Spending controls, lines88–155.

Limits: Exact included dollar/token pool sizes not published in retrieved page. The quoted provider-model table excludes the additional token fee. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH14 #

Cursor Pro/Pro Plus/Ultra monthly prices are $20/$60/$200. Each has separate Cursor Models and Other Models pools; third-party usage is charged at API prices and overages can be purchased.

Scope: Cursor individual plans, before tax… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH12 — Usage pools; Plans; reaching limit, lines104–110,147–176.

Limits: Exact guaranteed pool quantities unknown in current page; do not reuse older $20/$70/$400 allowances. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH15 #

OpenCode documents configurable BYO providers and local servers including llama.cpp/LM Studio/Ollama; custom Chat Completions uses @ai-sdk/openai-compatible, while Responses uses @ai-sdk/openai. Credentials are stored locally in auth.json.

Scope: OpenCode documented providers; exact installed version unknown… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH13 — Overview/Credentials; llama.cpp/LM Studio; Custom provider, lines178–194,2052–2146,3499–3634.

Limits: Endpoint configuration does not prove tool-call accuracy, context management, or full interchangeability for a specific new model. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH16 #

Zed ACP External Agents include Claude, Codex, OpenCode, Copilot and Cursor. They own provider auth/billing/config; Zed does not charge for these agents. Native agent configuration and Zed MCP forwarding may both matter.

Scope: Zed External Agents, exact release unknown… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH14 — Introduction; Common Agents; Claude Agent; MCP, lines10–42,166–170.

Limits: This integration is documented, not tested here. Provider terms and retention remain separate; cross-agent session interchange is not established. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH17 #

Codex Plus is $20/month. Business is $20/user/month annually for 2+ users or $25 monthly; business data is not trained on by default. API-key access covers CLI/SDK/IDE without cloud features. Astra’s 5–45 local messages/5 h on Plus/standard Business is an estimate, not a fixed allowance.

Scope: Codex through ChatGPT plans versus API key… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH15 — Plus; API Key; Business; Usage limits, lines832–888,921–965.

Limits: Exact task throughput depends on context, tools, caching and reasoning; consumer training policy and Business retention duration are not established on this pricing page. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH18 #

Fable 5.1 is GA in Copilot Pro+, Max, Business, Enterprise with staged rollout and list-price usage billing. Business/Enterprise model policy is off by default because enabling acknowledges retention; eligible enterprise temporary ZDR requires separate approval.

Scope: Copilot Fable 5.1 September 1 release… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH16 — Availability; Enabling access; ZDR access, lines37–65.

Limits: GitHub internal performance remarks are vendor observations without public methods; availability is not proof of advantage. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH19 #

Codex/ChatGPT plugins span web/desktop/mobile and the Codex CLI plugin browser but are unavailable in the IDE extension; workspace controls govern access and tools require connected-system authorization.

Scope: OpenAI administration documentation, current surfaces… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH17 — Step6 plugins and Step8 verification, lines909–933.

Limits: Do not infer equal connector capabilities across every surface or unrestricted shared credentials. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH20 #

Codex CLI/IDE defaults separate workspace writes from network/outside-workspace approval. Astra asynchronous safety monitoring may pause after activity and does not replace sandboxing. Auto-review checks only approval-requiring actions, can add model usage and does not inspect every sandboxed action.

Scope: Codex CLI/IDE and Astra monitoring; configured permission boundaries… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH18 — Safety approach and monitoring, lines830–837; Automatic approval reviews, lines975–992.

Limits: A documented safeguard is not a measured security guarantee; host configurations can override defaults. Counterevidence: Scoped product fact; no empirical superiority inferred.

CH21 #

Copilot Business is $19/seat/month with 1,900 pooled credits; Enterprise $39 with 3,900. Pro+ is $39/month with 3,900 base plus 3,100 flex credits; Pro $10 has 1,000+500; Max $100 has 10,000+10,000.

Scope: Copilot plan catalog September snapshot… supported; high confidence (Underlying first-party page opened; claim is limited to its documented scope.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SH19 — Copilot plans overview; allowances, lines60–96,191–197.

Limits: Flex allotment conditions require the individual usage page before treating flex as guaranteed equivalent cash credit. Counterevidence: Scoped product fact; no empirical superiority inferred.

CO01 #

METR’s follow-up estimates changed from 19% more completion time in early 2025 (CI +2% to +39%) to 18% less for returning developers (CI −38% to +9%) and 4% less for new developers (CI −15% to +9%). Severe selection and time-recording problems make the newer effect unreliable.

Scope: Early- and late-2025 tools on developers’ own repositories; follow-up: 10 returning and 47 new developers… supported; high confidence (Direct study-author account supports uncertainty and tool vintage, rather than a current universal uplift.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO01 — Opening paragraphs; Wider adoption of AI has made it more difficult to measure task-level productivity.

Limits: Both follow-up intervals cross zero. Participation, pay selection and concurrent-agent timing undermine the causal magnitude. Neither new model was tested. Counterevidence: The follow-up challenges carrying the early-2025 slowdown forward unchanged.

CO02 #

METR’s survey of 349 technical workers found median self-reported value multipliers of 1.4–2x and a speed multiplier of 3x, with approximately 2% email response and potentially large selection and perception biases.

Scope: February–April 2026 survey, with 87 software engineers among a mixed technical population… supported; high confidence (The study clearly distinguishes reported value and speed from measured causal output.). Evidence: self-report. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO02 — Summary; Methodology participant recruitment; Results: productivity gains around March 2026.

Limits: Self-report, not representative population measurement or proof of delivered value. Recruitment through researcher networks adds selection bias. Counterevidence: The authors’ checks of public outputs cast doubt on especially high self-reported value.

CO03 #

Terminal-Bench 4.0 changes resources and the task set, sets an 8-hour agent timeout, removes 8 tasks and reports 19 fixes. The maintainer requires rerunning trials before comparing scores.

Scope: TB 4.0.0 release August 26 and announcement August 28; exact CPU and memory limits were not fully extracted… supported; high confidence (Maintainer announcement and versioned release establish breaking changes.). Evidence: documented-feature. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO03 — Calibrating resources; Removing and fixing tasks; Versioning Terminal-Bench; SO04 — v4.0.0 release timestamp, commit and removed/modified task lists.

Limits: Snorkel says 20 revised tasks while the announcement says 19 fixed. Cross-version score movement cannot isolate system progress. A canary is not proof against contamination. Counterevidence: The researcher sought revision and resource explanations; both are documented.

CO04 #

GPT-6 Astra with Codex at max effort is listed at 58.2% resolution with a reported ±2.8 margin on Terminal-Bench 4.0.0.

Scope: 66-task contributor presentation of the Harbor evaluation, observed September 8, 2026 America/New_York; exact evaluation date unknown… supported; medium confidence (The benchmark contributor gives an identifiable system and dataset version, supplying a descriptive empirical signal.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO05 — Leaderboard; Methodology: resolution rate; Harbor run command.

Limits: Harness version, per-task CPU/memory settings, attempts, token limits and fallback routing are unknown. The reported margin’s confidence level is not defined. This is a within-cutoff observation of a mutable table, not a model-only ranking. Counterevidence: The Astra–Fable gap of 0.3 percentage points is smaller than either reported margin; no superiority test was verified.

CO05 #

Claude Fable 5.1 with Claude Code at max effort is listed at 57.9% resolution with a reported ±3.8 margin on Terminal-Bench 4.0.0.

Scope: 66-task contributor presentation of the Harbor evaluation, observed September 8, 2026 America/New_York; exact evaluation date unknown… supported; medium confidence (The benchmark contributor gives an identifiable system and dataset version, supplying a descriptive empirical signal.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO05 — Leaderboard; Methodology: resolution rate; Harbor run command.

Limits: Harness version, per-task CPU/memory settings, attempts, token limits and fallback routing are unknown. The reported margin’s confidence level is not defined. This is a within-cutoff observation of a mutable table, not a model-only ranking. Counterevidence: The Astra–Fable gap of 0.3 percentage points is smaller than either reported margin; no superiority test was verified.

CO06 #

GLM-5.3 with Claude Code at max effort is listed at 41.8% resolution with a reported ±3.2 margin on Terminal-Bench 4.0.0.

Scope: 66-task contributor presentation of the Harbor evaluation, observed September 8, 2026 America/New_York; exact evaluation date unknown… supported; medium confidence (The benchmark contributor gives an identifiable system and dataset version, supplying a descriptive empirical signal.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO05 — Leaderboard; Methodology: resolution rate; Harbor run command.

Limits: Harness version, per-task CPU/memory settings, attempts, token limits and fallback routing are unknown. The reported margin’s confidence level is not defined. This is a within-cutoff observation of a mutable table, not a model-only ranking. Counterevidence: The result is a different system and benchmark version from GLM’s vendor-reported Terminal-Bench 2.1 and 3.0 scores.

CO07 #

Endor’s September 4 Fable 5.1 plus Claude Code row reports 87.2% FuncPass and 37.4% SecPass. Functional success is much more common than jointly functional and security-test success.

Scope: Agent Security League Python tasks derived from CVE fixes; row dated September 4, 2026… supported; medium confidence (Primary evaluator and explicit metric definitions support the decision-relevant gap.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO06 — Fable 5.1 row dated2026-09-04 and metric footnotes; SO07 — Curation; Redefining the pipeline for fairness; Nondeterminism.

Limits: Security vendor with commercial interest; 200 original tasks, 179 feasible cases and cheating adjustments. Exact September row denominator, settings and uncertainty are unknown. Passing security tests does not guarantee safety. Counterevidence: The whitepaper identifies leaked fixes, brittle verifiers and stochastic borderline cases. Raw unadjusted scores and universal security rankings are rejected.

CO08 #

GitInject demonstrates that trusted repository configuration and runner credential handling can expose CI/CD coding agents even when model-level resistance improves. Workflow permissions and trusted configuration sources need separate checks.

Scope: June 2026 preprint: 11 named attacks across 4 representative workflows, using older models and real GitHub Actions runs… supported; medium confidence (Actual workflow execution tests credential and configuration boundaries.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO08 — Sections 4–5; Table 2; Config-file injection; Countermeasures.

Limits: Specific versions and configurations; not proof that September models exhibit every tested vulnerability. Individual mitigations do not generalize to all credential paths. Counterevidence: The paper reports simulation false positives and false negatives, as well as stronger model resistance on some paths.

CO09 #

Three randomized field experiments covering 4,867 developers report 26.08% more completed tasks (SE 10.3%) with an AI code-completion assistant; less-experienced developers benefited more.

Scope: Microsoft, Accenture and an unnamed Fortune 100 company; primary page labeled June 2025… supported; medium confidence (Randomized field design with explicit uncertainty supplies positive counterevidence.). Evidence: vendor-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO09 — Abstract.

Limits: Vendor-affiliated. Quality, rework and exact study dates were not fully extracted. Older completion tool rather than current autonomous agent. Counterevidence: Population and task differences permit coexistence with METR’s slowdown; no universal effect percentage follows.

CO10 #

One ML student reports Astra advantages in debugging and environment recovery but a text-encoding defect, while Fable 5.1 followed style constraints better but missed a debugging cause. Both improved after human feedback.

Scope: u/returnity’s text-processing comparison, observed by September 8, 2026 America/New_York; both models reported at xhigh, exact harness versions and publication date unknown… supported; low confidence (Opened first-hand account describes concrete positive and negative cases.). Evidence: anecdote. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO10 — Original post paragraphs 21–46 in retrieved text.

Limits: One author without a fully reproducible protocol; crossposts are not replications and test partitions differ. Exact publication date is unresolved, although the account was available within the local cutoff. It does not establish general model tendencies. Counterevidence: The author describes failures in both setups and gains after feedback, challenging a universal winner.

CO11 #

A six-task, two-run first-hand microtest found Fable 5.1’s only strict failures were extra arithmetic explanations despite the correct number. Astra passed 12/12, and Fable passed 10/12 strictly or 12/12 leniently.

Scope: 3h4x, September 7. High-effort text tasks; Claude Code tools disabled versus Codex read-only with a no-tools prompt… supported; low confidence (The author provided raw traces, and grading differences explain the result.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO11 — Results; What failed and why; raw arith_exact records; SO12 — Results; What failed and why; raw arith_exact records.

Limits: Tiny self-selected suite with asymmetric tool restrictions, without complex agentic repository work. It does not establish broad quality or cost rankings. Counterevidence: Lenient grading removes the gap; the source explicitly rejects long-horizon conclusions.

CO12 #

Tim Sehn describes Codex with Sol as his daily implementation choice and Claude as his design and ambiguity choice on an embedded-C database project, while reporting orchestration friction.

Scope: DoltLite author account dated August 5; before Astra and Fable 5.1; company CEO… supported; low confidence (Concrete ongoing project and named author, but subjective choice.). Evidence: anecdote. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO13 — A Brief History; Credentials; Criteria; Verdict.

Limits: No controlled counterfactual or task-time measurement. Subscription experience is not current pricing. Commercial interest in the project. Counterevidence: Sehn also reports Fable fixing a hard bug that an earlier GPT model failed to fix.

CO13 #

David Vujic reports improved team review flow and says review did not become the bottleneck after agent adoption. He retains incremental steering, tests and static analysis.

Scope: June 28 personal and team account; Eca/Emacs user and Polylith Python tooling maintainer… supported; low confidence (Opened first-hand counterexample to a universal bottleneck claim.). Evidence: anecdote. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO14 — Reflections: human reviews, quality and static analysis.

Limits: Single team, without a quantitative causal estimate; tooling affiliation and unspecified model versions. Counterevidence: Other selected accounts describe coordination friction, so this sample does not support a universal bottleneck story.

CO14 #

A 54-student study reports faster and more accurate initial agent-assisted web tasks but lower code comprehension and little transfer of those gains to follow-up extension work.

Scope: July 29 preprint; GPT-4.1-2025-04-14 plus Aider versus the same base model as a chatbot. Two colleges, 54 participants after five attention-check exclusions… supported; medium confidence (Primary paper specifies population, tool vintage and distinct outcomes.). Evidence: independent-experiment. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SO15 — Sections 3.4–3.5 and 4.1; Appendix A.2.

Limits: Small student web-task study. The extension phase still allowed a chatbot. Random assignment was not verified in this review. No September-model or professional-productivity generalization. Counterevidence: Initial performance gains coexist with comprehension costs. Interaction-pattern analyses are exploratory.

CGLP01 #

For enterprise and developer API Services, Z.ai’s terms prohibit using user or end-user content to develop or improve its services unless the user explicitly agrees.

Scope: Z.ai enterprise/developer API Services under the Additional Terms; no specific GLM model exception identified… supported; high confidence (The current official terms expressly state the API content-use restriction and explicit-agreement exception.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGLP02 — Content, API-user exception (web extraction line 97); Additional Terms for API Services, End User Content (lines 267–269).

Limits: A contractual commitment, not an operational audit. Do not transfer this commitment automatically to individual Coding Plan traffic, feedback, diagnostic metrics or third-party services. Counterevidence: The same terms permit broader content use for individual users; the applicable product and account classification matters.

CGLP02 #

The API DPA states that submitted and generated content is processed without server storage. Other Customer Data may be retained for service or legal purposes and deleted after termination unless law requires otherwise. Processing is generally in Singapore, with lawful international transfers permitted.

Scope: Business/enterprise customers covered by the Z.ai API DPA; Customer Data is defined there as personal data processed on the customer’s behalf… supported; high confidence (The official DPA explicitly distinguishes content from other Customer Data and qualifies the processing location.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGLP01 — Data Processing Addendum for API Services, scope and definitions (lines 238–242); section 3 International Data Transfer (line 264); section 4(b)–© Data Return and Deletion (lines 269–271).

Limits: This is not a promise that every metadata category has zero retention or that data remains exclusively in Singapore. Human-access controls and a fixed retention duration for other data were not established. Coding Plan applicability is unresolved. Counterevidence: The individual privacy policy has separate retention and data-use provisions; the DPA itself permits retention of other Customer Data.

CGLP03 #

Application of the API no-training and content-no-storage commitments to individual GLM Coding Plan traffic remains unverified.

Scope: Individual GLM Coding Plan subscriptions used through supported coding tools, including current GLM-5.3 and GLM-5.3-Flash routes… unverified; low confidence (Three reviewed legal pages do not expressly map individual Coding Plan account and endpoint traffic to the API data commitments.). Evidence: contractual. Verified: 2026-09-09. Recommendation-critical: yes.

Support: SGLP01 — Opening scope statement (line 43) and API DPA scope (lines 238–242); SGLP02 — Content, separate individual and API provisions (lines 86–97); Additional Terms for API Services scope (lines 236–244); SGLP03 — Section 4.2 Usage Scenario Restrictions and 4.3 Personal-Use Only (lines 63–70).

Limits: Bounded review of three primary pages and two queries; absence of explicit mapping is not proof that Coding Plan trains on content or lacks API protections. Verify the exact account, endpoint and applicable agreement before sending restricted repositories. Counterevidence: The general terms cover developer API use, while subscription terms make Coding Plan individual-only and prohibit general-purpose API access. Either label alone is insufficient to settle the governing content terms.