
Claude Opus 5.5 Lands at $4 In, $20 Out, Meets GPT-6 Sol and Astra
Claude Opus 5.5 lands at $4 input and $20 output with Fable-class results, facing GPT-6 Sol and Astra in this episode's head-to-head. Show notes: https://tobyonfitnesstech.com/podcasts/episode-116/
🎧 Listen to EpisodeAgentStack Daily EP116 — Opus 5.5 ships at $4/$20, Grok 4.7 lands, Nemotron tracks eight speakers
Title: Claude Opus 5.5 Lands at $4 In, $20 Out, Meets GPT-6 Sol and Astra
Tagline: Claude Opus 5.5 ships at $4 input and $20 output with what Anthropic calls Fable-class results, landing directly into a head-to-head with OpenAI's GPT-6 Sol and Astra. Grok 4.7 also arrives as a larger model at the same $2 and $6 price point. Hermes Agent v2026.9.21 headlines this week's harness readout. NVIDIA's Nemotron 3 diarization tracks eight overlapping speakers live, and Nokia open-sources AnyJev, a no-training layer that turns open LLMs into reliable decision-makers. OpenAI extends Daybreak cyber access to Ukraine and releases MentalHealthBench for mental-health conversations. The research digest covers GameHorizon's 5,000-hour AAA agent test and a new benchmark for agent taste on long tasks.
Feed description: Claude Opus 5.5 lands at $4 input and $20 output with Fable-class results, facing GPT-6 Sol and Astra in this episode's head-to-head. Grok 4.7 ships at $2 and $6 as a larger model. Hermes Agent v2026.9.21 leads the harness readout. NVIDIA's Nemotron 3 diarization handles eight overlapping speakers live, and Nokia open-sources AnyJev for reliable open-LLM decision-making. OpenAI extends Daybreak cyber access to Ukraine, releases MentalHealthBench, and the research digest covers GameHorizon's 5,000-hour AAA agent benchmark plus a new study on agent taste across long tasks.
Story Slate
Agent Stack Release Readout: Hermes Agent v2026.9.21 Hermes Agent shipped v0.21.4, tagged v2026.9.21, on September 21, 2026. It is a patch release that rolls roughly 1,800 merged pull requests and 5,071 non-merge commits across 5,169 changed files into a stable cut for Docker, Hermes Cloud, and hosted deployments. Curated release notes for the window are deferred to v0.22.0. Notable additions in the window include
--format stream-jsonfor the CLI, anmcp.discovery_concurrencycap,skills.auto_loadpinning skills into every new session, and a host-wide gateway singleton lock so Desktop attaches to a running backend instead of spawning a second one. Technical depth angle: The notable mechanism is the host-wide gateway singleton: one backend process owns connector operations and serves Desktop, TUI, and CLI through a rendezvous record, eliminating duplicate processes. Stream-json output and the MCP discovery concurrency cap give operators structured logs and a tunable upper bound on parallel MCP connections during cold start. Actionability angle: What this means is that self-hosters running Docker images or Hermes Cloud get a stable, tagged build to pin against instead of tracking main. The skills auto-load behavior and stream-json CLI output change how new sessions start and how downstream tooling can ingest runs. Watch v0.22.0 for the deferred curated notes covering this whole window. The implications land across Antigravity, Codex, Claude Code, and Hermes stacks alike. Listener hook: If you pin Hermes Agent by Docker tag or live in Hermes Cloud, this is the build you're moving to today.Claude Opus 5.5 delivers Fable-class results at $4 in, $20 out Anthropic released Claude Opus 5.5 on September 22, positioning it between flagship and mid-tier. The model performs about as well as Claude Fable 5.1 on most benchmarks while costing 40% less to run at default settings than Opus 5. Input pricing dropped 20% to $4 per million tokens, output to $20, and cache reads are 60% cheaper. Output generates 30% faster than Opus 5. The thinking model can no longer be disabled, and a Fast mode delivers 2.5x speed at double the price. It runs on Claude's platform, AWS, Google Cloud, Azure, and GitHub Copilot. Technical depth angle: Opus 5.5 uses adaptive thinking with five effort levels—low, medium, high, xhigh, and max—where higher effort produces more reasoning steps before output. Benchmarks at max effort show meaningful gains: Terminal-Bench 4.0 reaches 66.4% versus Opus 5's 52.3%, AutomationBench hits 40.0% versus 26.9%, and OSWorld partial scores 81.8% versus 74.0%. The thinking model is now mandatory; turning it off is no longer an option. Actionability angle: This means you can run Fable-class code migrations and audits at Opus pricing—Anthropic cites a 680,000-line code migration finishing in under a day and a 200,000-line audit completing in under three hours versus over twenty hours on Opus 5. Stripe had 40 stacked pull requests pass CI, Deloitte caught 72% of bugs at low effort versus 56% for Opus 5, and Box cut token usage by a third. If speed matters more than cost, Fast mode runs 2.5x faster at $8 input and $40 output per million tokens. Listener hook: If you've been paying Opus 5 prices, Opus 5.5 delivers Fable-class performance for 40% less—and Anthropic has published the full benchmark table so you can verify the claims yourself.
Head-to-head: GPT-6 Sol and GPT-6 Astra versus Anthropic's new flagship Anthropic shipped Claude Opus 5.5 on September 22, 2026, and OpenAI followed roughly 90 minutes later with GPT-6 Sol and Luna. The pricing picture is now clear: Opus 5.5 lists at $4 per million input tokens and $20 per million output, versus GPT-6 Astra's $10 and $50. On benchmarks Anthropic published alongside the launch, Opus 5.5 at its default effort level ties Astra on Terminal-Bench, beats Astra's best on FrontierCode at about one-fifth the cost, and leads on Humanity's Last Exam. Astra retains edges on science and automation tasks. All three models share 128,000-token maximum output and support text, image, and file input. OpenAI positioned Sol as a coding-focused alternative to Astra at $2 and $10, with Luna targeting high-volume work at a fraction of a cent per token. Technical depth angle: Opus 5.5 benchmarks at medium effort tie or beat Astra on several tests while costing 40–80% less per task. Astra leads on AutomationBench and Terminal-Bench-Science. Sol and Luna sit two and four price tiers below Astra, with Luna scoring comparable to Opus 5 at medium effort at 93% less per task. Actionability angle: For tasks in coding, general reasoning, and complex professional work, Opus 5.5 now offers a cost-per-quality point that challenges Astra's flagship positioning. The competitive pricing pressure from both Anthropic and OpenAI means teams running high inference volumes should re-evaluate whether the premium tier is justified for their workload. Sol targets the same coding use case at even lower cost, creating a new evaluation choice between Anthropic's model family and OpenAI's segmented offerings. Listener hook: Anthropic's new flagship undercuts OpenAI's top model by 60% while beating it on most of the same benchmarks.
Grok 4.7 Lands: Bigger Model, Same $2/$6 Price SpaceXAI shipped Grok 4.7 on September 21, 2026, billing it as the company's most capable model for coding and knowledge work. The new release sits on a larger base model than Grok 4.6 and was trained with a longer reinforcement learning run weighted toward multi-hour problems. Pricing holds at $2 per million input tokens and $6 per million output tokens — unchanged from Grok 4.6 — with an optional fast variant that doubles output speed for twice the price. Grok 4.7 sits at the frontier of CursorBench 4.0 price-performance, tops LatchBio's biosafety benchmark at 62.4%, and is live now in Cursor, the Grok API, and Grok Build. Technical depth angle: The upgrade is a new, larger base model trained with a longer RL run on a harder multi-hour task mix, plus native understanding of the Grok Bot harness for conversational work. The serving stack — same $2/$6 pricing, same speed, optional 2x-speed fast variant — stayed constant, so the wins come from training rather than new infrastructure. Actionability angle: For builders, Grok 4.7 is a drop-in upgrade at the same price, so existing Grok API code keeps working while long-context coding and document generation both improve. It's worth pitting against your current coding harness on multi-hour refactors and professional workflows like legal and financial analysis. Listener hook: SpaceXAI's Grok 4.7 ships a bigger brain at the same $2/$6 price as its predecessor — and tops the biosafety leaderboard while doing it.
Nokia Open-Sources AnyJev: No-Training Layer Makes Open LLMs Reliable Decision-Makers Nokia's applied research team has open-sourced AnyJev, a Python library that transforms open-source language models into calibrated decision systems without requiring additional training. The library installs via PyPI under Apache-2.0 licensing and supports multiple backend frameworks including transformers and vLLM. AnyJev operates by rotating option presentations and averaging token probabilities across multiple passes to eliminate positional and label bias, then applies temperature scaling for additional calibration. In benchmarks on Qwen3-8B, the system reduced decision flip rates by 68% when options were reordered, boosted accuracy by 8 percentage points, and increased the proportion of automatically resolvable queries from under 8% to over 52%. Technical depth angle: AnyJev operates in two calibration layers. L0 uses cyclic shifts and batch prior correction to remove position and label bias without any labeled data. L1 adds temperature scaling using 100-500 labeled examples to reshape confidence estimates. The core mechanism is presenting each decision in K rotations and averaging the log probabilities—geometric mean in log space—then dividing out the observed prior distribution at strength 0.75. This removes additive position bias exactly and produces probability scores suitable for thresholding. Actionability angle: For builders deploying open models in production, AnyJev provides a straightforward path to turn any transformer or vLLM-served model into a decision system for routing, classification, or structured selection tasks. The library is immediately usable via PyPI with vLLM prefix caching for efficient serving, requiring no fine-tuning or data collection pipeline. Listener hook: Nokia is open-sourcing a technique that eliminates the two most common pitfalls when reading probabilities directly from language models, making open-source decisions reliable enough for production traffic.
NVIDIA's Nemotron 3 Diarization Tracks Eight Overlapping Speakers Live NVIDIA has released Nemotron 3 Diarization, a 100-million-parameter open-weight model that answers one question about any conversation: who spoke when. It tracks up to eight speakers, including when voices overlap, in a single checkpoint that covers offline transcripts down to 320-millisecond streaming. On Voice Arena's initial Diarization-Bench, the model hit 14.72% error rate versus 19.3% for the next-ranked system, a roughly 24% relative reduction. Against NVIDIA's prior four-speaker baseline at 1.04 s latency, average error dropped 41% across eight evaluation conditions. Weights ship under the OpenMDW 1.1 license for commercial use and run through NeMo on Ampere, Ada Lovelace, Hopper, or Blackwell GPUs. Pair it with an ASR model like Parakeet TDT 0.6B and you have a speaker-attributed transcript pipeline. Technical depth angle: The model converts 16 kHz audio into mel-spectrogram frames with a 10 ms step, then stacks every eight frames into 80 ms encoder tokens. A 31-layer Transformer with rotary positional embeddings processes those tokens, and a one-dimensional convolution up-samples predictions back to 10 ms resolution, so overlapping voices register as multiple active channels in an eight-channel tensor. Speakers are ordered by arrival time, with streaming memory held by an Arrival-Order Speaker Cache and a first-in-first-out queue to keep labels stable across chunks. Actionability angle: What this means: speaker-attributed transcripts are now within reach of any team willing to run a 100M-parameter checkpoint on NVIDIA hardware. Production deployments can use Baseten or DigitalOcean, and on-device mobile is available through Argmax Pro SDK 3. Why this matters: meeting tools, call analytics, podcast pipelines, and voice-agent memory can stop relying on guesswork for who said what. Listener hook: NVIDIA just dropped a 100-million-parameter open model that finally tells you who was talking in any recording.
OpenAI extends Daybreak cyber access to Ukraine OpenAI announced on September 23, 2026 that it is extending access to its Daybreak program to the Government of Ukraine to support the cyber defense of civilian infrastructure. The announcement, published via OpenAI News, frames the extension as part of the company's broader work helping protect civilian-facing systems from cyber threats. Daybreak is positioned as OpenAI's program for cyber defense support, with Ukraine becoming a direct government recipient of extended access. Technical depth angle: Daybreak is OpenAI's program supporting cyber defense for civilian infrastructure. Extending access to a national government means OpenAI is shipping direct vendor-to-government access for civilian-defense use, treating civilian infrastructure as a distinct category that warrants dedicated tooling and program structure rather than ad-hoc support. Actionability angle: What this means is that direct vendor-to-government access programs for civilian cyber defense are an active model rather than one-off partnerships. For builders working on threat-intel pipelines, anomaly detection, or automated triage for critical-infrastructure buyers, the takeaway is that the civilian-defense buyer is real and active. The next thing worth watching is how Daybreak tooling gets used in practice inside Ukraine's defensive stack. Listener hook: Ukraine's government is getting extended access to OpenAI's Daybreak cyber program — here's what that actually changes for civilian defense.
Research digest: A benchmark for agent 'taste' on long tasks A research team has released TasteBench, a benchmark aimed at measuring the in-the-middle decisions an AI agent makes while working through a long task — not just whether the run ends in success. The authors frame the quality of those mid-flight choices — which hypothesis to test, which implementation path to follow — as the agent's "taste." End-to-end benchmarks already exist, but this one focuses on the branching decision points themselves. It could matter because real software and research work is full of these choices, and right now the field has no clean way to compare how well different agents make them. Technical depth angle: The paper proposes measuring an agent's decision quality at choice points during long-running work — what it picks to test, pursue, or abandon — rather than only scoring final outputs. Actionability angle: What this means for teams building long-running agents: there is now a separate yardstick for decision quality inside a run, not just whether the task finished cleanly. Why this matters: it surfaces failure modes that show up only when an agent picks the wrong starting branch and then runs with it for hours. Listener hook: Most agent tests count a win or a loss — this one tries to grade the judgment calls along the way.
Research digest: GameHorizon Puts AI Agents Through 5,000 Hours of AAA Gameplay A new benchmark suite tests AI models on 5,000 hours of AAA video game play, covering 21 titles from Valorant to Elden Ring. The goal: measure how well models can plan across different time horizons — from a single keystroke to a multi-session strategy — using language-grounded instructions. The team tested 47 different models and built offline multiple-choice questions plus stepwise online tasks that pinpoint exactly where a model fails. Technical depth angle: The suite gives AI agents a pyramid of instructions — primitive actions, short-horizon operations, medium-horizon goals, and long-horizon strategies — tied to timestamped human gameplay, so evaluators can test planning at every scale against reproducible offline questions and stepwise online tasks. Actionability angle: For anyone building game agents or evaluating multimodal models, this offers a standardized yardstick that isolates where breakdowns happen — perception, planning, or execution. Researchers can compare model families on the same AAA content offline rather than relying on flaky live rollouts. The 62 online subtasks make it possible to localize exactly which step a model gets wrong. Listener hook: If you've ever wondered whether an AI can actually play a real game — not a simplified grid world — here's the first benchmark built to find out.
NVIDIA Frames AI Agent Security as an Engineering Discipline On September 21, NVIDIA published a blog arguing that AI agent security is fundamentally an engineering problem requiring defined requirements, enforceable controls, named owners, and evidence that protections actually work. The post breaks the agent stack into models, harnesses, and runtimes, each carrying distinct security responsibilities, and points to concrete tools — NVIDIA's open-source OpenShell sandbox, Cisco's DefenseClaw governance layer, JFrog's skill scanning, Palo Alto Networks' Prisma AIRS for red teaming, and Capital One's VulnHunter for code security — that defenders can adopt today. Technical depth angle: The piece reframes agent security around three stack layers: models provide capabilities, harnesses organize context and tools, and runtime environments host execution. Crucially, controls must live outside the agent's reach so boundaries hold even when the model's reasoning goes wrong. Actionability angle: For builders shipping agents, this means treating the runtime sandbox — not the prompt — as the actual security perimeter. Wire scoped identities, network policies, and protected audit logs into the execution environment first, and assign a named owner who signs off on reproducible test evidence before each deployment. The framework matters because prompt-level guardrails alone cannot stop an agent with file and network access from doing real damage. Listener hook: If your agent can read a file and call an API, it already has the power to exfiltrate data, and the prompt is not where you stop it.
Thinking Machines Lab moves open-model inference to Crusoe Cloud under $65M deal Thinking Machines Lab has signed a $65 million annual deal to run production inference for its open models on Crusoe Cloud, the companies announced on September 23. The workload runs through Crusoe Managed Inference, a managed serving layer the company tunes around throughput, price-performance, and reliability — and the deal positions Crusoe as a serious neocloud option for open-model builders. Technical depth angle: Crusoe Managed Inference is a managed serving layer that lets a lab point open-model traffic at Crusoe's stack without owning the underlying hardware. The partnership is framed around three operational targets: throughput, price-performance, and reliability. Actionability angle: Builders using Thinking Machines Lab's open models should expect the same model behavior but a different provider behind the endpoints, which is worth re-benchmarking once traffic shifts. If you're running cost-sensitive batch jobs, a managed SLA and explicit price-performance framing may matter more than peak tokens-per-second claims. Why this matters: serving-stack choices now show up directly in your latency, uptime, and per-token bill. Listener hook: A serious open-model lab just bet $65 million a year that Crusoe can serve its traffic more reliably than its previous setup.
Jev returns probabilities instead of text, undercutting GPT-5 Nano on price TypeSafe AI has unveiled Jev, a new model category it's calling 'System One' or 'decision' models. Unlike a regular LLM, Jev takes in text and returns floating point numbers — confidence scores, yes/no probabilities, or distributions over a set of choices — rather than freeform text. It's also priced unusually: only input tokens count, output is free, and the input rate is $0.042 per million tokens, undercutting OpenAI's GPT-5 Nano at $0.05. That makes it a different kind of building block — better suited to classification, scoring, and routing decisions than to writing prose. Technical depth angle: Jev accepts a 'state' object — a string, list of strings, or set of name-value pairs — plus one or more typed questions, and returns a structured probability answer for each. Three question shapes: Noul (yes/no, returning a 0–1 confidence; the name comes from Bernoulli), Choice (a probability distribution over labeled options), and Score (a numeric rating along a sequence of levels). Actionability angle: For builders, this is a fit for routing, triage, and classification layers where a confidence number matters more than a sentence. It pairs naturally with a regular LLM — Jev makes the decision, a text model drafts the reply. Listener hook: Sometimes you don't want an answer, you want a probability — and a new model class just made that cheaper than ever.
A Self-Hosted Browser That Lets AI Agents Skip Captchas A new release of invisible_playwright_mcp, an open-source Python Model Context Protocol server, lets AI agents drive an undetected stealth Firefox for scraping, browser automation, and computer use without running into captchas. The project shipped v0.70.0 on September 23 and now sits at over 31,600 stars on GitHub, making it one of the most-starred stealth-browser tools available to builders. Technical depth angle: It's an MCP server wrapping Playwright around a patched, anti-detect Firefox build that mimics a normal user session, so the traffic profile avoids the fingerprint and bot-detector checks that typically trip up headless browsers. Actionability angle: Builders whose agents need to log in, scrape, or fill forms can self-host this instead of paying for a captcha-solving service. The setup is open-source and runs inside your own environment, which keeps credentials off third-party endpoints. Worth pinning the version and keeping usage inside site terms and applicable law, since stealth browsers live in an active arms race. Listener hook: If your agent keeps getting stopped by captchas, there's a self-hosted stealth Firefox that wants to fix it.
OpenAI releases MentalHealthBench to test AI responses in mental-health conversations On September 23, OpenAI published MentalHealthBench, a new evaluation set designed to measure how helpful and safe AI systems are when responding to realistic mental-health conversations. The benchmark is described as expert-informed, meaning mental-health specialists helped shape the scenarios and the criteria used to score AI replies. OpenAI framed it as a resource for developers and researchers building conversational AI in sensitive domains. Technical depth angle: MentalHealthBench is built from realistic mental-health conversation scenarios shaped with input from mental-health specialists, and it grades AI replies on both helpfulness and safety at the same time so neither dimension can be optimized at the expense of the other. Actionability angle: If you build a chatbot, assistant, or model that touches emotional support, counseling, or any crisis-adjacent use case, this gives you a public yardstick to track regressions and compare options on the same scenarios rather than cherry-picked demos. The dual helpful-and-safe framing also signals what OpenAI considers table stakes for mental-health-facing products, which is useful context for anyone shipping in that space. Listener hook: OpenAI just put a public scorecard on the table for AI in therapy-style conversations, and the rubric came from the people who do this work for real.
Editorial Mix Check
- flagship_products: 7
- builder_projects: 6
- local_ai: 2
- hardware_compute: 3
- policy_regulation: 5
- research: 2
Model Discovery Check
Z.ai: GLM 5.3 Prime (z-ai) — Newly listed this cycle (verified September 23, 2026). Primary source: https://openrouter.ai/models/z-ai/glm-5.3-prime. Availability: API via OpenRouter. Capabilities: context length 1000000; GLM-5.3-Prime is the high-speed variant of Z.ai's GLM-5.3, inheriting its full capabilities while delivering 1.5–2× the output throughput through inference acce. Try now / integration angle: available for evaluation via the model page above. Decision: Not Selected — variant/duplicate of a model featured on a recent broadcast, or not a major standalone drop.
Qwen: Qwen3.8 Max Prime (qwen) — Newly listed this cycle (verified September 23, 2026). Primary source: https://openrouter.ai/models/qwen/qwen3.8-max-prime. Availability: API via OpenRouter. Capabilities: context length 1000000; Qwen3.8 Max Prime is a higher-throughput variant of Qwen3.8 Max from Alibaba's Qwen team, served as a separate SKU at a higher price point. It accepts text, ima. Try now / integration angle: available for evaluation via the model page above. Decision: Not Selected — variant/duplicate of a model featured on a recent broadcast, or not a major standalone drop.
Local LLM Spotlight
- prism-ml/Ternary-Bonsai-2-27B-gguf — https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf — Trending open model on Hugging Face; task text-generation; 1950 likes and 2815979 downloads. Tags: llama.cpp, gguf, ternary, 2-bit, llama-cpp, cuda, metal, on-device, hybrid-attention, prismml. Try now: Read the linked model card before downloading, and choose a runtime or device only after it confirms the license, weight format, context window, benchmarks, and hardware requirements.
GitHub Project Radar
HKUDS/nanobot — https://github.com/HKUDS/nanobot — nanobot is an ultra-lightweight, open-source, self-hosted Python framework for personal AI agents, shipping a WebUI, tool registry, memory, MCP integration, multi-agent workflows, and automation hooks.
stars: 48,518;stars_delta_30d: +1,267 (+2.7%) since 2026-08-21;latest_release: v0.3.5 (2026-09-15). Why this is on the radar now: v0.3.5 shipped on 2026-09-15 and the repository was updated on 2026-09-23. Stack improvement angle: It can sit beside OpenClaw or Hermes as a self-hosted orchestration shell, offloading WebUI, memory persistence, and MCP tool wiring from the harness itself. Try now: Clone the repo and run its WebUI locally to compare its MCP tool surface against what your current harness exposes.DeusData/codebase-memory-mcp — https://github.com/DeusData/codebase-memory-mcp — codebase-memory-mcp is a high-performance MCP server that builds a persistent knowledge graph of any codebase, claiming sub-millisecond queries across 158 languages and a 99% token reduction, shipped as a single static binary.
stars: 44,542;stars_delta_30d: +4,787 (+12.0%) since 2026-08-21;latest_release: v0.11.0 (2026-09-15). Why this is on the radar now: v0.11.0 shipped on 2026-09-15 and the repository was updated on 2026-09-23. Stack improvement angle: Drop it into a Codex or Claude Code stack as a dedicated code-intelligence MCP so the agent can query a pre-built graph instead of re-reading files every turn. Try now: Point the static binary at one of your own repos and time a query against the harness's default file-reading path.feder-cr/invisible_playwright_mcp — https://github.com/feder-cr/invisible_playwright_mcp — invisible_playwright_mcp is a self-hosted Python MCP server that drives an undetected anti-detect Firefox profile, giving agents a browser surface that aims to avoid captchas.
stars: 31,644;stars_delta_30d: n/a — first tracked appearance;latest_release: v0.70.0 (2026-09-23). Why this is on the radar now: v0.70.0 shipped on 2026-09-23 and the repository was updated on 2026-09-23. Stack improvement angle: Swap it into an OpenClaw or Hermes browser tool to keep scraping and computer-use flows running without the agent hitting captcha walls mid-task. Try now: Stand it up locally and run a single navigation request through your agent to confirm the MCP handshake before wiring it into production flows.
Extra Research Candidates
Sam Altman’s remarks at the United Nations Security Council — https://openai.com/index/sam-altman-un-security-council-remarks — OpenAI CEO Sam Altman discusses AI safety, human control, and international cooperation in remarks to the United Nations Security Council. Technical depth angle: The remarks center on AI safety governance, retaining human control over advanced systems, and international coordination frameworks for frontier model deployment.
Introducing MentalHealthBench — https://openai.com/index/introducing-mentalhealthbench — MentalHealthBench is an expert-informed benchmark for evaluating helpful and safe AI responses across realistic mental health conversations. Technical depth angle: MentalHealthBench evaluates helpfulness and safety using expert-informed rubrics applied to realistic mental-health conversation transcripts.
TykTechnologies/tyk — Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Mode — https://github.com/TykTechnologies/tyk — Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol) GitHub reports 10830 stars. Latest release: v5.14.0 2026-07-07T17:34:16Z. Repository pushed 2026-09-23T15:02:32Z. Technical depth angle: Tyk acts as a unified gateway that proxies REST, GraphQL, TCP, gRPC, and MCP traffic behind a single routing and policy layer.
Show Notes
Episode 116 — September 23, 2026
[00:00] Episode hook
Hermes Agent shipped v0.21.4, tagged v2026.9.21, on September 21, 2026, rolling roughly 1,800 merged pull requests and 5,071 non-merge commits across 5,169 changed files into one patch release. Anthropic released Claude Opus 5.5 on September 22 at $4 per million input tokens and $20 per million output tokens, performing about as well as Claude Fable 5.1 across most benchmarks while running 40% cheaper to operate. OpenAI followed roughly ninety minutes later with GPT-6 Sol and Luna. SpaceXAI also shipped Grok 4.7 on September 21, 2026, built on a larger base model than Grok 4.6 with coding and knowledge-work improvements at the same $2 input and $6 output pricing. Nokia open-sourced AnyJev, a Python library turning open-source LLMs into calibrated decision systems without additional training, while NVIDIA released Nemotron 3 Diarization, a 100-million-parameter open-weight model that tracks up to eight overlapping speakers live.
[02:00] Agent Stack Release Readout: Hermes Agent v2026.9.21
Hermes Agent shipped v0.21.4, tagged v2026.9.21, on September 21, 2026. It is a patch release from Nous Research that rolls up roughly 1,800 merged pull requests since v0.21.3 into a single stable tag for downstream consumers like Docker images, Hermes Cloud, and hosted deployments. Measured at commit 4b8a8134009a8727a289bcabeb0019fedd353128, the window since v0.21.3 contains 5,071 non-merge commits across 5,169 changed files, with 312,961 lines added and 62,855 removed, alongside 1,812 merged PRs and 2,116 closed issues. Curated release notes for everything in this window are deferred to v0.22.0.
Several concrete changes landed in the window. The CLI gains `--format stream-json` for structured JSONL output, which downstream tooling can ingest directly. A new `mcp.discovery_concurrency` setting caps parallel MCP discovery connections, giving operators a tunable knob during cold start. `skills.auto_load` now pins selected skills into every new session prompt, so the set of available skills is consistent across sessions without re-invocation. A host-wide gateway singleton lock with a rendezvous record means the Desktop client now attaches to the running host backend rather than spawning a second one, and one backend-owned connector operation shows up as a setup card on Desktop, TUI, and CLI.
Other additions include a `decline` unauthorized-DM behavior for the gateway, `session_search` after and before bounds with OR-relaxed recall retry, and a `hermes sessions set-journal-mode` command. Desktop picks up a chat and UI font picker, one-click local engine updates, and plugin uninstall from the Plugins hub. The video catalogs add LTX 2.5 and Kling O3, and the website now has a page for every catalog plugin and author with pinned-commit READMEs and added or updated sorting. About a dozen community plugins joined the catalog, including tailscale, ssh, shodan, terminal, rss, resetwatch, done-bell, kiwi, cognee, and octen.
To update, git installs run `hermes update`, and Docker or Hermes Cloud users pull from `nousresearch/hermes-agent:v2026.9.21`.
[03:10] Claude Opus 5.5 delivers Fable-class results at $4 in, $20 out
Anthropic shipped Claude Opus 5.5 on September 22, the first model in the Claude 5.5 family, with Sonnet 5.5 and Haiku 5.5 arriving within weeks. The headline claim: Opus 5.5 performs about as well as Claude Fable 5.1 on most work while running at lower cost. The pricing reflects that shift. Input tokens cost $4 per million versus Opus 5's $5, output tokens cost $20 versus $25, and cached reads are 60% cheaper at $0.20. At default settings, typical workloads cost 40% less overall. Output generates more than 30% faster than Opus 5. The model carries a 1,000,000-token context window and supports up to 128,000 output tokens, handling text, image, and file inputs. It is available on the Claude Platform, AWS, Google Cloud, Microsoft Azure, and GitHub Copilot, with zero data retention as an option.
The thinking model is now mandatory. Users can choose effort levels—low, medium, high, xhigh, or max—but cannot disable thinking entirely. Max effort unlocks adaptive thinking, which produces more internal reasoning steps before final output. Fast mode in Claude Code and the Claude Platform runs up to 2.5 times faster at $8 input and $40 output per million tokens, trading cost for speed.
Anthropic published benchmark results comparing Opus 5.5, Fable 5.1, and Opus 5 at max effort with adaptive thinking. On Terminal-Bench 4.0, Opus 5.5 scored 66.4% versus Opus 5's 52.3%. On AutomationBench, the gap widened to 40.0% versus 26.9%. On OSWorld 2.0 partial, Opus 5.5 reached 81.8% versus Opus 5's 74.0%. GDPval-AA v2.1 Elo placed Opus 5.5 at 1846 versus Opus 5's 1708. Anthropic also shared internal test results from customers. Stripe ran 40 stacked pull requests through the model and all passed CI. Box used a third of the tokens compared to previous runs with 40% less verbose output. Deloitte caught 72% of planted bugs at low effort, compared to 56% for Opus 5. Hebbia achieved 86.6% rubric coverage on a research task versus 60.3% with the prior model.
Safety testing by METR and Frontier Design before release showed Opus 5.5 posted Anthropic's best score yet on an automated behavioral audit of roughly 2,000 scenarios and attempted to cross containment boundaries about 85% less often than Opus 5. Anthropic notes the model often suspects it is being evaluated, which tempers confidence in that figure. Cyber tasks route to Opus 4.8 under safeguards, and Anthropic opened a Cyber Verification Program and Life Sciences Verification Program to vetted organizations. Five-hour usage limits are rising for Pro, Max, Team, and seat-based Enterprise plans. Output carries text watermarking for EU AI Act compliance, and preserved thinking applies to Fable 5.1 and Opus 5.5 on API accounts created on or after August 31, 2026.
[05:58] Head-to-head: GPT-6 Sol and GPT-6 Astra versus Anthropic's new flagship
Anthropic shipped Claude Opus 5.5 on September 22, 2026. OpenAI answered roughly 90 minutes later with GPT-6 Sol and Luna, though Astra remains OpenAI's top-tier flagship. The pricing picture is now concrete. Opus 5.5 lists at $4 per million input tokens and $20 per million output. Astra sits at $10 and $50. Sol comes in at $2 and $10, and Luna at a fraction of a cent. On benchmarks Anthropic published with the launch, Opus 5.5 at its default medium effort ties Astra's Terminal-Bench score, beats Astra's best on FrontierCode at roughly one-fifth the cost, and leads on Humanity's Last Exam with tools. Astra retains edges on science-focused and automation benchmarks. All three models share 128,000-token maximum output, text-and-image-and-file input, and context windows near one million tokens. OpenAI positioned Sol as a coding and professional-work alternative to Astra at significantly lower cost, claiming it matches Claude Fable 5.1 performance on FrontierCode and reaches Astra-level factual accuracy at a fraction of the price. Luna, the fastest and cheapest tier, scores on par with Opus 5 at medium effort at 93% less per task, targeting high-volume automated workflows. Simon Willison's read is that the premium top tier is now a two-horse race between Astra and Claude Fable 5.1, while the real price war is happening below that, with Opus 5.5, Sol, and Grok 4.7 competing for cost-conscious builders.
[07:23] Grok 4.7 Lands: Bigger Model, Same $2/$6 Price
SpaceXAI released Grok 4.7 on September 21, 2026, marketing it as the company's most capable model for coding and knowledge work. The twist is the price tag: it lands at the same $2 per million input tokens and $6 per million output tokens as Grok 4.6, with the same serving speed, and an optional fast variant that doubles output speed for twice the price.
Under the hood it's a larger base model than Grok 4.6, trained on a longer reinforcement learning run weighted toward problems that take many hours to complete. That extra training shows up in better self-verification, longer-context handling, and a new instruction layer that natively understands the Grok Bot harness for conversational and general knowledge tasks. SpaceXAI also rebuilt the safeguard stack, claiming Grok 4.7 is the strongest model it has tested on refusals and jailbreak resistance. On LatchBio's biosafety benchmark it posts 62.4%, and on HackerBench v0.3 it lets through only 3.3% of risky dual-use prompts while rarely blocking legitimate security work.
On benchmarks, Grok 4.7 sits at the frontier of CursorBench 4.0 price-performance, with a high-effort score on DeepSWE v1.1 and comparable marks on GDPval, AA Briefcase v1.1, and EEBench against Fable 5.1 and GPT-6 Astra. Document and presentation creation improved over Grok 4.6, and SpaceXAI says select cybersecurity partners now have invite-only access to its red-team capabilities for defense research.
It's live today in Cursor, Grok Build, the Grok API, third-party coding harnesses, and several model routers and cloud platforms. For anyone already running Grok 4.6 in a production pipeline, the upgrade is effectively free at the API level — flip the model string and you get the bigger brain for the same bill.
[09:09] Nokia Open-Sources AnyJev: No-Training Layer Makes Open LLMs Reliable Decision-Makers
Nokia's applied research team has released AnyJev, a Python library that turns any open language model into a calibrated decision model without training. The tool targets a frequent production need: selecting one answer from a fixed set rather than generating free-form text. It installs from PyPI under Apache-2.0 and has transformers and vLLM backends with shared-prefix scoring for efficient serving.
The problem the team addresses is that reading probabilities directly from language models produces two consistent errors. First, models favor certain labels regardless of input—what the team calls prior bias, like preferring "Yes" over "No." Second, models favor positions in the option list, so shuffling the order changes the answer. Both flaws make naive probability reading unreliable for real systems.
AnyJev applies two fixes. L0 uses cyclic shifts: for a question with K options, it shows the list in K different rotations, so every option appears in every position once. It averages the results in log space as a geometric mean, which removes position bias exactly if that bias is additive in logit space. L0 also keeps a running mean of predicted distributions on real inputs and divides it out at strength 0.75 after observing 8 items, correcting the prior bias. L1 adds temperature scaling on top, requiring 100 to 500 labeled examples per question type. That reshapes confidence scores without changing which answer ranks first.
On Qwen3-8B tested against the BANKING77 benchmark—a 20-way classification task with 300 test items—raw logits flipped answers 23% of the time when options were reordered. AnyJev L0 cut that to 7.3%, and L1 held it at 7.7%. Accuracy improved from 74.7% to 80.7%. More practically, the fraction of queries that could be decided automatically at a 5% error threshold rose from 7.7% to 52%, meaning over half of all decisions could be routed with confidence instead of escalated to a human.
The team tested the approach across Qwen, OLMo, Granite, Phi, and Mistral models, with L0 reducing order flips across all nine model and task combinations. On a typed-decisions dataset, Qwen3-32B with L1 reached a calibration error of 0.036 compared to 0.144 reported for Jev, the commercial decision model it emulates.
For serving, developers point vLLM with prefix caching at a hosted model and configure a VLLMBackend in AnyJev. The team estimates roughly 0.25 seconds per decision at batch 32 on a single H100 with K equals 20. The library is available now on PyPI.
[11:40] NVIDIA's Nemotron 3 Diarization Tracks Eight Overlapping Speakers Live
NVIDIA has released Nemotron 3 Diarization, a 100-million-parameter open-weight model that answers one deceptively simple question about any conversation: who spoke when. Automatic speech recognition gives you the words, but without attribution a summarizer cannot tell who made a commitment or who raised an objection. Diarization fills that gap.
The model tracks up to eight speakers and handles overlapping voices in a single checkpoint. NVIDIA's earlier Streaming Sortformer topped out at four. Inputs are 16 kHz, single-channel audio in wav, flac, opus, or mp3 format. A mel-spectrogram with a 10 ms step is stacked by a factor of eight to produce 80 ms encoder frames, which feed a 31-layer Transformer with rotary positional embeddings. A one-dimensional convolution layer upsamples speaker activity back to 10 ms, producing an eight-channel tensor where two voices at once lights up two channels.
Speakers are ordered by arrival time, so the first new voice takes channel one and stays there across streaming chunks. Two memory mechanisms keep that stable: an Arrival-Order Speaker Cache plus a first-in-first-out queue.
On Voice Arena's initial Diarization-Bench, which measures diarization error rate across 139 English conversations totaling about 22 hours, the model hit 14.72% versus 19.3% for the next-ranked system, roughly a 24% relative reduction. Against the four-speaker baseline at 1.04 s latency, average relative error dropped 41% across eight conditions, with a 65% drop on NOTSOFAR1 MHM. Throughput at 30.4 s hit 15,113x real-time on an NVIDIA RTX PRO 5000.
Weights are released under the OpenMDW 1.1 license for commercial use. Production paths include Baseten and DigitalOcean, with on-device mobile through Argmax Pro SDK 3.
[13:21] OpenAI extends Daybreak cyber access to Ukraine
OpenAI announced on September 23, 2026 that it is extending access to its Daybreak program to the Government of Ukraine. The program supports the cyber defense of civilian infrastructure, according to OpenAI News.
The extension puts OpenAI's tooling inside the defensive stack protecting Ukrainian civilian systems from cyber threats. By opening Daybreak access to a national government, OpenAI is treating civilian infrastructure as a category that warrants direct vendor support, rather than routing that support through intermediaries or third-party partnerships.
Daybreak is positioned as OpenAI's program for cyber defense work on civilian-facing systems, and Ukraine becomes a direct government recipient of extended access under that program.
What this changes in practice: any organization building critical-infrastructure defense tools now has another data point showing that major model vendors are willing to ship direct government access programs for civilian cyber work, not just research partnerships or advisory engagements. For builders working on adjacent tooling — threat-intel pipelines, anomaly detection, automated triage, or incident-response copilots — this confirms that the civilian-defense buyer is real, active, and getting direct vendor relationships.
The primary source is OpenAI's newsroom post dated 2026-09-23, published at 13:00 UTC.
[14:32] Research digest: A benchmark for agent 'taste' on long tasks
A research project called TasteBench is asking a fresh question about AI agents that work on long jobs: how good are the decisions they make along the way, not just whether the run ends in success? The paper, currently trending on HuggingFace's daily feed, borrows the word taste to describe an agent's ability to pick the right next move — which hypothesis to chase, which implementation to build on — inside a task that sprawls across hours of work. Existing benchmarks grade the final answer. This one focuses on the branching choices themselves. The authors argue that for software engineering and research workflows, those mid-run choices are what actually decide the outcome. A benchmark that isolates them could let teams compare agents on a dimension they currently have to guess at. Worth watching: whether other labs adopt it, or build their own version of a decision-quality yardstick for long-running work.
[15:29] Research digest: GameHorizon Puts AI Agents Through 5,000 Hours of AAA Gameplay
A team has released GameHorizon, a benchmark and dataset that puts AI agents through 5,000 hours of recorded play across 21 AAA video games — including Valorant, Minecraft, Grand Theft Auto V, Palworld, and Elden Ring. A hundred experienced human players drove the recordings, and every action is timestamped and labeled with a three-level pyramid of language instructions: primitive actions, short-horizon operations, and longer goals and strategies.
The point is to test whether models can plan across time horizons — figure out the next keypress, the next sub-objective, and a multi-step strategy — without relying on flaky live gameplay. The benchmark ships with 5,000 offline multiple-choice questions and 20 stepwise online tasks broken into 62 subtasks, so evaluators can pinpoint exactly where a model breaks down.
The team tested 47 models spanning vision-language, GUI, coding, and game-agent families. GameHorizon is the first large-scale AAA-focused dataset that combines human-recorded actions, dense instructions, and reproducible offline evaluation in one place.
[16:29] NVIDIA Frames AI Agent Security as an Engineering Discipline
NVIDIA published a blog on September 21 making the case that securing AI agents is not a research problem, it's an engineering one. The post argues that defenses only count when they come with defined requirements, enforceable controls, a named owner, and documented evidence that the controls actually work.
The agent stack, the blog says, splits into three layers: models provide capabilities, harnesses organize context, tools, and workflows, and runtime environments provide the infrastructure where actions execute. Each layer carries its own security responsibilities, and protection has to hold across all three as data and instructions move through the system.
The concrete example the post walks through: an agent asked to update a customer record encounters malicious instructions in an attached document and tries to export the data to an outside destination. A network policy blocks the outbound transfer. Protected logs capture the attempted tool call, the authorization decision, and where it was headed. The agent holds permission to update the record but not to export it, and it cannot grant itself that extra access on its own.
NVIDIA points to its own open-source OpenShell runtime as one enforceable boundary — a sandboxed execution environment that enforces file, network, and process limits outside the agent's reasoning. Cisco's DefenseClaw adds governance on top, and JFrog integrates to scan and verify agent skills before they are allowed to run.
For evidence, the post calls for testing that blocks credential escalation attempts and unauthorized data transfers, repeated after any meaningful model or tool change, with a named owner signing off on readiness. It highlights CrowdStrike's SafeMind for repeated attack simulations, Palo Alto Networks' Prisma AIRS for continuous red teaming, Capital One's VulnHunter for AI-assisted code review, and ReversingLabs' Spectra Assure for catching malware in software dependencies.
The closing message is shared openly: post-incident findings should turn into repeatable tests, and the broader Open Secure AI Alliance exists to circulate what works across the security community.
[18:30] Thinking Machines Lab moves open-model inference to Crusoe Cloud under $65M deal
Thinking Machines Lab has signed a $65 million annual deal to run inference for its open models on Crusoe Cloud, the companies said on September 23. The arrangement routes production traffic through Crusoe Managed Inference, a service layer the company positions around throughput, price-performance, and reliability rather than raw training horsepower.
For builders, the practical question is what changes at the API. The model weights and behavior are unchanged — Thinking Machines Lab's open models stay open. What shifts is the serving stack underneath them, which is the piece that determines latency, uptime, and per-token cost. Crusoe is selling Managed Inference as a tuned environment rather than bare-metal access, so the lab hands off capacity planning in exchange for a managed agreement.
The deal is also a signal about where serious open-model serving is consolidating. Crusoe has pitched itself as a neocloud built for AI workloads, and landing a multi-year, eight-figure annual commitment from a notable AI lab is the kind of reference customer that shapes the next round of buyer evaluations. The announcement frames throughput and reliability as the headline wins, with price-performance as the third leg — a deliberate echo of how hyperscalers market their own inference tiers.
One thing worth watching is what this means for developers already running Thinking Machines Lab models elsewhere. If you're a current customer, expect the same model surface but a different provider behind the endpoints, which is worth re-benchmarking once traffic shifts. The larger question is whether Crusoe can convert this single anchor customer into a broader pattern of open-model labs outsourcing their inference rather than running it in-house.
[20:11] Jev returns probabilities instead of text, undercutting GPT-5 Nano on price
TypeSafe AI unveiled Jev earlier this month, and it's a different kind of model than most people are used to. The company calls these "System One" models; Simon Willison and Maggie Appleton both prefer the term "decision models." The shape is unusual: Jev still takes in text, but instead of generating text back, it returns floating point numbers — probabilities, confidence scores, and distributions over categories.
You build a "state" object describing whatever you're looking at — an article, a customer record, a chunk of semi-structured data — and then attach one or more typed questions. Jev answers each one with a structured probability instead of a sentence. There are three question shapes. "Noul" questions are yes/no — you state a proposition, and Jev returns a number between 0 and 1 representing how confident it is that the statement holds; the name, the company's CEO confirmed on Hacker News, is short for Bernoulli, as in the Bernoulli distribution. Choice questions take a list of labeled options and return a probability distribution across them. Score questions ask for a rating along a sequence of numeric levels.
The pricing is what makes it interesting for builders. Jev charges only for input tokens — output is free — and the input rate is $0.042 per million tokens. That undercuts OpenAI's GPT-5 Nano at $0.05 per million tokens, which TypeSafe positions as the benchmark it just beat. Because output is essentially free, Jev fits naturally into pipelines that fan out many parallel decisions per document.
For builders, that means Jev is worth a look anywhere you'd previously bolted a classification prompt onto a general LLM. It's a fit for routing, triage, or content moderation layers where you want a confidence number rather than a paragraph. Pair it with a regular text model downstream for anything that needs an actual reply.
[22:07] A Self-Hosted Browser That Lets AI Agents Skip Captchas
A new release of invisible_playwright_mcp gives AI agents a self-hosted way to browse the web without tripping common bot defenses. The project is a Python server that speaks Model Context Protocol, the same standard models use to call external tools, and it wraps Playwright, the popular browser-automation library, around an undetected, anti-detect stealth build of Firefox. The result is a browser session that mimics a regular user rather than a headless script, which helps it pass fingerprint checks and skip captchas. Version 0.70.0 shipped on September 23, and the GitHub repository now shows more than 31,600 stars.
For builders, the appeal is straightforward. Browser automation that used to require a paid captcha-solving service or fragile workarounds can now be handled inside a tool an agent can already call. Anything that needs a real session — logging in to a dashboard, scraping a site behind basic bot walls, filling multi-step forms, or driving a "computer use" loop — can run through this server in your own environment. That keeps credentials local and removes a third-party dependency from the loop.
The project is open-source and self-hosted, so the usual caveat applies: stealth browsers are arms-race tools, and an anti-detect Firefox from one project can be fingerprinted tomorrow. Watch upstream Firefox changes, pin the version, and keep usage within site terms and applicable law. If your agent is currently stuck behind a captcha wall, this is one of the more mature open options to try.
[23:38] OpenAI releases MentalHealthBench to test AI responses in mental-health conversations
OpenAI published MentalHealthBench on September 23. It is a benchmark — a standardized evaluation set — for measuring how AI systems respond in mental-health conversations, scored on two dimensions at once: being helpful and being safe.
What makes it distinct, according to OpenAI's announcement, is that the benchmark is expert-informed. Mental-health specialists were involved in shaping the realistic conversation scenarios the benchmark draws on. That detail matters because generic safety tests tend to miss the texture of an actual conversation — how a model handles someone in distress, talks through a panic moment, or knows when to point a user toward professional help.
The implied audience is developers and researchers building conversational AI for sensitive contexts — therapy-adjacent products, support bots, wellness apps, and the underlying models behind them. A public benchmark gives those teams a shared reference point instead of relying on hand-picked demos.
The framing also emphasizes a dual score. A model can be helpful but unsafe — engaging warmly while steering the user somewhere harmful — or safe but unhelpful, refusing or deflecting when the user genuinely needs guidance. MentalHealthBench tracks both, which means any single headline number will understate the picture. Teams shipping in this space now have a common yardstick, and they have to read both ends of it.
Watch next: whether third-party labs pick the benchmark up, and whether OpenAI releases baseline scores for its own models alongside it. A benchmark without published numbers is really just a rubric.
Chapters
- 00:00 — Intro: Agent Stack Release Readout: Hermes Agent v2026.9.21 / Claude Opus 5.5 delivers Fable-class results at $4 in, $20 out / Head-to-head: GPT-6 Sol and GPT-6 Astra versus Anthropic's new flagship
- 02:00 — Agent Stack Release Readout: Hermes Agent v2026.9.21
- 03:10 — Claude Opus 5.5 delivers Fable-class results at $4 in, $20 out
- 05:58 — Head-to-head: GPT-6 Sol and GPT-6 Astra versus Anthropic's new flagship
- 07:23 — Grok 4.7 Lands: Bigger Model, Same $2/$6 Price
- 09:09 — Nokia Open-Sources AnyJev: No-Training Layer Makes Open LLMs Reliable Decision-Makers
- 11:40 — NVIDIA's Nemotron 3 Diarization Tracks Eight Overlapping Speakers Live
- 13:21 — OpenAI extends Daybreak cyber access to Ukraine
- 14:32 — Research digest: A benchmark for agent 'taste' on long tasks
- 15:29 — Research digest: GameHorizon Puts AI Agents Through 5,000 Hours of AAA Gameplay
- 16:29 — NVIDIA Frames AI Agent Security as an Engineering Discipline
- 18:30 — Thinking Machines Lab moves open-model inference to Crusoe Cloud under $65M deal
- 20:11 — Jev returns probabilities instead of text, undercutting GPT-5 Nano on price
- 22:07 — A Self-Hosted Browser That Lets AI Agents Skip Captchas
- 23:38 — OpenAI releases MentalHealthBench to test AI responses in mental-health conversations
Primary Links
- Hermes Agent v2026.9.21 release: https://github.com/NousResearch/hermes-agent/releases/tag/v2026.9.21
- Claude Opus 5.5 delivers Fable-class results at $4 in, $20 out: https://www.anthropic.com/claude-opus-5-5
- Head-to-head: GPT-6 Sol and GPT-6 Astra versus Anthropic's new flagshi: https://simonwillison.net/2026/Sep/22/opus-and-sol-and-luna/
- Grok 4.7: https://x.ai/news/grok-4-7
- Gemini 3.8 text-to-speech: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-8-text-to-speech/
- NVIDIA Introduces SoL-Pi: Auto-Research Loops That Cut Coding Agent To: https://www.marktechpost.com/2026/09/21/nvidia-researchers-have-released-sol-pi/
- Nokia Open-Sources AnyJev: A Training-Free Layer That Turns Any Open L: https://www.marktechpost.com/2026/09/23/nokia-open-sources-anyjev-a-training-free-layer-that-turns-any-open-llm-into-a-calibrated-decision-model/
- NVIDIA Releases Nemotron 3 Diarization: A 100M-Parameter Open-Weight M: https://www.marktechpost.com/2026/09/23/nvidia-releases-nemotron-3-diarization/
- OpenAI extends cyber access to Ukraine for civilian defense: https://openai.com/index/openai-extends-cyber-access-to-ukraine-for-civilian-defense
- The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Task: https://github.com/wbopan/tastebench
- GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay: https://gamehorizon-suite.github.io/
- AI Security Is an Engineering Problem — How to Solve It at Every Layer: https://blogs.nvidia.com/blog/ai-security-agent-stack/
- Crusoe and Thinking Machines Lab Partner to Power Open-Model Inference: https://www.hpcwire.com/off-the-wire/crusoe-and-thinking-machines-lab-partner-to-power-open-model-inference-at-scale/
- Jev introduces a new shape of LLM - System One, aka Decision Models: https://simonwillison.net/2026/Sep/21/jev/
- feder-cr/invisible_playwright_mcp — Your AI agent browses the web with: https://github.com/feder-cr/invisible_playwright_mcp
- Introducing MentalHealthBench: https://openai.com/index/introducing-mentalhealthbench
- HKUDS/nanobot repo: https://github.com/HKUDS/nanobot
- DeusData/codebase-memory-mcp repo: https://github.com/DeusData/codebase-memory-mcp
- Sam Altman’s remarks at the United Nations Security Council: https://openai.com/index/sam-altman-un-security-council-remarks
- TykTechnologies/tyk — Open Source API and AI Gateway supporting REST, : https://github.com/TykTechnologies/tyk
- prism-ml/Ternary-Bonsai-2-27B-gguf: https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf
Release Coverage Check
- Hermes Agent — Latest stable verified:
v2026.9.21, published 2026-09-21T18:10:55Z. Recent episode version tags detected:v2026.8.31,v2026.9.11,v2026.9.14,v2026.9.7. Selected missing version(s):v2026.9.21. - OpenAI Codex — Latest stable verified:
rust-v0.156.1, published 2026-09-23T02:41:36Z. Recent episode version tags detected:rust-v0.153.0,rust-v0.153.2,rust-v0.155.0,rust-v0.155.1. No new stable release this cycle. - Claude Code CLI — Latest stable verified:
2.1.273, published 2026-09-15T18:06:34.098Z. Recent episode version tags detected:2.1.236,2.1.267,latest,stable. No new stable release this cycle. - Antigravity CLI — Continuous delivery model; no discrete release tags verified this cycle (latest build as of 2026-09-23). Recent episode version tags detected:
@google/antigravity,v2.0.
Harness Version Reference
- Hermes Agent —
v2026.9.21 - OpenAI Codex —
rust-v0.156.1 - Claude Code CLI —
2.1.273 - Antigravity CLI — Continuous delivery (no tagged release verified this cycle)
AgentStack Daily EP116 — Claude Opus 5.5 Lands at $4 In, $20 Out, Meets GPT-6 Sol and Astra
Nova I'm NOVA.
Alloy I'm ALLOY, and this is AgentStack Daily.
Nova Claude Opus 5.5 just landed at four dollars per million input tokens and twenty dollars per million output tokens, with Anthropic claiming Fable-class performance at a much lower operating cost. That puts it directly against OpenAI’s GPT-6 Sol and Astra—and gives people a model that can examine a large codebase, reason across a roomful of documents, or generate a report longer than many books.
Alloy And, okay, the price fight is getting intense. Grok 4.7 brings a larger base model without raising its two-dollar input and six-dollar output rates. Nokia’s AnyJev turns open language models into calibrated decision systems, while NVIDIA’s Nemotron 3 can separate as many as eight overlapping speakers live. Those changes affect what automation costs, whether an agent can make dependable routing decisions, and whether a meeting assistant can tell who actually promised what.
Nova Today, you’ll hear how Opus compares with Sol and Astra, what Hermes Agent 9.21 shipped across its enormous patch window, and why five thousand hours of recorded AAA gameplay could expose agent weaknesses that ordinary benchmarks miss.
[PAUSE]
[02:00] Agent Stack Release Readout: Hermes Agent 9.21
Nova Hermes Agent shipped 9.21 as a stable patch release from Nous Research, rolling roughly eighteen hundred merged pull requests into one tag for Docker images, Hermes Cloud, and hosted deployments. The measured window contains more than five thousand non-merge commits across roughly fifty-one hundred changed files, with over three hundred twelve thousand lines added. That’s an absurd amount of movement for something labeled a patch. The concrete additions cover both machine-facing output and daily interaction. Structured stream JSON gives downstream software a line-by-line event feed instead of forcing it to parse terminal prose. A new discovery-concurrency control limits how many Model Context Protocol connections open in parallel during startup. Selected skills can load automatically into every new session, making their availability consistent without calling them again. Search across prior sessions gains time boundaries and a broader retry when the first query is too strict. There’s also a command for changing session journal mode. The gateway can now decline unauthorized direct messages, and a host-wide singleton lock lets the desktop client attach to an existing backend instead of accidentally creating another one. One backend-owned connector operation can appear as the same setup card across desktop, terminal, and command-line surfaces. That consistency matters when the same agent is controlled from several interfaces.
Alloy Right, because duplicated backends make an agent feel haunted: two processes, two states, and no obvious owner. The singleton record gives every interface a shared place to find the running gateway, so opening desktop after a terminal session doesn’t quietly split the work. Desktop also gains one-click local-engine updates, a chat and interface font picker, and plugin removal from its hub. The video catalogs add LTX 2.5 and Kling O3. The plugin directory picks up community tools spanning Tailscale, SSH, Shodan, terminal access, RSS, memory, and notification utilities, while catalog pages now expose authors and pinned documentation more clearly. Taken together, 9.21 gives operators more control over structured output, connection pressure, persistent skills, gateway access, and which backend owns a session. Automatic skill loading is especially consequential for repeatable agents: a capability selected for every session no longer depends on somebody remembering to invoke it after the conversation begins. Structured event output also makes Hermes easier to embed inside another application because status, tool activity, and results can travel as records rather than decorated text. Honestly, the sheer size of the change window still deserves caution. A stable tag gives downstream deployments one defined release, but thousands of commits create a much broader surface than the word “patch” suggests. Even so, this isn’t merely a package bump. It changes how Hermes starts, communicates, remembers available capabilities, and presents the same operation across its interfaces.
[PAUSE]
[03:10] Claude Opus 5.5 Delivers Fable-Class Results at $4 In, $20 Out
Alloy Four dollars in and twenty dollars out sounds aggressive for an Opus model. What changed beyond the price?
Nova Opus 5.5 is the first Claude 5.5 model, with Sonnet and Haiku versions expected within weeks. Anthropic says it performs about as well as Claude Fable 5.1 across most work, while typical workloads cost forty percent less than Opus 5. Input falls from five dollars to four dollars per million tokens, output falls from twenty-five to twenty, and cached reads cost twenty cents. Generation is more than thirty percent faster. It accepts text, images, and files, carries a one-million-token context window, and can produce up to one hundred twenty-eight thousand tokens. It’s available through Anthropic, major cloud platforms, and GitHub Copilot, with zero data retention offered as an option. Thinking is always active. Users choose an effort level from low through max, and max enables adaptive thinking. Fast mode can run up to two and a half times faster at twice the standard token price.
Alloy That’s a serious repositioning. The launch results are substantial, though those numbers are Anthropic’s. At maximum effort, Opus 5.5 scored sixty-six point four percent on Terminal-Bench, up from fifty-two point three for Opus 5. AutomationBench rose from twenty-six point nine to forty percent, and partial OSWorld moved from seventy-four to eighty-one point eight. Stripe put forty stacked pull requests through the model and reported that all passed continuous integration. Box used a third of the previous token volume with forty percent less verbose output. Deloitte found seventy-two percent of planted bugs at low effort, against fifty-six percent for Opus 5, while Hebbia reported eighty-six point six percent rubric coverage, up from sixty point three. Anthropic also says containment-crossing attempts fell about eighty-five percent, while warning that the model often recognized evaluation settings. Cheaper long-context work, faster output, and stronger coding results still make this a serious flagship refresh.
[PAUSE]
[05:58] Head-to-Head: GPT-6 Sol and GPT-6 Astra Versus Anthropic’s New Flagship
Nova OpenAI answered roughly ninety minutes later with GPT-6 Sol and Luna, while Astra, launched earlier this month, stays its top tier. Price per million tokens: Astra is ten dollars in and fifty out, Opus 5.5 four and twenty, Sol two and ten, Luna ten cents and fifty cents. All three flagships take text, images, and files, handle about a million tokens of context, and produce up to one hundred twenty-eight thousand output tokens.
Alloy So against Astra, where does Opus actually win?
Nova Anthropic’s launch table puts them side by side. Terminal-Bench: Opus sixty-six point four, Astra fifty-seven point nine, with Opus at extra-high effort and Astra at high. FrontierCode: fifty-four point four against fifty-three point three. GDPval, an Elo rating for professional work: eighteen forty-six against fifteen forty-two. Humanity’s Last Exam with tools: sixty-seven point seven against fifty-seven point two. Astra wins two: AutomationBench, forty-one point four against forty, and Terminal-Bench Science, sixty-four point six against fifty-eight point seven. At default medium effort, Anthropic says Opus ties Astra on Terminal-Bench at about forty percent of the cost.
Alloy Sol meets Opus through the older models, because each lab benchmarked the other’s previous generation. OpenAI says Sol matches Fable 5.1 on FrontierCode at much lower cost, scores sixty-eight point eight on DeepSWE, about one point behind Fable 5, and edges Opus 5 on offline OSWorld, sixty point five to sixty point three, at roughly eighty percent lower cost per task. Anthropic says Opus 5.5 performs about as well as Fable 5.1. So the shape is clear: Astra and Fable hold the ten-and-fifty premium tier, Opus 5.5 brings Fable-class results down to four and twenty, and Sol halves that price while claiming Fable-level coding. As Simon Willison put it, the real price war sits one tier below the top.
[PAUSE]
[07:23] Grok 4.7 Lands: Bigger Model, Same $2/$6 Price
Alloy Grok 4.7 is the price-war move I didn’t expect. SpaceXAI says it uses a larger base model than Grok 4.6, yet the standard API stays at two dollars per million input tokens and six dollars per million output. Serving speed also stays level. A fast variant doubles output speed and doubles the price, which at least makes that trade explicit.
Nova The larger model went through a longer reinforcement-learning run weighted toward problems that can take hours, not seconds. SpaceXAI attributes better self-verification, longer-context handling, coding, and knowledge work to that training. It also added an instruction layer that understands the Grok Bot harness natively. The company says it rebuilt the safeguards and achieved its strongest refusal and jailbreak results so far. Its reported biosafety score is sixty-two point four percent on LatchBio, while HackerBench shows three point three percent of risky dual-use prompts getting through. Those are SpaceXAI’s results, so outside use will show how well they travel.
Alloy I care more about the price than the “bigger brain” slogan. Improved document and presentation creation at the same token rate can redirect routine work even if another flagship wins the hardest evaluation. SpaceXAI places Grok near the frontier of CursorBench price-performance and reports competitive results against Fable 5.1 and Astra across software engineering, professional work, and economics evaluations. Select security partners also get invitation-only red-team access. That needs careful boundaries, but defensive teams clearly want models capable of reasoning through realistic attack paths.
Nova And distribution is immediate: Cursor, Grok Build, the Grok API, third-party coding harnesses, model routers, and cloud platforms. Grok arrives where developers already buy inference, with its strongest argument on the invoice: a larger model at the old rate. If the claimed gains hold in ordinary coding and knowledge work, competitors must answer on quality and price without assuming a larger model automatically costs more.
[PAUSE]
[09:09] Nokia Open-Sources AnyJev: No-Training Layer Makes Open LLMs Reliable Decision-Makers
Nova Nokia’s AnyJev tackles a narrower problem than chat, and that’s why it’s interesting. The open-source Python library turns an existing open language model into a calibrated decision system without additional model training. Instead of asking for a paragraph, an application asks the model to select among fixed options and receives probabilities suitable for routing, classification, or escalation. It supports Transformers and vLLM serving, uses shared-prefix scoring to avoid repeating common prompt work, and carries the Apache 2.0 license. Nokia’s researchers tested the technique across Qwen, OLMo, Granite, Phi, and Mistral models rather than presenting it as a trick for one checkpoint.
Alloy Okay, the clever part is how it attacks two biases that make raw probabilities unreliable. A model can prefer a label such as “yes” regardless of the evidence, and it can favor whichever choice sits in a preferred list position. AnyJev rotates the options so every answer appears in every position, then combines the results using a geometric mean. It also corrects for the model’s background preference after observing real inputs. A second level uses a few hundred labeled examples to reshape confidence without changing the winning answer. On a twenty-way banking task with Qwen3-8B, reordered options changed raw answers twenty-three percent of the time. AnyJev cut that to about seven percent and raised accuracy from seventy-four point seven to eighty point seven percent. Better yet, the share of requests automated at a five-percent error threshold rose from seven point seven to fifty-two percent. That’s not statistical decoration. It changes how much work can move automatically and how much still needs a person.
[PAUSE]
[11:40] NVIDIA’s Nemotron 3 Diarization Tracks Eight Overlapping Speakers Live
Alloy Speech recognition tells you what was said, but it can leave a meeting assistant clueless about who said it. How does Nemotron 3 keep eight speakers straight when people interrupt one another?
Nova NVIDIA’s open-weight model produces eight channels of speaker activity from a single audio stream. It has one hundred million parameters and accepts standard sixteen-kilohertz, single-channel audio. The model converts sound into a frequency representation every ten milliseconds, groups those observations into eighty-millisecond frames, and sends them through a thirty-one-layer Transformer. A convolution layer restores ten-millisecond timing. When two people talk simultaneously, two output channels activate instead of forcing one voice to win. Speakers are assigned by arrival order—the first newly heard voice gets the first channel—and two memory systems preserve those identities as audio streams through successive chunks.
Alloy That’s a serious jump from NVIDIA’s previous four-speaker streaming system. On Voice Arena’s initial Diarization-Bench, covering about twenty-two hours across one hundred thirty-nine English conversations, Nemotron reached a fourteen point seven two percent diarization error rate. The next-ranked system was at nineteen point three, a relative reduction of roughly twenty-four percent. Against NVIDIA’s four-speaker baseline at just over one second of latency, average relative error dropped forty-one percent across eight conditions, including a sixty-five percent drop on one especially difficult multi-speaker set. The company also reports throughput above fifteen thousand times real time on an RTX Pro 5000 with longer chunks. Okay, that’s actually wild. Eight overlapping speakers aren’t a polite board meeting. They’re a hostile environment for attribution. The weights are commercially usable under NVIDIA’s OpenMDW license, with cloud serving routes and an on-device mobile path, so this can move beyond a lab demo into meeting capture, call analysis, broadcasting, and live transcription where interruptions are normal.
[PAUSE]
[13:21] OpenAI Extends Daybreak Cyber Access to Ukraine
Nova OpenAI is extending its Daybreak cyber-defense program directly to the Government of Ukraine, placing the company’s tools inside work protecting civilian infrastructure. A national government becomes a direct recipient of vendor support for defensive cyber operations rather than receiving capability only through an academic or intermediary partnership. Daybreak is framed around civilian-facing systems, giving this expansion a narrower purpose than general government access. In a country where digital attacks can accompany physical attacks, faster threat analysis can affect communications, public services, and other essential systems.
Alloy And that context makes the move consequential. Anomaly detection, threat-intelligence processing, automated triage, and incident-response assistance have immediate human stakes there. OpenAI’s decision shows frontier-model companies forming direct relationships with public-sector defenders around essential services. That may shorten response work, but it also puts difficult judgments inside vendor programs: who qualifies, which defensive uses receive advanced access, and how safeguards distinguish protection from dual-use escalation. The boundary isn’t academic when the same capabilities that identify a vulnerability might also help exploit it.
Nova Exactly, and it gives companies building the surrounding layer—security operations software, evidence handling, alert prioritization, and analyst copilots—a clear demand signal. Governments aren’t merely discussing AI-assisted cyber defense; at least one is receiving a dedicated program from a frontier lab during an ongoing conflict. I wouldn’t measure success by access alone. The meaningful results are defended services, faster investigations, and fewer successful intrusions. Still, Ukraine’s inclusion marks a move from demonstration toward operational support.
Alloy Yes, and direct support brings direct responsibility. OpenAI now has to maintain the boundary around civilian defense while its systems encounter real adversarial behavior, sensitive information, and urgent decisions. If Daybreak helps analysts connect evidence sooner without replacing accountable human judgment, it could become a model for narrowly defined public-interest deployments. If the boundary blurs, the same program will draw scrutiny for good reason.
[PAUSE]
[14:32] Research Digest: A Benchmark for Agent “Taste” on Long Tasks
Nova TasteBench asks whether an agent makes good choices during a long task, not merely whether it stumbles into a successful final answer. The researchers use “taste” for decisions such as which hypothesis deserves attention, which partial implementation should survive, and when a promising route has become a dead end.
Alloy I like that distinction because final-answer scoring can hide waste and luck. Two agents may both finish a software task, while one takes a coherent path and the other burns hours on bad branches before recovering. Long-running research and coding systems live or die through those intermediate decisions.
Nova But can a benchmark define good taste without just encoding the preferences of its authors?
Alloy That’s the hard part. Expert judgments may vary across domains, and a surprising route can look wrong before it succeeds. TasteBench is most useful as a diagnostic, not one grand score. It can help separate planning quality from final completion and reveal whether an agent repeatedly abandons strong ideas, clings to weak ones, or spends its budget wandering. Conventional pass-or-fail evaluations blur those behaviors together.
[PAUSE]
[15:29] Research Digest: GameHorizon Puts AI Agents Through 5,000 Hours of AAA Gameplay
Alloy GameHorizon gives agents five thousand hours of recorded play across twenty-one major games, including Valorant, Minecraft, Grand Theft Auto V, Palworld, and Elden Ring. One hundred experienced players generated the demonstrations, with actions aligned to instructions ranging from immediate controls to short operations and longer strategies.
Nova That layered labeling is the point. An agent might identify the next keypress yet fail to pursue a goal that takes several stages, or describe a good strategy while missing the action needed now. GameHorizon separates those failures through five thousand offline questions and twenty interactive tasks divided into sixty-two subtasks. The researchers evaluated forty-seven vision-language, interface-control, coding, and game-specialist models. Because the recordings are fixed, different systems face the same situations instead of being compared across unpredictable live runs. AAA games provide dense worlds, partial information, interruptions, and delayed rewards—a useful stress case for agents expected to plan beyond the next screen.
[PAUSE]
[16:29] NVIDIA Frames AI Agent Security as an Engineering Discipline
Nova NVIDIA argues that agent security becomes real when somebody turns a concern into a requirement, an enforceable control, an owner, and evidence that the control worked. Its example is blunt: an agent updating a customer record reads malicious instructions embedded in a document and attempts to export data. A network rule blocks the transfer, protected logs record the attempted tool call and destination, and the agent can’t expand its own permission.
Alloy That’s refreshingly concrete. It assumes the model can be manipulated and puts a boundary outside the model’s reasoning. NVIDIA divides the system into models, harnesses, and execution environments. Models supply capabilities; harnesses assemble instructions, context, and tools; runtimes control the files, networks, and processes where actions occur. A defense at only one layer leaves another layer able to carry a bad instruction into the world.
Nova NVIDIA points to OpenShell as its sandboxed runtime for external file, network, and process limits. Cisco’s DefenseClaw adds governance, while JFrog scans agent skills before they run. Other examples include CrowdStrike’s SafeMind for repeated attack simulation, Palo Alto Networks’ Prisma AIRS for continuous adversarial probing, Capital One’s VulnHunter for AI-assisted code review, and ReversingLabs’ Spectra Assure for finding malicious dependencies. That’s a lot of product names, but they support one concrete idea: permissions, execution boundaries, monitoring, and software supply-chain checks all have to survive independently of the model’s judgment. An agent that can read a malicious instruction may still be prevented from opening an outbound connection, reaching a protected file, or installing a poisoned package. That turns security from a hope about model behavior into several independently enforceable limits.
[PAUSE]
[18:30] Thinking Machines Lab Moves Open-Model Inference to Crusoe Cloud Under $65M Deal
Alloy Thinking Machines Lab has committed sixty-five million dollars annually to run inference for its open models on Crusoe Cloud. That’s not a hardware purchase disguised as a partnership. Production traffic will move through Crusoe Managed Inference, where Crusoe takes responsibility for the serving layer around throughput, price-performance, capacity, and reliability.
Nova The open weights and model behavior remain the same. What changes is the machinery behind the endpoint—the servers, scheduling, scaling, and optimization that determine latency and per-token economics. Thinking Machines hands off capacity planning under a managed agreement instead of building every part of that infrastructure itself. For Crusoe, the deal supplies a prominent anchor customer and a serious reference for its pitch as an AI-focused cloud rather than another seller of bare accelerators.
Alloy And sixty-five million a year shows how valuable inference operations have become. Training still gets the giant-cluster headlines, but a model used continuously creates an enormous recurring serving bill. Open-model labs face a choice: build an infrastructure organization beside the research lab, or let a specialist absorb that work. Crusoe is betting that a tuned managed service wins even when customers could theoretically host the weights elsewhere. I can see the appeal—owning weights doesn’t magically make scheduling, batching, failover, or hardware utilization easy.
Nova I’d resist reading one contract as broad consolidation, though. Developers may see the same model interface while the underlying provider changes, making latency, uptime, and price-performance the visible proof of the deal. Crusoe now has to show that a neocloud can deliver production inference at this scale, not simply reserve attractive compute. If it succeeds, other open-model companies gain a credible alternative to building their serving stack or defaulting to the largest hyperscalers. If it struggles, the contract becomes an expensive reminder that production inference is a product, not merely a pile of GPUs.
[PAUSE]
[20:11] Jev Returns Probabilities Instead of Text, Undercutting GPT-5 Nano on Price
Nova Jev accepts text but returns numbers: probabilities, confidence scores, and distributions across categories. TypeSafe AI calls it a System One model; “decision model” is clearer. An application supplies a state—perhaps a customer record, article, or semi-structured document—and attaches typed questions instead of asking for prose.
Alloy There are three response shapes. A yes-or-no question returns confidence between zero and one. A choice question distributes probability across named options. A score question rates the input along ordered numeric levels. So instead of prompting a general model to say whether a support ticket is urgent and then parsing its sentence, software gets a number that can feed routing directly.
Nova The price makes that specialization provocative. Jev charges four point two cents per million input tokens, with no output charge. That comes below GPT-5 Nano’s five-cent input rate, and numerical output avoids paying for explanatory paragraphs the application never wanted. It naturally suits systems making many small decisions across every document: triage, moderation, categorization, ranking, or choosing which downstream model should handle a request. At large volume, shaving a fraction of a cent per million tokens sounds tiny until every item generates several decisions.
Alloy And it pairs neatly with AnyJev. Jev is a commercial model designed to emit probabilities; AnyJev tries to coax calibrated decisions from open models without retraining them. They approach the same demand from opposite directions. Neither replaces a generative model when a person needs an explanation or reply, but both challenge the habit of using an expensive conversational model as a glorified classifier. When software needs one confidence value, returning three polished paragraphs isn’t intelligence. It’s overhead—and occasionally a parsing bug waiting to happen.
[PAUSE]
[22:07] A Self-Hosted Browser That Lets AI Agents Skip Captchas
Alloy Invisible Playwright MCP wraps browser automation in a self-hosted tool designed to avoid common bot defenses. It speaks Model Context Protocol, the standard agents use to call external tools, and drives an anti-detect Firefox profile through Playwright. Point seventy shipped with the repository above thirty-one thousand six hundred stars. That popularity tells you how often browser-based agents collide with systems built to reject automation.
Nova The attraction is obvious: an agent can maintain a browser session for dashboards, forms, authenticated pages, scraping, or computer-use loops without immediately hitting fingerprint checks and captcha screens. Self-hosting also keeps session credentials inside the operator’s environment instead of passing them through a captcha-solving service. But “undetected” is temporary language in an arms race. Sites can change their fingerprints, browser behavior can expose automation in new ways, and a tool that works against one defense may fail against the next. More importantly, bypassing a challenge doesn’t override a site’s terms, access rules, or the law. The project is useful infrastructure where automation is permitted; it isn’t permission disguised as a browser feature. Its real value is continuity—keeping an authorized workflow alive when ordinary automation reveals itself too easily. A self-hosted deployment also gives an organization control over browser storage, cookies, profiles, and the machines touching authenticated systems. That can matter for an internal agent reading an approved supplier portal or operating a company-owned dashboard. Still, the same stealth features attract obvious misuse, so the surrounding authorization and audit trail matter as much as the browser connection itself.
[PAUSE]
[23:38] OpenAI Releases MentalHealthBench to Test AI Responses in Mental-Health Conversations
Nova OpenAI has released MentalHealthBench, a standardized evaluation for AI responses in realistic mental-health conversations. It scores two dimensions together: whether a response is helpful and whether it is safe. Mental-health specialists helped shape the scenarios and scoring rubrics. That matters because a model can sound caring while still giving reckless guidance, or avoid obvious danger by becoming so evasive that it stops helping.
Alloy Right, warmth alone can conceal harm. Separate helpfulness and safety judgments make that tradeoff visible. A response might correctly recognize distress yet reinforce a dangerous belief. Another might avoid clinical certainty but abandon the person behind a generic refusal. Treating those outcomes as equivalent would produce a reassuring score and a bad product.
Nova Realistic conversations are also harder than isolated crisis keywords. Distress can emerge indirectly, change across several turns, or sit beside an ordinary practical question. Therapy-adjacent products, wellness apps, support systems, and general assistants all need to recognize when an exchange requires care, when professional help should be encouraged, and when the model has crossed from supportive language into inappropriate clinical authority. The multi-turn setting can expose failures that a single prompt never reaches.
Alloy A shared benchmark gives developers and outside researchers something firmer than hand-picked demos. I wouldn’t treat any benchmark as permission to deploy a model as a therapist; real people bring histories and risks that a fixed collection can’t fully represent. But expert-informed conversations can reveal whether a system stays useful without becoming reckless. MentalHealthBench also connects with OpenAI’s wider emphasis on human control. Here, that principle becomes measurable at one of the most sensitive points of contact: a person asking a machine for help when tone, certainty, and escalation can carry genuine consequences.
[PAUSE]
[25:12] GitHub Project Radar
Nova Three repositories are moving quickly. Nanobot has forty-eight thousand five hundred eighteen stars, up twelve hundred sixty-seven in thirty days. Its point three five release advances a lightweight, self-hosted personal-agent framework with a web interface, memory, tools, Model Context Protocol support, multi-agent workflows, and automation hooks. Codebase Memory MCP is the sharper growth story: forty-four thousand five hundred forty-two stars, up twelve percent in a month after point eleven. It builds a persistent code knowledge graph so coding agents can query structure instead of repeatedly rereading files, and the project claims support for one hundred fifty-eight languages plus major token savings.
Alloy Okay, those two connect naturally: Nanobot can orchestrate a personal agent, while Codebase Memory supplies specialized understanding of a repository. Invisible Playwright MCP is the browser counterpart, making its first tracked appearance at thirty-one thousand six hundred forty-four stars with point seventy released today. One project organizes the agent, another preserves code knowledge, and the third gives it a self-hosted browser surface. That modularity is exciting because teams can replace memory, browsing, or orchestration independently instead of accepting one giant framework. Codebase Memory’s twelve-percent monthly gain is especially striking at that size, while Nanobot’s recent release and continued repository activity show that its already-large audience is still receiving changes. Together, the three projects reflect attention moving toward durable context and dependable tool access, not merely another chat screen.
[PAUSE]
[26:14] Model Discovery Check
Nova Model progress today also landed through serving variants. GLM 5.3 Prime and Qwen 3.8 Max Prime each bring million-token context through OpenRouter, with their vendors positioning them as higher-throughput versions of established lines. The competition now includes how quickly enormous contexts can move through production, not only which model tops an evaluation.
[PAUSE]
[26:46] Local LLM Spotlight
Alloy Ternary Bonsai 2 27B packages a twenty-seven-billion-parameter text model in GGUF, a format used by llama.cpp for local inference. Its unusual feature is ternary, two-bit-oriented quantization, which compresses weights far more aggressively than full-precision storage. It supports CUDA and Apple Metal runtimes, uses hybrid attention, and has reached nineteen hundred fifty likes and more than two point eight million downloads on Hugging Face.
Nova That’s substantial interest in useful generation on hardware people control. Aggressive compression can trade memory savings against quality and device-specific speed, but it makes a twenty-seven-billion-parameter model plausible on machines that couldn’t hold ordinary weights. Local inference keeps sensitive prompts on the machine, removes per-token billing, and connects to a mature desktop runtime ecosystem. The download count shows people actively pursuing a workable balance among capability, memory, speed, and control.
[PAUSE]
[27:41] Extra Research Candidates
Nova Sam Altman’s United Nations Security Council remarks center on human control, AI safety governance, and international cooperation. Introducing MentalHealthBench turns part of that broad argument into expert-informed evaluation, measuring helpfulness and safety across realistic mental-health conversations.
Alloy Tyk connects both ideas to live infrastructure. Its open-source gateway routes REST, GraphQL, TCP, gRPC, and Model Context Protocol traffic through one policy layer, and it has more than ten thousand eight hundred stars. International cooperation sets expectations, MentalHealthBench measures sensitive behavior, and Tyk enforces routing and access rules where software runs.
[PAUSE]
[28:26] Closing
Nova For the primary sources, specifications, benchmark references, and projects behind everything we covered, look at the show notes at Toby On Fitness Tech dot com.
Alloy Thanks for listening to AgentStack Daily.
Nova We'll be back soon.