← Archive

Friday, September 25, 2026

30 stories.

01AgentsProductsingle source

Beatsprom releases Qwen-3.8-Coder-Stateless-MCP-Agent

Beatsprom has released the Qwen-3.8-Coder-Stateless-MCP-Agent, a production-grade autonomous tool-calling agent for Claude 5, GPT-6, and DeepSeek workflows, with a reported 26.4% increase in BFCL tool-calling accuracy and 28.6% increase in SQL injection defense. The agent is available for use with PEFT and can be run locally with Ollama. Commercial tooling and a full 25 MCP stack are also available for purchase on Gumroad.

02ResearchInternalssingle source

Benchmarks and Agent Research

CAIS and Scale released HLE-Diamond, a cleaned subset of Humanity's Last Exam, while OpenAI released MentalHealthBench, built with input from 80+ clinicians. Other releases include OpenRSI-Index v0.1, WorkspaceBench, and updates to various benchmarks and environments, such as Google's RRSI, Salesforce's RIVER, and NVIDIA's Skill2Env. Research findings include Microsoft's discovery that k agents sharing a directory can match 4k independent agents on ARC-AGI-3 and Stanford's demonstration of a self-organizing team hitting 66.7% on a task.

03AgentsInternalssingle source

Cameron R. Wolfe

Recent research has made significant progress in agentic reinforcement learning, enabling large language models to reason and act autonomously over long time horizons. New frameworks and techniques, such as ToRL, AgentGym-RL, Agent-R1, and AgentRL, have been proposed to train LLM agents with RL, improving their performance on various tasks and environments. These advancements have the potential to unlock more capable and generalizable AI systems.

04AgentsProductsingle source

DAPLab releases benchmarks for AI agents

DAPLab has released several benchmarks for evaluating AI agents, including LAKEQA, Live Kernel Crash Resolution, and BranchBench, with more in development, such as SRE-Bench and ConcurBugBench. These benchmarks test various aspects of AI agents, including their ability to discover and reason over structured datasets, diagnose and resolve real-world failures, and support agentic workloads. The benchmarks are designed to provide verifiable outcomes and contamination-resistant evaluation, and are updated regularly.

05ModelsInternalssingle source

DeepSeek AI releases DeepSeek-V4 series

DeepSeek AI introduces the DeepSeek-V4 series, a new generation of language models that achieve significant improvements in efficiency and performance, particularly in long-context scenarios. The series includes two models, DeepSeek-V4-Pro and DeepSeek-V4-Flash, which incorporate innovative architectural upgrades and optimization techniques. The models have been pre-trained on large datasets and demonstrate state-of-the-art performance on various benchmarks.

06AgentsProductsingle source

Guide to Five Agent Orchestration Patterns Released

A comprehensive guide to five agent orchestration patterns - orchestrator-worker, swarm, mesh, hierarchical, and pipeline - has been released, covering their architecture, trade-offs, and real-world implementations. The guide helps practitioners choose the right pattern for their multi-agent systems based on task structure, latency requirements, scale, and observability needs.

07ModelsProductsingle source

H Company releases Holotron-12B model for computer-use agents

H Company has released Holotron-12B, a multimodal computer-use model that achieves high throughput inference and strong agent performance, and is now available on Hugging Face. The model is post-trained from the NVIDIA Nemotron-Nano-2 VL model and demonstrates significant improvements over the base model on various benchmarks.

08ResearchProductsingle source

LLM benchmarks lose credibility due to contamination and saturation

The credibility of LLM benchmarks is compromised due to contamination and saturation, making it difficult to rely on leaderboard scores. A guide is provided to help readers critically evaluate benchmarks, considering factors such as governance type, contamination, and saturation. The goal is to move towards dynamic, contamination-resistant evaluation methods that prioritize real-world performance over raw scores.

09ModelsInternalssingle source

Open Models, System-1 Decision Models, and Inference Infra

BFL released an open-weights 7B world-action model, FLUX 3 Action, which takes the top spot on RoboLab, beating the previous best open model by 6.1 points with 56% fewer parameters. Other notable releases include CLM-8B, tev1-4B, and Cua-S1-4B-0.2 models, as well as Apple's LensVLM and inclusionAI's Ming-Image-0.1-Design. Additionally, Inferact open-sourced a TPU megakernel for Kimi K3, and several infrastructure updates were announced, including Prime Sandboxes, ClusterMAX 3.0, and a 25T-token pipeline.

10AgentsProductsingle source

OpenAI Opens the Codex Harness — No Extra Fee, US-Only Residency

OpenAI has released the Agents API in public beta, allowing developers to rent the harness behind Codex and ChatGPT for Work, with a managed orchestration layer priced toward zero, and including features like automatic compaction and parallel subagents. The API has some limitations, including US-only data residency and token-and-tool-metered pricing.

11AgentsInternals5 sources agree

Asymptote Labs open-sources Beacon

Asymptote Labs has open-sourced Beacon, a self-improving memory layer that uses Jev to evaluate and classify agent runs at scale, allowing for the creation of a shared knowledge layer across multiple agent harnesses. Beacon preserves full session history and helps identify valuable lessons to promote, review, or discard.

12AgentsInternals4 sources agree

Research: Harness Distillation, Agent Failure Modes, RL Environments, and Autonomous Science

Researchers introduce Harness-Zero, a method that distills an optimized agent harness into the model, resulting in higher macro task success rates. Additionally, several other advancements are reported, including the release of SmolDataEnvs, a dataset of verifiable data-science RL environments, and the development of an AI-run lab and the SciUniverse benchmark by C5R.

13CodingProduct2 sources agree

DHH Reverses: 'Put Your Pencils Down'

DHH, a prominent skeptic of AI-written code, has publicly changed his stance, citing significant productivity gains from using AI-generated code, and now advises developers to stop writing code by hand, while others discuss the implications of this shift on workflow and collaboration with AI models. The numbers behind DHH's reversal are striking, with a 5x increase in production code output in a single month, and a 99% reduction in CPU usage and 95% reduction in memory usage after rewriting HEY's mail server in Rust.

14ResearchProduct2 sources agree

Google releases Empirical Research Assistance

John Platt discusses Google's Empirical Research Assistance (ERA), a tool that uses AI to solve scientific problems, and its applications in tackling climate change, including reducing the effects of condensation trails from airplanes. ERA is an open-source implementation that can be used with any large language model.

16AI securityProductsingle source

Codex CLI adds Touch ID verification for MCP requests

Codex CLI 0.155.0 introduces experimental voice chats and Touch ID verification for MCP requests, while also hardening Windows/WSL sandboxes and protecting shell snapshots. The update adds a biometric gate for MCP tool calls, giving agents more surface and moving approval closer to the OS.

17ModelsInternalssingle source

Contrastive-LM releases CLM, alternative to TypeSafe AI's Jev

Contrastive-LM introduces CLM, an open-weights, self-hostable alternative to TypeSafe AI's Jev, offering the same functional primitives with improved latency and fine-tunability, but trailing in zero-shot broad knowledge and context budget. CLM achieves state-of-the-art verifier performance on certain benchmarks when fine-tuned on agent trajectories.

18On-deviceInternalssingle source

Inference Speedups and Compute Hardware

Liquid AI DSpark achieves up to 3.13× decode speedup with MLX on M5 Max, while other projects like GLM-5.3 and Pruna few-step LoRAs also show significant efficiency gains, and Google launches Project Suncatcher with TPUs in orbit.

19ResearchProductsingle source

OpenAI accused of gaming SWE-bench and Chatbot Arena

Researcher claims OpenAI modified SWE-bench to favor their models, and a paper by Singh et al reveals big LLM vendors are gaming Chatbot Arena by submitting multiple variants and fine-tuning models. This compromises the validity of these leaderboards, which are considered more meaningful than others due to their complexity and real-world relevance. The issue highlights the difficulty in maintaining fair evaluations in the AI research field.

20CodingProductsingle source

Opus 5.5 Sparks Harness Wars as Builders Report Limits That 'Last Longer'

Opus 5.5 is receiving praise from practitioners for its ability to handle long-horizon orchestration without breaking a sweat, with many reporting that usage limits now feel effectively unlimited. Builders are testing cross-CLI patterns and reporting efficiency gains, with some noting that the model is surprisingly good and feels much smarter. However, a migration debate is emerging, with some developers switching back to Claude Code after time on the ChatGPT/Codex app.

21ResearchProductsingle source

Radical Numerics co-founder Eric Nguyen discusses biosecurity

Radical Numerics is developing Genomic Language Models (GLMs) to tackle biological problems, with applications in biosecurity and beyond. The company's co-founder, Eric Nguyen, discusses the potential of GLMs to unlock biological intelligence and the need for defense to keep pace with advancements in the field. The company's models have already shown promising results in generating DNA and protein sequences, and are being developed to think in the language of DNA, with potential applications in fields such as epigenetics and natural language processing.

22AgentsProductsingle source

Skills Become the Packaging Format of the Agentic Era: 372 Skills, Then Azure's 193

Anthropic's Claude Skills library offers 372 AI skills across 20 domains, while Azure Agent Skills provides 193 skills across 19 categories, and AgentSmith introduces a model-agnostic operating harness for verification, with builders positioning skills as complementary to MCP, raising questions about standardization and vendor lock-in. Meanwhile, Notion and other companies are exploring skills tooling and agent-to-agent comms protocols.

23AgentsProductsingle source

Smolagents releases minimalist code-first agent framework

Smolagents is a lightweight, code-first agent framework that enables developers to build powerful agents with minimal abstractions, comparing favorably to alternatives like LangChain and Microsoft Agent Framework. It supports model-agnostic design, modality-agnostic inputs, and sandboxed environments for security. The framework is ideal for single-agent, short-horizon reasoning, tool-heavy workflows, and prototyping, but lacks persistent memory, a limitation addressed by integrating Mem0.

25BusinessBig picture3 sources agree

Antrhopic and Endura pioneer AI-driven science navigation

Adrian Sanborn, CEO of Endura Therapeutics, discusses how AI is transforming front-line scientific research, enabling faster and more agile experiments, and improving access to expertise, with examples from his company's work in biotech and CRISPR research. He highlights the role of 'navigators' who use AI to drive better decisions and faster processes, and the potential for AI to accelerate scientific progress by making expertise more accessible and scalable.

26On-deviceProduct2 sources agree

Backlot Emulates Enterprise SaaS Locally, While Builders Patch Tool-Chain Seams

Backlot, a local emulator for enterprise SaaS APIs, and open-supermarkets, an open-source grocery interface, simplify testing and integration for agent builders, while prompt patches and doc-native versions address agent halting issues.

27AgentsInternalssingle source

AG2 ships MCP 2.0 support and TypeSafe provider

AG2 v1.1.0 adds a TypeSafe provider for decision-only agents and updates MCP surfaces to MCP 2.0, while other developments include a citation bug fix in Gemini 3.8, the introduction of Talkie, a 13B LLM for generalization research, and RedSOC, an adversarial eval framework showing high success rates in indirect prompt injection and corpus poisoning.

28BusinessBig picturesingle source

California Makes AI Data Centers Pay Their Own Power Bill

Governor Gavin Newsom signed a package of bills requiring large AI data centers to cover their own electricity infrastructure costs, introducing new permitting processes and water-use disclosure requirements. This change creates a separate utility rate class for data centers and gives communities greater control over project approvals, affecting the build-versus-buy calculus for agent deployments.

29ResearchProductsingle source

Cohere Labs criticizes Chatbot Arena leaderboard

A new paper from Cohere Labs and other institutions criticizes the Chatbot Arena leaderboard for allowing model providers to anonymously preview and cherry-pick their models, leading to biased scores. The paper also highlights unfair sampling rates and removal rates. The authors propose more transparency in the testing process. Meanwhile, OpenRouterAI LLM rankings are suggested as an alternative evaluation method.

30ResearchInternalssingle source

Researchers Find LLM Rankings Sensitive to Small Data Changes

A new study reveals that popular LLM evaluation platforms, such as Chatbot Arena, are vulnerable to changes in top model rankings when a small fraction of preference data is removed, highlighting the need for more robust evaluation methods. The researchers propose a fast and efficient method to assess the robustness of LLM rankings to worst-case data-dropping, which can help identify influential preferences and improve the reliability of leaderboard rankings.

From Around the Web

01On-deviceInternalssingle source

Virtio-nvgpu: Near-native Nvidia GPU access inside a KVM guest

virtio-nvgpu allows a Linux guest to access an NVIDIA GPU at near-native performance, with the guest rendering within 2% of the host machine and costing the same CPU, enabling headless streaming and other use cases. The project achieves this by forwarding NVIDIA kernel driver ioctls between the guest and host at the driver ABI level, bypassing API-level translation. The solution has been measured and benchmarked, with results showing significant performance improvements over existing approaches like Venus.

02ModelsProduct3 sources agree

Best LLM for every budget, updated daily

The Artificial Analysis Intelligence Index visualizes AI models' performance against their blended API price, allowing users to find the best model for their budget. The index is updated daily via a GitHub Actions cron and provides detailed information on each model's score, price, and performance metrics.

03SafetyInternalssingle source

Dynamic Abliteration: Non-Destructive Refusal Suppression via Engram Steering

Researchers demonstrate Dynamic Abliteration using Multi-Layer Engram Steering with Qwen3-4B model, providing a modular alternative to traditional weight abliteration and fine-tuning for refusal behavior control. The approach utilizes PyTorch forward hooks and achieves non-refusal output without modifying base model weights.

04PolicyBig picturesingle source

U.S. appeals court upholds designation of Anthropic as supply chain risk

A federal appeals court panel upheld the Pentagon's blacklisting of Anthropic, citing national-security risks associated with the company's Claude AI models. The decision rejected Anthropic's argument that the ban was arbitrary and unauthorized. Meanwhile, a separate court ruled that one of the designations used to justify the blacklisting was illegal.

05PolicyBig picture7 sources agree

Classified Estimates Show the NSA Is Paying Billions to Test AI Models

The National Security Agency is spending billions of dollars to evaluate and test advanced artificial intelligence models, leading lawmakers to consider a more comprehensive AI regulatory system. The high cost of these efforts may prompt calls for tech companies to shoulder the financial burden of reviewing AI models. Experts suggest that the government could levy a tax on AI companies to fund safety operations or require them to pay for independent audits.

06SafetyBig picturesingle source

Google engineer quits over AI concerns

A Google engineer has resigned due to concerns about the rapid development of AI and its potential risks to humanity, citing the need to slow down AI progress and prioritize human well-being. The engineer plans to continue working on projects that use AI in a way that benefits humans, such as debugging tools and hobby projects.

07ModelsProduct2 sources agree

Mercury 2.5 LLM hits 770 tokens per second

Mercury 2.5 is a reasoning model that scores 12 on the Artificial Analysis Intelligence Index, with a context window of 260k tokens and output speed of 770 tokens per second. It is available via API through one provider, with pricing starting at $0.25 per 1M input tokens and $0.75 per 1M output tokens. The model is proprietary, with undisclosed model size and parameter count.

08CodingProduct2 sources agree

The Year of Internal Tools

Geocodio has developed several internal tools, including Atlas for customer support and Yak, a coding agent, using AI and shared infrastructure, to improve efficiency and reduce manual processes. The company has established principles for building and maintaining these tools, including planning, research, and testing, and has open-sourced some of them. Geocodio is deliberate about which tools to build and maintain, considering factors such as domain experience, business impact, and integration with their own data and workflow.

09BusinessProductsingle source

Microsoft tried to ban "Microslop", and six months later it has given up

Microsoft has stopped blocking the nickname 'Microslop' in its official Copilot Discord server, and has also reduced the visibility of Copilot in Windows 11, removing unnecessary entry points and auto-installation of the Microsoft 365 Copilot app. The company is shifting its focus towards more intentional integration of AI across Windows, with a focus on local background capabilities. Despite this, criticism and backlash against Microsoft's AI push continue, with some users demanding the old Copilot back after a recent architecture change broke chat continuity and memory.

10On-deviceProductsingle source

The newest ESP32 can run Linux and it's getting close to a Raspberry Pi

Espressif's new ESP32-S31 microcontroller features a gigabit Ethernet MAC, USB 2.0 High-Speed host controller, and SD card interface, making it more like a single-board computer than a traditional microcontroller. The S31 also supports Linux, with a published BSP and community ports, but is limited by its memory and lack of GPU or NPU. The device's peripherals, bandwidth, and CPU privilege model are similar to those of a modern SBC, closing the gap between microcontrollers and SBCs.

11CodingProductsingle source

We just shipped support for the ugliest part of HTTP: Vary

Cloudflare has introduced support for the Vary HTTP response header in its Cache Rules feature, allowing customers to control how cached responses are served based on request headers. The feature helps solve the problem of one URL having multiple correct responses, but introduces a new challenge of determining which request differences actually matter. Cloudflare's implementation allows customers to normalize, passthrough, or bypass cache for specific headers, giving them more control over their caching strategy. The feature is available on all plans, including Free, Pro, Business, and Enterprise, through the Cloudflare dashboard, Rulesets API, and Terraform.