Agentic AI Foundation
HomeEventsResourcesNewsletters
Sign in
Copyright © The Linux Foundation®. All rights reserved. The Linux Foundation has registered trademarks and uses trademarks. For more information, including terms of use, privacy policy, and trademark usage, please see our Policies page.
← Conference Recap
MCP Dev Summit
Seoul 2026
MLOps Community
AI Agents SummitCoding Agents ConferenceAgents in Production 2025
On this page
ThemesKeynotes and framingAgent orchestration and scalingEvals and quality benchmarksContext engineering and memorySecurity and supply chainEnterprise adoption and tooling
Resources/Conference Recap/MLOps Community
Coding Agents Conference

Coding Agents Conference

12 talks, 6 themes, one fast way through the event — key takeaways, standout quotes, and every recording from Coding Agents Conference.

On this page
ThemesKeynotes and framingAgent orchestration and scalingEvals and quality benchmarksContext engineering and memorySecurity and supply chainEnterprise adoption and tooling

Themes

Keynotes and framing Opening keynotes framing where coding agents are headed and what's been learned so far. 3 talks ↓ Agent orchestration and scaling Architectures, decompositions, and model choices for running agent systems reliably at scale. 3 talks ↓ Evals and quality benchmarks Moving past vibes to rigorous evaluation and benchmarking of coding agents. 2 talks ↓ Context engineering and memory Techniques for managing sub-agent context and giving agents durable, self-learning memory. 2 talks ↓ Security and supply chain Practical approaches to securing AI-generated code and its supply chain. 1 talks ↓ Enterprise adoption and tooling How organizations navigate the growing landscape of coding agent gateways and tools. 1 talks ↓

Keynotes and framing

1
Harrison Chase & Sam Partee
LangChain · Arcade AI

Keynote: How to Make a Coding Agent a General Purpose Agent

Worth noting

Argues general-purpose agents need a coding-agent-style harness (Deep Agents: virtual file system, planning, sub-agents, compaction) plus a tool runtime doing delegated per-user OAuth so agents act as users, not with over-privileged service tokens.

Quote

Doing work for the user is good. Doing work as the user is much better in many cases.

2
Dexter Horthy
HumanLayer

Keynote: Everything We Got Wrong About Research-Plan-Implement

Worth noting

Dexter Horthy retires RPI for "CRISPI": splitting the 85-instruction mega-prompt into 7 smaller stages, since research shows LLMs reliably follow only ~150-200 instructions, and shifts review from long plans to lightweight design/outline docs plus reading actual code.

Quote

Frontier LLMs could only follow about 150 to 200 instructions with good consistency.

3
Scott Breitenother
Kilo (Co-founder & CEO)

Keynote: Lessons from 25 Trillion Tokens — Scaling AI-Assisted Development at Kilo

Worth noting

Kilo's 15 engineers each own one feature end-to-end, running 2–4 parallel agents, shipping 1–2 features weekly (up from one every 2–3 weeks) across 25 trillion tokens processed and 1.5M developers.

Quote

You've got to give trust to get trust... as you get deeper up that ladder, you need to open up the books and give more context.

Agent orchestration and scaling

1
Zach Lloyd
Warp

2026: The Year of Agent Orchestration

Worth noting

Warp's founder argues local laptops can't scale multi-agent coding, and demos Oz, a cloud platform for launching, tracking, and team-sharing coding-agent runs across any harness.

Quote

I think it sometime in 2025 coding switched over from being you writing code by hand to writing by prompt.

2
Niels Bantilan
Union.ai

Decomposing the Agent Orchestration System: Lessons Learned

Worth noting

A customer's deep-research agent (250k products, ~200 steps/100 LLM calls each) went from prototype to 2,000+ concurrent runs in an hour using replay logs, caching, and spot instances.

Quote

The problem isn't that agents fail, it's that recovering from failure is challenging without the full context of how infra, networking, logical, semantic layers all interact.

3
Ash Lewis
Fastino

Choosing the Right Model is Hard. Maintaining Accuracy is Harder.

Worth noting

Fastino's upcoming Pioneer platform continuously runs agents that monitor inference logs, fine-tune, and re-evaluate deployed open-source models (Llama, Qwen, DeepSeek) to counter model drift and cut cost/latency.

Quote

What that looks in reality is that you end up with the situation in which you've deployed Llama and it's actually getting more accurate over time.

Evals and quality benchmarks

1
Jessica Wang
Braintrust

Stop Shipping on Vibes — How to Build Real Evals for Coding Agents

Worth noting

In a head-to-head eval on SWE-bench and TypeScript-Go bug fixes, agentic search (Claude Code's grep/find approach) beat a basic vector search 68% vs 60%, while costing far fewer tokens.

Quote

Evals are important because without them you're essentially making ship decisions based off of vibes, which is not good.

2
Yanis He
Scale AI (SWE-Bench Pro)

Beyond SWE-Bench Pro: Where do Agents go from Here?

Worth noting

SWE-Bench Pro fought contamination with proprietary code and human-verified tasks; a new survey found issue resolution is only ~25% of engineering work, prompting a new, broader benchmark launching next.

Quote

We start seeing a trend of coding being the legs and hands for AI.

Context engineering and memory

1
Faye Zhang
Staff AI Engineer & Tech Lead, Pinterest

Productionizing Sub-Agents for LLM Post-Training

Worth noting

Pinterest cut LLM post-training from 4-6 weeks to ~1 week using Claude Code sub-agents; letting agents write their own code ("tool calling 2.0") cut token use by 50-70%.

Quote

We essentially giving the agent capability to write its own code to solve its question.

2
Erin Ahmed
Cleric

How to Fix Your Agent's Amnesia: Lessons from Building a Self-learning Agent

Worth noting

Cleric, an AI SRE deployed to dozens of customers, found learning agents need three things: easy correction, corrections that persist/compound/are visible, and continuous ambient context absorption.

Quote

Wrong answers are inevitable and accuracy is important but the agents that win will be the ones that make it easy to correct mistakes and not visibly repeat those mistakes later.

Security and supply chain

1
Milan Williams
Semgrep

Practical Security for AI-generated Code

Worth noting

Offers three concrete steps for securing AI coding agents: minimally scope credentials, log every action via hooks, and automatically scan agent-generated code with tools like Semgrep.

Quote

Downscope your credentials before you start. It takes two minutes and can save you from a really bad day.

Enterprise adoption and tooling

1
Ankit Mathur
Databricks

The Coding Agent Multiverse of Madness

Worth noting

Databricks built an internal "coding agent gateway" (Isaac) unifying billing, observability and MCP token management across Claude Code, Codex, Cursor etc. for 2,000+ engineers, shifting bottlenecks to code review and CI.

Quote

You should absolutely use the best tool for your use case, even if that's not the one-size-fits-all solution that you have already.

← Previous
AI Agents Summit
Next →
Agents in Production 2025