--- title: "When token costs go off-script" newsletter: "User Community" date: 2026-08-27 source: https://aaif.live/newsletters/usercommunity/2026-08-27-when-token-costs-go-off-script --- # When token costs go off-script *Plus… leaner agents, stateless MCP, and safer tooling* *User Community — Agentic AI Foundation, 2026-08-27* Fresh new look, same great taste! We’ve refreshed the design but kept the useful content you’re used to. ## Hidden gems ## 36 hours live from Amsterdam ## AGNTCON + MCPCON EUROPE Get the coffee and stroopwafels ready - we’re going live from AGNTCon + MCPCon Europe for 36 hours straight, bringing you the talks, speaker interviews, expo floor conversations, demos, after-hours chats and plenty that won’t appear on the official agenda. We’ll be moving around the conference, catching speakers and builders between sessions, following the conversations happening across RAI Amsterdam and bringing questions from the livestream chat into the event. Drop in for a keynote, stick around for the aftershow, or see how long you can stay with us through the night shift. Watch from home: Tune in across September 17–18 for the full 36-hour broadcast. Register free [https://luma.com/aaif-afd7] Want to be there in person? Join us in Amsterdam and come say hi. Early Bird tickets are available until September 4. Get your ticket here [https://events.linuxfoundation.org/agntcon-mcpcon-europe/register/] ## How predictive analytics stops budget overruns before they happen A model change can push token usage up 8x, while retry-heavy agent loops can burn through budget before conventional billing alerts catch the problem. The discussion looks at how FinOps can move closer to the engineering workflow as AI usage scales. * Predictive budgets can flag teams or service accounts heading far beyond quota early in the month, giving engineers time to adjust rather than simply hitting a hard stop. * FinOps checks can be built into system prompts, pull requests, and deployment workflows, surfacing policy, model, and infrastructure costs as code changes. * Some workflows may be better served by rules, retrieval, or conventional ML, with LLMs reserved for the steps that genuinely need generation. The core idea is to make cost an engineering signal that appears early enough to shape architecture, model choice, and day-to-day decisions. [https://podcasts.apple.com/us/podcast/how-predictive-analytics-stops-budget-overruns-before/id1505372978?i=1000784610595](https://podcasts.apple.com/us/podcast/how-predictive-analytics-stops-budget-overruns-before/id1505372978?i=1000784610595) [https://home.mlops.community/home/videos/how-predictive-analytics-stops-budget-overruns-before-they-happen](https://home.mlops.community/home/videos/how-predictive-analytics-stops-budget-overruns-before-they-happen) [https://open.spotify.com/episode/3A20FeJFBHIsLGESe3imYX?si=R1r7I17LQcSfjW4qOHFoOw](https://open.spotify.com/episode/3A20FeJFBHIsLGESe3imYX?si=R1r7I17LQcSfjW4qOHFoOw) ## The Winchester Mystery House Problem in AI development A workflow that cost $1 per 1,000 records at 90% accuracy reached 95% accuracy while costing less, after an optimizer moved 75% of the work out of the model and into code. That result sits inside a broader discussion about when agentic behavior should become a defined workflow. * Models increasingly inherit assumptions from the coding harnesses they were trained around, which can make custom harnesses harder to build. * Repeated agent tasks can often be “crystallized” into smaller models or conventional code once the process is understood. * DSPy separates task definitions from implementation, allowing prompts, models, and even harness code to be optimized without redefining the task. The practical direction is toward identifying which tasks still need open-ended agents and which are mature enough to become cheaper, more reliable workflows. [https://podcasts.apple.com/us/podcast/the-winchester-mystery-house-problem-in-ai-development/id1505372978?i=1000785551986](https://podcasts.apple.com/us/podcast/the-winchester-mystery-house-problem-in-ai-development/id1505372978?i=1000785551986) [https://home.mlops.community/home/videos/the-winchester-mystery-house-problem-in-ai-development](https://home.mlops.community/home/videos/the-winchester-mystery-house-problem-in-ai-development) [https://open.spotify.com/episode/4IjjWOjSq8XQPAXLq6ApRQ?si=TnlufikXRKqxS8ZHSpyYCQ](https://open.spotify.com/episode/4IjjWOjSq8XQPAXLq6ApRQ?si=TnlufikXRKqxS8ZHSpyYCQ) ## MCP 2026–07–28: Stateless core, enterprise authorization, and SDK betas Sticky sessions and shared session stores are no longer required under MCP’s 2026-07-28 specification, removing a major obstacle to scaling remote servers across multiple instances. The same release cycle also brings centralized enterprise authorization and a more predictable protocol lifecycle. * The stateless core makes every request self-describing, enabling standard round-robin load balancing and multi-round-trip interactions without persistent sessions. * Enterprise-managed authorization uses ID-JAG and token exchange to connect existing SSO, roles, and audit controls to MCP servers. * Formal deprecation windows, conformance testing, and beta SDKs give teams a clearer path for testing and migrating between protocol versions. The changes move MCP closer to infrastructure that teams can scale, govern, and upgrade using established production patterns. [Read the blog](https://mlops.community/blog/mcp-2026-07-28-stateless-core-enterprise-authorization-and-sdk-betas) ## Building a read-only multi-cloud Kubernetes inventory with goose A read-only inventory agent can still have more authority than the task requires if its shell or cloud credentials are too broad. This design walkthrough uses goose to show how OKE and AKS inventory could be constrained without giving the model write-capable access, while clearly separating planned behavior from validated results. * The prototype combines read-only cloud identities, supervised shell access, and two exact inventory commands, while acknowledging that recipe instructions are not a technical allowlist. * Structured output preserves partial failures, unknown values, warnings, and provenance, with independent logs needed to verify what actually ran. * A stronger production boundary would replace the general shell with narrow MCP tools that expose only the required read operations. The main design lesson is to keep authorization outside the model and treat prompts, approvals, and containers as supporting controls rather than security boundaries. [Read the blog](https://aaif.io/blog/building-a-read-only-multi-cloud-kubernetes-inventory-with-goose) ## Where A2A fits in the open agent ecosystem A restaurant manager agent can use one protocol to delegate an urgent order, another to read inventory, and others to structure checkout and verify payment authorization. The piece uses that flow to show where A2A fits alongside MCP, UCP, AP2, and existing web standards. * A2A gives independent agents a shared contract for discovery, delegation, stateful tasks, progress updates, and artifacts without exposing their internal implementation. * MCP covers tool and context access, while A2A handles collaboration between autonomous endpoints with their own execution logic. * Extensions let domain protocols such as UCP and AP2 add commerce-specific data and authorization without expanding A2A’s core. The architecture depends on clear protocol boundaries, so each layer can specialize while remaining composable with the others. [Read the blog](https://aaif.io/blog/where-a2a-fits-in-the-open-agent-ecosystem) ## IN-PERSON EVENTS ## Come and connect * Silicon Valley [https://luma.com/ey4era2u] - August 27 * Denver [https://luma.com/9faba5i4] - August 27 * Melbourne [https://luma.com/et8icca1] - September 2 * Shanghai [https://luma.com/m4ygi0b2] - September 5 * AGNTCon + MCPCon China [https://www.lfopensource.cn/mcp-dev-summit-shanghai/] - September 6 * Toronto [https://luma.com/p6vg7zag] - September 10 * AGNTCon + MCPCon Japan [https://events.linuxfoundation.org/agntcon-mcpcon-japan/] - September 10 * Pune, India [https://luma.com/4h0mjfzr] - September 12 * New York [https://luma.com/aaif-kc6u] - September 15 * San Francisco, Voice Agents Forum [https://luma.com/voiceagentssf] - September 16 * AGNTCon + MCPCon Europe [https://events.linuxfoundation.org/agntcon-mcpcon-europe/] - September 17 Find your city here [https://aaif.io/events?tab=community], or start a chapter if there isn't one yet. ## VIRTUAL EVENTS ## Join from anywhere * Reading Group: Prompt Injection as Role Confusion [https://home.mlops.community/home/events/prompt-injection-as-role-confusion-rethinking-agent-security-kzdnmrqqqz?agenda_day=6a7a2823abc455f7962051e5&agenda_track=6a7a2823abc455f7962051fc&agenda_stage=6a7a2823abc455f7962051eb&agenda_filter_view=stage&agenda_view=list] - August 27 * 36 Hours Live from AGNTCon + MCPCon Europe [https://luma.com/aaif-afd7] - September 17 - 18 --- Source: https://aaif.live/newsletters/usercommunity/2026-08-27-when-token-costs-go-off-script