Engineering brief
Production AI Agents Break Daily, But Trust Remains High
At a glance
The brief is enough
- Relevance
- Practical value
- Radar
- Time horizon
- This year
- Warnings
- Vendor pitch
A Temporal survey finds 41% of AI agent teams face daily failures, yet 85% trust their agents' output. The #1 blocker: tracking state across services.
Agent reliability and state management, not model quality, are now the bottleneck in production.
Watch if you are choosing a durable execution platform for agent workflows and want to see a live demo with crash recovery.
Summary
The survey. Temporal’s 2025 State of Development survey, drawn from 554 engineers and leaders actively building with AI agents, reveals a striking contradiction. 80.8% use agents daily, yet only 49.1% run them in production. The gap between usage and deployment is 30 points — and it’s filled with reliability problems. 41.1% of teams hit agent issues daily or more often; 16.4% see them every hour. Despite this, 85.5% trust agent output at least somewhat. Most teams trust a system that breaks every day.
The real bottleneck. When asked what limits productivity, tracking state across services was the top blocker (35.7%), followed by debugging (30.9%). Model capability didn’t make the top two. Cost is also a factor — 80% of respondents say cost limits how they use agents. The implication: production AI is no longer a model problem. It’s an infrastructure and state management problem. Teams are spending their time on recovery code and manual debugging, not on business logic.
The recovery gap. Only 13% of respondents are very confident they can observe and debug AI workflows at scale. 22% lose progress because of crashes. The gap between seeing a failure and recovering from it is a person reading traces at 2 a.m. and fixing state by hand. Observability alone doesn’t solve recovery — it just tells you what broke. Most teams lack the mechanics to resume work without losing the agent’s progress or re-spending LLM tokens.
The Temporal argument. The talk demonstrates a durable execution pattern that preserves workflow state across process crashes. A nine-step payment workflow — with an AI agent performing fraud investigation and a human approval step — recovers seamlessly after a worker is killed. Key effect: the agent’s tool calls run only once, avoiding retoken costs. The event history serves both as observability and as the source of truth for replay. The claim is that one platform can close all four identified gaps.
Production evidence. The demo is not theoretical. OpenAI Codex and Replit agents run on Temporal. The speaker notes that Replit’s engineering team found catastrophic errors in long-running agents to be a bad user experience, and durable execution addresses that. However, the evidence remains vendor-sourced — the survey was conducted by Temporal, and the speaker works there. Independent validation of the failure rates would strengthen the case.
My take
The survey data that 41% of agent teams face daily failures is the real signal. I'm not surprised state management is the top blocker, distributed systems have always had this problem. But I'd be careful taking Temporal's claim that one platform solves all seven blockers at face value. It's a well-demoed solution for state persistence and replay, but production agents also need security, audit trails, and integration with existing observability stacks. I'd treat durable execution as one tool in the toolbox, not the whole answer. Teams should invest in understanding their failure modes before picking a platform.
What to do with this
- Audit your current agent workflows for crash recovery gaps; measure LLM retoken cost after failures.
- Evaluate durable execution frameworks (Temporal, AWS SWF, Azure Durable Functions) for a bounded pilot.
- Survey your team on state management pain points using the categories from the Temporal report.
Watch the video
This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.
Related breakdowns
Voice agent evals: from 33% agreement to 92% in regulated fintech
Upstart's voice agent evals went from 33% to 92% compliance agreement. The blueprint for deploying AI safely in regulated environments.
The hidden collapse of human code review under AI volume
AI code generation is overwhelming human review. Cognitive surrender and error compounding demand a new governance approach.
How a Hedge Fund Measures AI ROI Without Waiting for P&L
A hedge fund's Head of AI shares how they AB test AI workflows and measure cost per useful insight—a practical model for proving AI ROI when P&L impact is…
Get TL;DW
Too Long; Didn't Watch.
A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.
Free. Weekly. No hype.
Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.