Engineering brief

Production AI Agents Break Daily, But Trust Remains High

AI Engineer3 min read · saves 19 min

At a glance

The brief is enough

Relevance
Practical value
Radar
Time horizon
This year
Warnings
  • Vendor pitch

A Temporal survey finds 41% of AI agent teams face daily failures, yet 85% trust their agents' output. The #1 blocker: tracking state across services.

Agent reliability and state management, not model quality, are now the bottleneck in production.

Watch if you are choosing a durable execution platform for agent workflows and want to see a live demo with crash recovery.

Summary

The survey. Temporal’s 2025 State of Development survey, drawn from 554 engineers and leaders actively building with AI agents, reveals a striking contradiction. 80.8% use agents daily, yet only 49.1% run them in production. The gap between usage and deployment is 30 points — and it’s filled with reliability problems. 41.1% of teams hit agent issues daily or more often; 16.4% see them every hour. Despite this, 85.5% trust agent output at least somewhat. Most teams trust a system that breaks every day.

The real bottleneck. When asked what limits productivity, tracking state across services was the top blocker (35.7%), followed by debugging (30.9%). Model capability didn’t make the top two. Cost is also a factor — 80% of respondents say cost limits how they use agents. The implication: production AI is no longer a model problem. It’s an infrastructure and state management problem. Teams are spending their time on recovery code and manual debugging, not on business logic.

The recovery gap. Only 13% of respondents are very confident they can observe and debug AI workflows at scale. 22% lose progress because of crashes. The gap between seeing a failure and recovering from it is a person reading traces at 2 a.m. and fixing state by hand. Observability alone doesn’t solve recovery — it just tells you what broke. Most teams lack the mechanics to resume work without losing the agent’s progress or re-spending LLM tokens.

The Temporal argument. The talk demonstrates a durable execution pattern that preserves workflow state across process crashes. A nine-step payment workflow — with an AI agent performing fraud investigation and a human approval step — recovers seamlessly after a worker is killed. Key effect: the agent’s tool calls run only once, avoiding retoken costs. The event history serves both as observability and as the source of truth for replay. The claim is that one platform can close all four identified gaps.

Production evidence. The demo is not theoretical. OpenAI Codex and Replit agents run on Temporal. The speaker notes that Replit’s engineering team found catastrophic errors in long-running agents to be a bad user experience, and durable execution addresses that. However, the evidence remains vendor-sourced — the survey was conducted by Temporal, and the speaker works there. Independent validation of the failure rates would strengthen the case.

My take

The survey data that 41% of agent teams face daily failures is the real signal. I'm not surprised state management is the top blocker, distributed systems have always had this problem. But I'd be careful taking Temporal's claim that one platform solves all seven blockers at face value. It's a well-demoed solution for state persistence and replay, but production agents also need security, audit trails, and integration with existing observability stacks. I'd treat durable execution as one tool in the toolbox, not the whole answer. Teams should invest in understanding their failure modes before picking a platform.

What to do with this

  1. Audit your current agent workflows for crash recovery gaps; measure LLM retoken cost after failures.
  2. Evaluate durable execution frameworks (Temporal, AWS SWF, Azure Durable Functions) for a bounded pilot.
  3. Survey your team on state management pain points using the categories from the Temporal report.

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.