Engineering brief
Agent trust is now an operating problem, not a model problem
At a glance
The brief is enough
- Relevance
- Practical value
- Radar
- Time horizon
- This year
- Warnings
- None
Michele Grant argues the agent working is the easy part. The real risk is whether leadership can define value, assign an accountable owner, and produce evidence before granting autonomy.
Agents will reach production, but trust, ownership, and autonomy controls decide whether they create or destroy business value.
Watch if you are deploying agents into workflows where a wrong number reaches a board, CFO, or steering committee.
Summary
The argument. Michele Grant, an enterprise transformation and M&A integration veteran, says the agent that works is the easy part. The hard part is earning the business trust to run it inside a core workflow. She frames trust as three questions: what value does it create, who is on the hook for it, and what evidence allows more autonomy. It is a governance model, not a technology pitch.
The scenario. She grounds it in a $15 billion acquisition targeting $400 million in synergies across 40 workstreams. An integration management office analyst team spends five business days compiling a weekly steering committee report. An agent drafts the report, reconciles the general ledger, and flags slips. A four-week pilot matches the manual reports line for line. That proves the tech works, but not that the committee should trust it.
The value case. Before production, leadership must write a value case with baselines. Three metrics matter: cycle time from five business days to two, analyst capacity, and detection time from first slip to committee visibility. Four analysts spend half their week on the deck, so the agent can return 80 hours, but that counts only when reassigned to lagging workstreams and netted against compute, licensing, and review costs. No baseline means no deploy.
The accountability. She applies the three lines model: management owns controls, risk and compliance challenges, internal audit assures. Each agent gets one senior analyst with operational boundaries, override authority, and a kill switch. A one-page human work standard maps every decision fork to a human role, required evidence, and escalation path. The agent prepares analysis; people own consequences.
The evidence. Autonomy comes from three artifacts: an auditable decision log, a model inventory record, and an autonomy scorecard. The important engineering claim: core math and reconciliation must run in deterministic, finance-approved code, with the LLM summary treated as explanation, not proof. Regression triggers force full revalidation after model or API changes.
The trade-off. The four autonomy stages track value and control side by side, ending in exceptions-only review. The vulnerability: a falling override rate can mean the agent improved or the human stopped looking. Independent sampling is the check. The evidence is expert opinion with a realistic example, not production data. Teams should borrow the questions and scorecard, then test them on one controlled workflow before scaling.
My take
I agree with the core claim: technical performance is the easy part, and enterprise trust is a governance problem. The three questions and the one-page human work standard are useful enough to test on a real workflow this quarter.
I would be careful with the autonomy scorecard as a fixed template. Most organizations do not have the pre-deployment baselines or deterministic reconciliation rules she assumes, and where those are missing, the governance overhead can eat the value. Start with one bounded report, one named owner, and a decision log. Promote to exceptions-only only after independent samples and override rates give you a reason to trust the controls, not because the model looks accurate.
What to do with this
- Pick one core workflow with a measurable baseline and write a one-page human work standard before any agent touches production data.
- Require deterministic, finance-approved code for any agent math that feeds a steering committee report.
- Define autonomy stages, a kill-switch run book, and regression triggers for every agent you fund this quarter.
Watch the video
This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.
Related breakdowns
Stop Panicking About Token Bills. Watch Cost Per Merged PR
Token costs are up 60x, yet cost per merged PR is down 26%. Jellyfish data says leaders are tracking the wrong number.
Containment is a vanity metric: agent escalations can be the real work.
Containment is a vanity metric for AI agents. Druid's benchmark shows the same number means different things by industry, and escalation can be revenue.
AI coding assistants are boosting volume — but quality is suffering
DX's platform data from 200,000+ engineers reveals a tradeoff: AI boosts raw throughput but PR size grows 64%, change confidence drops 6%, and change failure…
Get TL;DW
Too Long; Didn't Watch.
A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.
Free. Weekly. No hype.
Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.