Engineering brief

Context Is the New Code: Why Your Team Needs DevOps for Agent

InfoQ3 min read · saves 47 min

At a glance

The brief is enough

Relevance
Practical value
Radar
Time horizon
This year
Warnings
None

Patrick's talk argues context for AI agents needs its own DevOps lifecycle: generate, test, distribute, observe. The real signal: engineers are aligning on good practices because agents depend on it.

Context management is becoming the operational bottleneck for AI agent effectiveness and governance.

Watch if you're building a platform team for AI agent toolchain and want to see a prototype of context firewall and observability loops.

Summary

The proposal. Patrick argues that context—rules, docs, specs given to AI agents—should be managed like code, with its own DevOps lifecycle: generate, evaluate, distribute, observe. He draws a direct parallel to the code SDLC, calling this the "context development life cycle." The goal is systematic curation, not ad-hoc prompting.

Why now. The industry is standardizing around agent.md and skills formats, making context portable across tools. Vendors like Context7 and Ref provide curated context for libraries, and platforms like Unblocked mine Slack and docs for institutional knowledge. Patrick notes that Kuro, Spec, and Baroo treat task specifications as a new form of context. This infrastructure is nascent but forming fast.

The testing challenge. Evals are the equivalent of unit tests for context. Patrick describes linting (checking metadata syntax), AI-as-judge (Grammarly for context), and functional evals using Docker containers that run agents against test tasks. But results are non-deterministic, so teams must adopt risk-based decisions akin to error budgets. He advises capturing agent failures as new test cases to build a virtuous loop.

Distribution as packaging. Context should be versioned, packaged, and shared like libraries—not copy-pasted on Slack. Patrick envisions registries of skills with metadata, testing, and security scanning. He points to projects like G blame for provenance and a context bill-of-materials. The emerging challenge is determining ownership when context spans teams.

Observability loops. Observability for agents includes logs, self-reflection (like Hugging Face's retrospectives), and feedback from commits, Slack threads, and production incidents. Patrick demoed a prototype context firewall that intercepts file reads to detect unauthorized access, similar to a web application firewall. The goal is a feedback loop that improves context over time.

The organizational shift. Engineers now willingly write tests and documentation because it directly improves agent output—a rare alignment with good engineering practices. The speaker argues that context curation will become a differentiator for businesses, and platform teams should treat context as a first-class artifact. Ownership models, maturity levels, and chaos engineering for context remain open questions.

My take

I agree with the DevOps analogy for context, it's the right lens. But I'm skeptical about how fast teams can adopt the eval maturity described. Evals are expensive to build, non-deterministic, and require constant maintenance. Many teams will underestimate the effort and end up with false confidence. The real insight is the alignment effect: engineers now have a selfish reason to write good documentation and tests. That's a cultural win we should exploit, even if the full lifecycle pipeline remains aspirational for most organizations. Start by treating your most critical agent instructions as versioned artifacts with a simple CI check.

What to do with this

  1. Start an internal registry for agent context files (agent.md, skills) with versioning and clear ownership.
  2. Define 3–5 evals for your most critical agent tasks: both synthetic tests and repo-specific end-to-end scenarios.
  3. Assign a team to evaluate context security scanning for prompt injection and unauthorized data access.

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.