Engineering brief

Ontologies: The Missing Guardrail for Agentic AI

AI Engineer2 min read · saves 19 min

At a glance

Relevance
Practical value
Warnings
None

Agentic loops make LLMs Turing-complete but cause drift and infinite token spend. Frank Coyle proposes using formal ontologies with inference rules to validate outputs before side effects occur, providing a governance layer many teams overlook.

Agent reliability problem shifts from prompt engineering to architecture, impacting cost, safety, and governance.

Summary

Frank Coyle argues that agentic workflows, while unlocking Turing-complete capabilities via loops, introduce serious operational risks: drift, infinite loops, and soaring token costs. The root cause is that LLMs are probabilistic and lack innate constraints. His solution is to pair them with formal ontologies—graph-based domain models—that act as a validation layer.

Using RDFS and OWL inference rules, ontologies can catch logical errors (e.g., double refunds, impossible statuses) that raw text generation would miss. Combined with Pydantic type checking, this creates a two-tier guardrail: structural validation at the interface, semantic validation against domain rules.

The tradeoff is upfront investment in ontology design and governance, which clashes with the fast iteration culture of many AI teams. Coyle acknowledges the burden but points to existing taxonomies like schema.org to shortcut the effort. Without this layer, teams will spend more on debugging, human-in-the-loop escalations, and unpredictable runaway costs.

This neuro-symbolic approach revisits lessons from the expert systems era but adapts them for modern agentic pipelines. It frames reliability not as a model quality problem, but as an architectural deficiency that engineering leaders must address before scaling agents into production.

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.