Engineering brief
AI slop is measurable—and fixing it requires judgment, not just bigger models
At a glance
- Relevance
- Practical value
- Warnings
- None
Taste Labs analyzed 2M websites to quantify AI slop, finding that simple classifiers beat LLMs at detecting repetitive, context-free designs. Their brand API shows how structured context can force agents to stay on-brand.
AI slop is a real engineering cost; structured judgment layers may matter more than model improvements.
Summary
Taste Labs founder Thais Castello Branco argues that as AI generation costs drop, judgment becomes the scarce resource. The core problem is that AI outputs collapse to the mean, producing repetitive, context-agnostic slop. Their research on 2M websites shows that slop is measurable through structural features like color palettes, typography, and
layout—detectable by simple classifiers better than LLM-as-judge. They advocate a two-pronged approach: improve models via post-training data and RL, but equally important, fix inference-time behavior. Repetition can be broken by a creativity API that intentionally generates out-of-distribution results without random noise. Lack of fit is addressed by a brand API that
extracts structured guidelines from existing brands, allowing agents to maintain consistency. The biggest tradeoff is that taste is subjective—no one-size-fits-all solution. The brand API works for existing brands but struggles for novel contexts. And while measurement helps, it doesn't guarantee creativity. Teams must decide whether to invest in model-layer perfection
or accept inference-time guardrails as the faster path to quality. For engineering leaders, the signal is clear: the bottleneck is shifting from model capability to governance and verification of AI outputs. Building structured context layers—like brand definition, creativity constraints, and slop detectors—may be a higher-leverage investment than chasing ever-bigger models.
Watch the video
This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.
Related breakdowns
Why Warp’s agent platform succeeds on structure, not model power
Warp’s cloud agent platform succeeds by hiding infrastructure complexity and enforcing guardrails across harnesses. The real signal: agents are more about…
Beyond Agents: Why AI-Native Software Demands New Engineering Strategies
AI agents are today's web pages. The next phase is AI-native software—but teams must navigate orchestration, cost, and governance first.
Relative Scoring and In-Loop Eval Fix AI Video Quality
Character.ai replaced slow, vibe-based video scoring with a fast distilled model that does axis-specific relative comparisons, embedding evaluation in the loop.
Get TL;DW
Too Long; Didn't Watch.
A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.
Free. Weekly. No hype.
Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.