Topic
AI Infrastructure - Page 8
Model platforms, cost, latency, and operational trade-offs. Curated tldw.news briefings about ai infrastructure, with practical engineering takeaways from long-form AI and developer-tool videos.
137
breakdowns
Page 8 of 14
Theo - t3․ggWhen AI Runs $200K of Inference and Fixes Your BIOS
GPT-5.6 ran multi-hour coding, rewrote a compiler, and registered for databases autonomously—but $200K/month and unverified code signal a governance gap.
No Priors: AI, Machine Learning, Tech, & StartupsMoats Are Dead: AI Cuts Costs But Won’t Protect You
Booking’s AI is cutting costs, but its CEO warns there’s no moat. The real challenge? Proving ROI before scaling—and retraining teams before they’re displaced.
Cole MedinThe Personal Agent Trap: Why Markdown Wikis Don’t Scale
Personal AI agents don't scale. Production forces a shift from markdown wikis to database-backed context retrieval and memory. What that means for your team.
Latent SpaceAgent Experience Is the New DevEx—and a Scaling Challenge
Modal’s pivot to agent experience reveals a hidden cost: scaling sandboxes for agentic RL creates capacity planning problems that resemble airline fuel hedging.
OpenAIVoice AI’s Full-Duplex Shift: Smarter, but Still Scripted
OpenAI's GPT Live 1 introduces full-duplex voice and reasoning delegation, erasing turn boundaries but leaving cost and readiness questions open.
IBM TechnologyModel Guardrails Won’t Stop AI-Powered Attacks
New AI models emphasize safety guardrails, but open-source competitors and adversarial use render them insufficient. The real defense is system architecture.
AI EngineerThe Agents Aren't Bad, Their Search Queries Are Broken
Why do capable LLMs fumble complex search tasks? It’s not reasoning, but retrieval. A new agent harness teaches natural queries, closing the gap.
Theo - t3․ggOpen-weight models won’t run on your laptop—and that’s fine
Local AI enthusiasts dream of frontier models, but GLM 5.2 needs 400GB+ VRAM. The real value of open-weight is competitive cloud inference.
David OndrejLoRA Turns Trillion-Parameter Fine-Tuning Into an Opex Decision
A $131 LoRA fine-tune of Kimi K2.7 makes frontier-model customization an opex line item, but proof of gains over generic APIs is missing.
GOTO ConferencesEcosystems Over Architectures
Three people ran a petabyte-scale sensor network; the bottleneck wasn’t AI but SD cards, legal agreements, and community trust—lessons for long-lived platforms.
Get TL;DW
Too Long; Didn't Watch.
A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.
Free. Weekly. No hype.