Engineering brief

AI memory has converged on profiles—context silos remain the real gap

AI Engineer1 min read · saves 19 min

At a glance

Relevance
Practical value
Warnings
None

ChatGPT and Claude both settled on running user profiles, but they made opposite compute tradeoffs: 4k tokens vs 1k, updates every few days vs every 24 hours. The hard problem isn’t memory architecture—it’s that no assistant looks at your email to resolve conflicting facts.

Memory architecture choices directly impact product cost, user experience, and competitive differentiation for AI teams.

Summary

After three years of independent evolution, ChatGPT and Claude have converged on running user profiles as their core memory architecture, but their implementation tradeoffs reveal how constrained current AI memory really is.

ChatGPT uses dense 4,000-token profiles updated every few days, prioritizing richer context per conversation at higher serving cost. Claude uses concise 1,000-token profiles updated daily, making the opposite compute tradeoff. Both now allow profile visibility and editing, but staleness remains a flaw

The real bottleneck isn't architecture—it's context access. AI assistants still cannot reason across email, calendar, or photos to resolve conflicting memories. The speaker's travel plans were wrong because ChatGPT couldn't cross-reference flight bookings with conversational history.

Every consumer AI product builds its own memory system in-house, creating fragmented user profiles that don't share context. Until products solve cross-source reasoning, memory will remain a product design problem, not a technology one.

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.