At a glance
- Relevance
- Practical value
- Warnings
- None
Because post-training data rarely includes disagreement, LLMs develop sycophancy, aiming to please. This makes them mirror your inferred identity, changing answers based on whether you seem like a Chargers fan.
LLM outputs are population samples, so they can be wiser than individuals but also blindly amplify the crowd’s prejudices and errors.
Summary
LLMs are not individual minds but statistical samples from internet text. They memorize because it's computationally cheaper than true generalization; diverse training data forces concept learning. This population framing also creates wisdom-of-crowd effects, outperforming any single expert when noisy opinions about each expert's domain combine.
Sycophancy arises because post-training data rarely includes disagreement. The model aims to please, mirroring inferred user beliefs and sometimes refusing to answer rather than contradict. Political bias experiments show models infer demographics from cues like football fandom, then adjust guardrails, causing uneven censorship and performance.
Tokenization adds weirdness: efficiency shortcuts like preferring American conventions (em dashes without spaces) reduce token counts. For engineering leaders, LLMs mirror their training data's collective voice. Every interaction is shaped by the user's implied identity, making deployment a governance challenge as much as a technical one.
Watch the video
This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.
Related breakdowns
AI is hollowing out junior engineers; preceptorship is the fix.
Scott Hanselman argues AI is destroying the junior developer pipeline by eliminating routine coding tasks that build foundational skills. His proposed fix: a…
Roblox's fix for the trust gap between AI code and production shipping
Roblox's engineering director reveals that the hardest part of shipping AI-generated code isn't the models — it's trust infrastructure, policy changes, and…
How a bank's top team got tired of AI coding agents
A seasoned team that practices TDD and mob programming tried AI for everything. The result: fatigue, reduced flow, and slower delivery. A grounded…
Get TL;DW
Too Long; Didn't Watch.
A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.
Free. Weekly. No hype.
Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.