Engineering brief

Dexterous manipulation is the bottleneck for general-purpose robots

Google for Developers2 min read · saves 37 min

At a glance

Relevance
Practical value
Warnings
None

Google DeepMind's Gemini Robotics 2 reveals that the hardest problem isn't walking—it's tying a bag or unscrewing a bulb. The team admits physical data is tiny compared to internet-scale training, and that frontier models break when adding action tokens.

Dexterous manipulation is the unsolved bottleneck for physically capable robots in the real world.

Summary

Google DeepMind's Gemini Robotics 2 introduces an embodied reasoning model that tackles the hardest remaining problem: dexterous manipulation. While locomotion and basic navigation are nearly solved, tasks like tying a trash bag or unscrewing a sphere-shaped bulb require coordinating over twenty joints with precise force and contact management. The team admits data is the bottleneck—teleoperation

data is costly and scarce, and human video lacks the action labels needed for robot training. Crucially, the team reveals that adding physical action tokens to Gemini's pre-trained model degrades its language and vision capabilities because physical datasets are orders of magnitude smaller than internet-scale digital data. This explains why frontier models don't directly control

robots yet. The model does show cross-embodiment transfer, meaning training on one robot type (gripper) can benefit another (dexterous hand), but the fundamental unsolved problem is acquiring millions of high-quality physical interaction trajectories. The team's deployment strategy is pragmatic: industrial environments first, where safety is controlled and tasks are semi-structured, then retail, and finally homes—likely

five to ten years out. They warn that 90% success with 10% failure (breaking a wine glass) may not be acceptable for consumers. The embodied reasoning model is available via AI Studio and an API, while the action models remain with deep partners for now. The key takeaway: the physical AGI path is fundamentally different

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.