Current progress toward generalization lacks precision
3
My goal: precise robotic generalization
4
What do we need to solve precise pick-and-place?
5
Test time: pick-and-place on the real system
6
What do we mean by tactile localization?
7
Pipeline for tactile pose estimation
8
What does it mean that 2 images are close?
9
We compute pose error using the object's pointcloud
10
Tactile localization using contrastive learning
11
Quantitative results on tactile localization
12
Pipeline for visual pose estimation
13
Benefits of matching images with encodings
14
Our solutions allows different goal configurations
15
Lessons learned and future directions
Description:
Explore a comprehensive approach to robotic pick-and-place that combines high precision and generalization skills. Learn how simulation-based probabilistic models for grasping, planning, and localization can be effectively transferred to real robotic systems. Discover the capabilities of a dual-arm robot in exerting task-aware picks on new objects, utilizing visuo-tactile sensing for localization, and performing dexterous placings with sub-millimeter accuracy. Gain insights into achieving precise robotic generalization through learned probabilistic models, enabling robots to adapt their skills across multiple tasks. Delve into the research of Maria Bauza Villalonga, a PhD student at MIT, as she presents her work on advancing robotic capabilities in handling novel objects and placing configurations with high precision.
Towards Generalization of Precise Robot Skills - Accurate Pick-and-Place of Novel Objects