Shopping for Groceries and Putting Them Away
Dec 19, 2011 2198 views 
The video shows TUM-James (a PR2 robot) simulating the shopping task by bringing the groceries home and placing them in accordance to a priori learnt organizational patterns in households. The robot uses the 3D perception algorithms from point cloud library in order to detect object candidates in the storage rack and system for textured objects detection in order to recognize objects. Grasping and manipulation of the shopping basket is done using James's haptic capabilities. Finally, to infer where do the objects belong to, TUM-James queries a system for knowledge modeling and resoning and computes the similarities (WUP similarity) to the other objects in the kitchen's ontology using techniques from semantic information retrieval.