Robot Introspection via Wrench-based Action Grammars.
Juan Rojas, Zhenjie Huang, Shuangqi Luo, Yunlong Du, Wenwei Kuang, Dingqiao Zhu, and Kensuke Harada
Abstract:
Robotic failure is all too common in unstructured robot tasks. Despite well designed controllers, robots often fail due to unexpected events. How do robots measure unexpected events? Many do not. Most robots are driven by the senseplan- act paradigm, however more recently robots are working with a sense-plan-act-verify paradigm. In this work we present a principled methodology to bootstrap robot introspection for contact tasks. In effect, we are trying to answer the question, what did the robot do? To this end, we hypothesize that all noisy wrench data inherently contains patterns that can be effectively represented by a vocabulary. The vocabulary is generated by meaningfully segmenting the data and then encoding it. When the wrench information represents a sequence of sub-tasks, we can think of the vocabulary forming sets of words or sentences, such that each subtask is uniquely represented by a word set. Such sets can be classified using statistical or machine learning techniques. We use SVMs and Mondrian Forests to classify contacts tasks both in simulation and in real robots for one and dual arm scenarios showing the general robustness of the approach. The contribution of our work is the presentation of a simple but generalizable semantic scheme that enables a robot to understand its high-level state. This verification mechanism can provide feedback for high-level planners or reasoning systems that use semantic descriptors as well.
Resources:
- Code
- Simulation Environment OpenHRP 3.0.8 used in Linux 10.04:
https://fkanehiro.github.io/openhrp3-doc/en/ - Manipulation Strategy for Assembly Task:
https://github.com/birlrobotics/PivotApproach/tree/DualArm_Gray - RCBHT (Semantic Encoder):
https://github.com/birlrobotics/RCBHT/releases/tag/v2.0.2
- Simulation Environment OpenHRP 3.0.8 used in Linux 10.04:
- DATA:
- REAL_HIRO_ONE_SA_SUCCESS with RCBHT labels:
https://github.com/birlrobotics/REAL_HIRO_ONE_SA_SUCCESS/tree/RCBHT - SIM_HIRO_ONE_SA_SUCCESS with RCBHT labels:
https://github.com/birlrobotics/SIM_HIRO_ONE_SA_SUCCESS/tree/RCBHT - SIM_HIRO_two_SA_SUCCESS with RCBHT labels:
https://github.com/birlrobotics/SIM_HIRO_TWO_SA_SUCCESS/tree/RCBHT
- REAL_HIRO_ONE_SA_SUCCESS with RCBHT labels:
Media
- Outside China – YouTube
Copyright Notice:
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.