While recent research has focused heavily on dexterous grasp pose generation, less attention has been devoted to the execution of planned grasps. Under shape and position uncertainty, open-loop execution often yields uncoordinated contacts, causing undesired in-hand object motion and even grasp failures. To address this, this paper proposes a tactile-driven model predictive controller for adaptive and delicate execution of diverse dexterous grasps. Our approach emphasizes multi-contact coordination across both approaching and grasping phases, with three key novelties: (i) coordination-aware phase separation, (ii) arm–hand coordination to compensate for position errors, and (iii) adaptive force coordination to increase contact forces in a balanced manner. An analytical model is employed to relate contact forces to robot joint motions for predictive control. Our formulation imposes no restrictions on grasp types or contact configurations and integrates seamlessly with state-of-the-art grasp pose generation methods. We validate the approach through large-scale simulations involving 15k grasps across 478 objects on three robotic hands, and real-world experiments on 8 objects. Results demonstrate that our method achieves higher grasp success rates and reduced undesired object movements.
Overview of our tactile-driven coordinated contact control method for adaptive execution of planned grasp poses generated from observations with uncertainty. Our method employs a coordination-aware separation of the approaching and grasping phases, using the criteria of wrench balance. During the approaching phase, the fingers make contact with the object using gentle forces, while coordinated arm motions compensate for object position errors without deviating from the planned finger configurations. Once sufficient contacts are established, the fingers increase contact forces in a balanced manner to reach the desired total grasp force, during which the desired force of each contact is re-allocated in real time to adapt to changes in contact states.