NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation

The article presents "NoContactNoWorries," a transformer-based multimodal framework designed to estimate binary contact states in robotic manipulation by integrating RGB-D vision with proprioceptive data. This approach addresses the limitations of traditional tactile sensors by enabling robots to infer contact through visual cues, thereby supporting downstream tasks such as in-hand object reorientation. Experimental validation in both simulation and real-world scenarios demonstrates the model's effectiveness and potential for enhancing dexterous manipulation capabilities in robotics.