Thesis
A Reinforcement Learning Testbed for Deformable Object Manipulation using Visuotactile Sensing
KAIST Jan 2024
We aim to create a simulated testbed for training and assessing deformable object manipulation skills. This testbed requires tactile sensing to distinguish heterogeneous elasticities of a deformable object to acquire skills. In this work, we introduce a visuotactile testbed, DetactGym, for deformable object manipulation, integrating a novel architecture of tactile sensors leveraging collision cascades. These sensors integrate a diamond-shaped rigid element encased within an external rigid structure. This design overcomes a fundamental limitation of PhysX engine-based simulators: their inability to directly measure contact force on deformable objects. The diamond-shaped element efficiently transmits the contact force to the outer structure during interactions with these objects, ensuring force measurements. Our evaluation focuses on the testbed’s capability, equipped with tactile sensors, to facilitate the learning of lifting heterogeneous deformable objects with minimal deformation through reinforcement learning methods. Our findings highlight the effectiveness of tactile feedback over visual cues in manipulating deformable objects with diverse elasticities, reducing deformation.