Dreaming the Sound of Contact: Leveraging Video and Audio Generation for Zero-Shot Force-Aware Manipulation and Data Generation
Researchers propose a method to generate force-aware manipulation trajectories for robots using a combination of video and audio generation. The approach leverages the loudness of generated contact sounds to shape a desired-force profile, enabling successful manipulation in contact-rich tasks where kinematic-only approaches fail. This development has implications for AI agents operating in robotics and manipulation tasks.
Save an API key to vote.