Listen Before Act: Audio-Conditioned Robot Manipulation with
Overview
Source roundup from published reports. Claims below are attributed to their publishers, not independently verified. arXiv Robotics — research abstracts: Listen Before Act: Audio-Conditioned Robot Manipulation with ListenVLA. This paper presents ListenVLA, an audio-conditioned VLA policy that improves robotic manipulation by integrating auditory cues into action generation. The method combines semantic audio embeddings with waveform-derived a…
Generated from attributed reports · Updated 2 hours ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Reported quantity · tasks: 8 other · Basis not reported
“ction differences. The objective supervises short-horizon differences between flow-velocity predictions under different audio conditions, with shared pure-noise action inputs and fixed non-audio observations, alongside full-chunk action supervision. Furthermore, we develop LIBERO-Audio, an eight-task benchmark covering sound-based target selection, responses to auditory events, and physical interactions that reveal a”
Exact source · revision 1Source owner not reported
Artifact availability · code: available
“coustic evidence. Experiments on LIBERO-Audio and three real-world manipulation tasks show excellent performance. Ablation studies support the contributions of binding supervision and audio modulation, while audio swap tests show that sound influences action predictions. Our code and videos are available at https://anonymous.4open.science/r/listenvla-F18D”
Exact source · revision 1Source owner not reported
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsListen Before Act: Audio-Conditioned Robot Manipulation with ListenVLA
This paper presents ListenVLA, an audio-conditioned VLA policy that improves robotic manipulation by integrating auditory cues into action generation. The method combines semantic audio embeddings with waveform-derived acoustic cues and introduces an audio-action binding objective to link auditory differences to demonstrated actions. Evaluated on a new benchmark, LIBERO-Audio, and real-world tasks, the approach demonstrates strong performance in sound-based manipulation.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).