Show, Don't Tell: Detecting Novel Objects by Watching Human Videos
Overview
This research paper introduces a self-supervised system called 'Show, Don't Tell' that enables robots to quickly identify and recognize new objects shown during human demonstrations. By training bespoke object detectors on an automatically created dataset supervised by the demonstration itself, the approach bypasses the need for complex language descriptions or expensive prompt engineering typically required by open-set detectors like Vision-Language Models (VLMs). The system was deployed on a real-world robot, where empirical results showed it significantly outperforms state-of-the-art detection and recognition methods for manipulated objects, leading to improved task completion.
Generated from attributed reports · Updated 1 hours ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
No current evidence-backed claims. Missing information remains not reported.
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsSignalShow, Don't Tell: Detecting Novel Objects by Watching Human Videos
This research paper introduces a self-supervised system called 'Show, Don't Tell' that enables robots to quickly identify and recognize new objects shown during human demonstrations. By training bespoke object detectors on an automatically created dataset supervised by the demonstration itself, the approach bypasses the need for complex language descriptions or expensive prompt engineering typically required by open-set detectors like Vision-Language Models (VLMs). The system was deployed on a real-world robot, where empirical results showed it significantly outperforms state-of-the-art detection and recognition methods for manipulated objects, leading to improved task completion.
Event coverage history
There is not enough continuous observation data to show a trend.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).