Skip to content
arXiv Robotics — research abstracts· Marius Memmel, Shawn Yin, Urvi Rutia, Angad Wadhwa, Eldon Li, Gavin Angeloff, Ankit Goyal, Jesse Zhang, Dieter Fox, Fabio Ramos, Anqi Li, Abhishek Gupta·· 1 days agoSignalEditorial score75

D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models

D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models

Summary

This research introduces D&A (Describe & Assess), a prompt-based method that decouples task progress estimation into an objective textual description of scene dynamics followed by an assessment phase using explicit rubrics. By requiring the Vision-Language Model to synthesize an absolute definition of success before scoring, the approach anchors evaluations to external criteria rather than internal video timelines. Empirical results indicate that D&A calibrates zero-shot estimates and mitigates confirmation bias, providing fine-grained partial progress metrics that penalize failures while interpolating successful runs. The method generalizes across tasks and embodiments, matching or surpassing post-trained reward models, and enables efficient downstream reinforcement learning.

Editorial context

The authors propose a prompt-based framework that decouples task description from assessment to mitigate confirmation bias in Vision-Language Models for zero-shot robotic reward estimation, enabling fine-grained progress metrics without expensive post-training.

Source: arXiv Robotics — research abstracts · Read original article ↗

Loading article text…

Source:arXiv Robotics — research abstracts · arxiv.org

Timezone · UTC

Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).