D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models
D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models
This research introduces D&A (Describe & Assess), a prompt-based method that decouples task progress estimation into an objective textual description of scene dynamics followed by an assessment phase using explicit rubrics. By requiring the Vision-Language Model to synthesize an absolute definition of success before scoring, the approach anchors evaluations to external criteria rather than internal video timelines. Empirical results indicate that D&A calibrates zero-shot estimates and mitigates confirmation bias, providing fine-grained partial progress metrics that penalize failures while interpolating successful runs. The method generalizes across tasks and embodiments, matching or surpassing post-trained reward models, and enables efficient downstream reinforcement learning.
The authors propose a prompt-based framework that decouples task description from assessment to mitigate confirmation bias in Vision-Language Models for zero-shot robotic reward estimation, enabling fine-grained progress metrics without expensive post-training.
Source: arXiv Robotics — research abstracts · Read original article ↗
Loading article text…
Source:arXiv Robotics — research abstracts · arxiv.org