Skip to content
arXiv Robotics — research abstracts· Keru Zhou, Zhirui Fang, Xinrun Xu, Yaopeng Lou, Zeyuan He, Zihao Zhu, Xinze Niu, Chen Wang, Tianfu Li, Samith Va, Xiyue Zhang, Bin Qian, Junwei Li, Wenjia Ding, Yicheng Xu, Bowen Jiang, Wenhao Wang, Ziwei Wang, Chang Zhou, Li Liu, Xiu Li, Maoqing Yao·· 4 days agoSignalEditorial score75

Ego-CEVR: Learning Cross-Embodiment Visual Representations from Human Egocentric Videos

Ego-CEVR: Learning Cross-Embodiment Visual Representations from Human Egocentric Videos

Summary

Ego-CEVR is a data-native framework for hierarchical visual representation learning that assigns distinct learning objectives to global and interaction representations. The global module learns object relations, task state, and temporal progress through future prediction on egocentric video, while the Interaction module interprets wrist observations in global context and learns local alignment and contact cues through robot action supervision. The framework supports independent pretraining of its global video module on large-scale human egocentric videos and videos from diverse robot embodiments, without requiring robot action labels or paired wrist observations.

Editorial context

This paper introduces Ego-CEVR, a framework for learning cross-embodiment visual representations from human egocentric videos, focusing on hierarchical representation learning with distinct objectives for global and interaction modules.

Source: arXiv Robotics — research abstracts · Read original article ↗

Loading article text…

Source:arXiv Robotics — research abstracts · arxiv.org

Timezone · UTC

Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).