Skip to content

Robotics datasets: a primary-source reference map

RoboSignal · Published · Version 1.0

This small reference map separates robot interaction data from human egocentric video. It is a starting point for inspecting documentation, not an exhaustive dataset ranking. Use each original project for the current release, measured scale and access conditions.

DROID: robot manipulation data

DROID presents a dataset for robot manipulation. Start with its collection setup, available observations and actions, release instructions and evaluation material. Determine whether the documented hardware and tasks fit your question. The entry in this map does not imply independent verification of the project’s reported scale or performance.

Open X-Embodiment: data across robot platforms

Open X-Embodiment brings together robot-learning datasets across embodiments. Inspect constituent datasets, their documented formats and their individual terms. Aggregation does not make all component licences or task distributions identical. Keep the collection’s overall description separate from facts about one constituent release.

Ego4D: human egocentric video

Ego4D focuses on first-person video and associated research tasks. Human observations can be relevant to embodied perception, but video is not automatically a robot-action trajectory. Check the access process, permitted uses, annotations and task definitions at the project. Avoid labelling human recordings as robot demonstrations unless a specific learning setup establishes that relationship.

How to compare without a misleading leaderboard

Begin with the job you want the data to support. Is it robot action learning, first-person perception, evaluation or another task? Then inspect the action labels, embodiment, modalities and release rights. Do not rank projects by a mixed list of trajectories, clips, sensor-hours and unique hours. The values measure different things. A normalized comparison requires compatible definitions and a documented conversion basis, which this map does not claim to supply.

Use and update the source register

Download this reference map as CSV. The register includes the data category, primary URL, inspection question and reference date. It deliberately omits unsourced numeric rankings and blanket licence labels. Use the evidence checklist to extend it for a particular release. Report a stale link or correction through Feedback, with the original source and affected field. A future update should record its own date rather than pretending an older row is continuously verified.

Primary-source register

Reference date: 2026-10-04. No cross-project numeric ranking or blanket rights assessment.
ProjectData categoryInspection question
DROIDPhysical robot manipulationCheck observations, actions, collection setup and release terms.
Open X-EmbodimentRobot-learning datasets across embodimentsCheck constituent data, formats and individual terms.
Ego4DHuman egocentric videoCheck task definitions, annotations, access and permitted uses.

Primary references

Reference links checked 2026-10-04. Project claims remain attributed to their original source. This page is not a certification or a live test of the referenced system.

Related reading

Cite this reference

RoboSignal. “Robotics datasets: a primary-source reference map” (2026-10-04), version 1.0. https://robosignal.ai/resources/robotics-dataset-reference-map. Cite the original project separately for its own reported results.

Corrections and feedback · Reference RSS