Leaderboard / robocasa target human unified
robocasa target human unified
Camera dropoutShare of frames from live episode cameras that are almost entirely one flat black or white value. A camera blank for a whole episode is counted as absent, shown underneath, not as a dropout. Method →
0
0 frames
BlurShare of camera frames inside an interval at least 0.5 s long where the image is much blurrier than that camera's typical frame. Method →
2.4%
1,067,441 frames
DarknessShare of camera frames inside an interval at least 0.5 s long where 60% or more of the pixels are near-black. Method →
<0.1%
1,346 frames
FreezeShare of camera frames inside an interval at least 1 s long where the video repeats the exact same image. Method →
0.1%
49,756 frames
Duration mismatchShare of assessed episode-camera pairs whose metadata video length disagrees with the Parquet frame count by more than 1 frame. A hatched cell with * means only some pairs could be assessed (the small number shows how many); the rest are unknown, not clean. –* means none could be assessed. Method →
0
0 of 75,921 assessed
Flagged episodesEpisodes flagged by any episode check: actions that never change, a robot that barely moves, non-finite values, broken row indexes or timestamp gaps. The count is on top, its share of assessed episodes underneath. Method →
0
of 25,307 assessed episodes
All checks
| Check | Flagged | Share | Coverage |
|---|---|---|---|
| Files 973 | |||
| Video decoding | 0 | 0 | complete |
| Episodes 25,307 | |||
| Episode boundaries | 0 | 0 | complete |
| Finite action and state | 0 | 0 | complete |
| Timestamp gaps | 0 | 0 | complete |
| Static actions | 0 | 0 | complete |
| Idle episodes | 0 | 0 | complete |
| Episode-camera pairs 75,921 | |||
| Duration mismatch | 0 | 0 | complete |
| Video/action sync | – | – | not measured |
| Frames 44,873,697 | |||
| Camera absent | 0 | 0 | complete |
| Camera dropout | 0 | 0 | complete |
| Blur | 1,067,44123,715 intervals | 2.4% | complete |
| Darkness | 1,34652 intervals | <0.1% | complete |
| Freeze | 49,7561,220 intervals | 0.1% | complete |
By camera
| Camera | Frames | Absent | Dropout | Blur | Darkness | Freeze |
|---|---|---|---|---|---|---|
| robot0_agentview_left | 14,957,899 | 0 | 0 | 0.1%333 intervals | <0.1%1 interval | 0.2%601 intervals |
| robot0_agentview_right | 14,957,899 | 0 | 0 | 0.2%522 intervals | 0 | 0.1%488 intervals |
| robot0_eye_in_hand | 14,957,899 | 0 | 0 | 6.8%22,860 intervals | <0.1%51 intervals | <0.1%131 intervals |
Evidence
Longest video intervals up to 4 per signal · times are within the video file
| Signal | Camera | Episode | File | Start | End | Duration | |
|---|---|---|---|---|---|---|---|
| Blur | robot0_agentview_left | 13575 | file-148.mp4 | 6:12.4 | 7:06.0 | 53.6 s | Inspect → |
| Blur | robot0_agentview_left | 13543 | file-147.mp4 | 8:26.5 | 9:20.1 | 53.6 s | Inspect → |
| Blur | robot0_agentview_left | 13501 | file-146.mp4 | 1:08.5 | 1:59.4 | 50.9 s | Inspect → |
| Blur | robot0_agentview_left | 13636 | file-150.mp4 | 0:00.0 | 0:47.2 | 47.2 s | Inspect → |
| Darkness | robot0_agentview_left | 13049 | file-132.mp4 | 33:55.0 | 34:03.8 | 8.8 s | Inspect → |
| Darkness | robot0_eye_in_hand | 25275 | file-228.mp4 | 73:50.4 | 73:54.1 | 3.8 s | Inspect → |
| Darkness | robot0_eye_in_hand | 10017 | file-050.mp4 | 45:12.7 | 45:15.3 | 2.7 s | Inspect → |
| Darkness | robot0_eye_in_hand | 24830 | file-226.mp4 | 13:04.4 | 13:06.6 | 2.3 s | Inspect → |
| Freeze | robot0_agentview_left | 13636 | file-150.mp4 | 0:12.6 | 0:37.5 | 24.9 s | Inspect → |
| Freeze | robot0_agentview_right | 9238 | file-063.mp4 | 3:32.2 | 3:49.6 | 17.3 s | Inspect → |
| Freeze | robot0_agentview_left | 13501 | file-146.mp4 | 1:33.6 | 1:46.0 | 12.4 s | Inspect → |
| Freeze | robot0_agentview_left | 13575 | file-148.mp4 | 6:37.6 | 6:49.8 | 12.2 s | Inspect → |
Provenance
- Revision
- a1c7cba1a128f5dd8d3084012ba366d10ce174d9 (main)
- Scanned
- 2026-10-10 00:41 UTC · NVIDIA RTX PRO 6000 Blackwell Server Edition
- Flag method
- rule-based-video-events-v1
- Episode method
- episode-motion-v1
- Code
- 9f54cd5fa0437e2c lock 282482d5a82a
Pinned dataset on Hugging Face ↗Result JSONMethodologyReport an issue with this result →