Leaderboard / droid 100
droid 100
Camera dropoutShare of frames from live episode cameras that are almost entirely one flat black or white value. A camera blank for a whole episode is counted as absent, shown underneath, not as a dropout. Method →
0
0 frames
BlurShare of camera frames inside an interval at least 0.5 s long where the image is much blurrier than that camera's typical frame. Method →
2.9%
2,808 frames
DarknessShare of camera frames inside an interval at least 0.5 s long where 60% or more of the pixels are near-black. Method →
0.7%
658 frames
FreezeShare of camera frames inside an interval at least 1 s long where the video repeats the exact same image. Method →
0
0 frames
Duration mismatchShare of assessed episode-camera pairs whose metadata video length disagrees with the Parquet frame count by more than 1 frame. A hatched cell with * means only some pairs could be assessed (the small number shows how many); the rest are unknown, not clean. –* means none could be assessed. Method →
0
0 of 300 assessed
Flagged episodesEpisodes flagged by any episode check: actions that never change, a robot that barely moves, non-finite values, broken row indexes or timestamp gaps. The count is on top, its share of assessed episodes underneath. Method →
0*
of 99 assessed episodes · 1 unassessed
All checks
| Check | Flagged | Share | Coverage |
|---|---|---|---|
| Files 3 | |||
| Video decoding | 0 | 0 | complete |
| Episodes 100 | |||
| Episode boundaries | 0 | 0 | complete |
| Finite action and state | 0 | 0 | complete |
| Timestamp gaps | 0 | 0 | complete |
| Static actions | 0 | 0 | 99 assessed |
| Idle episodes | 0 | 0 | 99 assessed |
| Episode-camera pairs 300 | |||
| Duration mismatch | 0 | 0 | complete |
| Video/action sync | – | – | not measured |
| Frames 96,636 | |||
| Camera absent | 0 | 0 | complete |
| Camera dropout | 0 | 0 | complete |
| Blur | 2,80851 intervals | 2.9% | complete |
| Darkness | 6588 intervals | 0.7% | complete |
| Freeze | 0 | 0 | complete |
By camera
| Camera | Frames | Absent | Dropout | Blur | Darkness | Freeze |
|---|---|---|---|---|---|---|
| exterior_image_1_left | 32,212 | 0 | 0 | 0.5%4 intervals | 0 | 0 |
| exterior_image_2_left | 32,212 | 0 | 0 | 0.4%5 intervals | 0 | 0 |
| wrist_image_left | 32,212 | 0 | 0 | 7.8%42 intervals | 2.0%8 intervals | 0 |
Evidence
Longest video intervals up to 4 per signal · times are within the video file
| Signal | Camera | Episode | File | Start | End | Duration | |
|---|---|---|---|---|---|---|---|
| Blur | wrist_image_left | 53 | file-000.mp4 | 18:23.5 | 18:49.3 | 25.8 s | Inspect → |
| Blur | wrist_image_left | 50 | file-000.mp4 | 17:15.7 | 17:31.3 | 15.7 s | Inspect → |
| Blur | wrist_image_left | 63 | file-000.mp4 | 21:43.9 | 21:58.3 | 14.4 s | Inspect → |
| Blur | wrist_image_left | 50 | file-000.mp4 | 16:42.6 | 16:52.5 | 9.9 s | Inspect → |
| Darkness | wrist_image_left | 53 | file-000.mp4 | 18:23.5 | 18:49.3 | 25.8 s | Inspect → |
| Darkness | wrist_image_left | 10 | file-000.mp4 | 2:45.8 | 2:56.5 | 10.7 s | Inspect → |
| Darkness | wrist_image_left | 57 | file-000.mp4 | 20:09.3 | 20:11.5 | 2.1 s | Inspect → |
| Darkness | wrist_image_left | 88 | file-000.mp4 | 31:00.1 | 31:01.4 | 1.3 s | Inspect → |
Provenance
- Revision
- 87301a2d2e99340e2010c9ef0f1d8e780b08aaf9 (main)
- Scanned
- 2026-10-10 00:18 UTC · NVIDIA A40
- Flag method
- rule-based-video-events-v1
- Episode method
- episode-motion-v1
- Code
- 9f54cd5fa0437e2c lock 282482d5a82a
Pinned dataset on Hugging Face ↗Result JSONMethodologyReport an issue with this result →