Leaderboard / uiuc d3field
uiuc d3field
Camera dropoutShare of frames from live episode cameras that are almost entirely one flat black or white value. A camera blank for a whole episode is counted as absent, shown underneath, not as a dropout. Method →
0
0 frames
BlurShare of camera frames inside an interval at least 0.5 s long where the image is much blurrier than that camera's typical frame. Method →
0
0 frames
DarknessShare of camera frames inside an interval at least 0.5 s long where 60% or more of the pixels are near-black. Method →
0
0 frames
FreezeShare of camera frames inside an interval at least 1 s long where the video repeats the exact same image. Method →
0
0 frames
Duration mismatchShare of assessed episode-camera pairs whose metadata video length disagrees with the Parquet frame count by more than 1 frame. A hatched cell with * means only some pairs could be assessed (the small number shows how many); the rest are unknown, not clean. –* means none could be assessed. Method →
0
0 of 768 assessed
Flagged episodesEpisodes flagged by any episode check: actions that never change, a robot that barely moves, non-finite values, broken row indexes or timestamp gaps. The count is on top, its share of assessed episodes underneath. Method →
11*
of 187 assessed episodes · 5 unassessed
All checks
| Check | Flagged | Share | Coverage |
|---|---|---|---|
| Files 4 | |||
| Video decoding | 0 | 0 | complete |
| Episodes 192 | |||
| Episode boundaries | 0 | 0 | complete |
| Finite action and state | 0 | 0 | complete |
| Timestamp gaps | 0 | 0 | complete |
| Static actions | 11 | 5.9% | 187 assessed |
| Idle episodes | – | – | not measured |
| Episode-camera pairs 768 | |||
| Duration mismatch | 0 | 0 | complete |
| Video/action sync | – | – | not measured |
| Frames 53,536 | |||
| Camera absent | 0 | 0 | complete |
| Camera dropout | 0 | 0 | complete |
| Blur | 0 | 0 | complete |
| Darkness | 0 | 0 | complete |
| Freeze | 0 | 0 | complete |
By camera
| Camera | Frames | Absent | Dropout | Blur | Darkness | Freeze |
|---|---|---|---|---|---|---|
| image_1 | 13,384 | 0 | 0 | 0 | 0 | 0 |
| image_2 | 13,384 | 0 | 0 | 0 | 0 | 0 |
| image_3 | 13,384 | 0 | 0 | 0 | 0 | 0 |
| image_4 | 13,384 | 0 | 0 | 0 | 0 | 0 |
Evidence
Flagged episodes 11 stored of 11
| Episode | Reason | Steps | Length | |
|---|---|---|---|---|
| 19 | Static actions | 89 | 1:29.0 | Inspect → |
| 89 | Static actions | 47 | 47.0 s | Inspect → |
| 105 | Static actions | 100 | 1:40.0 | Inspect → |
| 117 | Static actions | 52 | 52.0 s | Inspect → |
| 123 | Static actions | 100 | 1:40.0 | Inspect → |
| 130 | Static actions | 100 | 1:40.0 | Inspect → |
| 157 | Static actions | 100 | 1:40.0 | Inspect → |
| 167 | Static actions | 78 | 1:18.0 | Inspect → |
| 172 | Static actions | 100 | 1:40.0 | Inspect → |
| 179 | Static actions | 100 | 1:40.0 | Inspect → |
| 181 | Static actions | 61 | 1:01.0 | Inspect → |
Provenance
- Revision
- 6400996f91f7d436874c9007c42cc68ae59a2cc7 (main)
- Scanned
- 2026-10-10 01:10 UTC · NVIDIA L4
- Flag method
- rule-based-video-events-v1
- Episode method
- episode-motion-v1
- Code
- d54f0dee28b0d484 lock 282482d5a82a
Pinned dataset on Hugging Face ↗Result JSONMethodologyReport an issue with this result →