Leaderboard / SO101 coffee subtask 2
SO101 coffee subtask 2
Camera dropoutShare of frames from live episode cameras that are almost entirely one flat black or white value. A camera blank for a whole episode is counted as absent, shown underneath, not as a dropout. Method →
0
0 frames
BlurShare of camera frames inside an interval at least 0.5 s long where the image is much blurrier than that camera's typical frame. Method →
7.4%
30,372 frames
DarknessShare of camera frames inside an interval at least 0.5 s long where 60% or more of the pixels are near-black. Method →
0
0 frames
FreezeShare of camera frames inside an interval at least 1 s long where the video repeats the exact same image. Method →
0
0 frames
Duration mismatchShare of assessed episode-camera pairs whose metadata video length disagrees with the Parquet frame count by more than 1 frame. A hatched cell with * means only some pairs could be assessed (the small number shows how many); the rest are unknown, not clean. –* means none could be assessed. Method →
60.2%*
242 flagged · only 402 of 972 assessed
Flagged episodesEpisodes flagged by any episode check: actions that never change, a robot that barely moves, non-finite values, broken row indexes or timestamp gaps. The count is on top, its share of assessed episodes underneath. Method →
0
of 486 assessed episodes
Video offsets in this dataset are inconsistent, so video intervals can’t be assigned to episodes. Counts still cover every decoded frame.
All checks
| Check | Flagged | Share | Coverage |
|---|---|---|---|
| Files 24 | |||
| Video decoding | 0 | 0 | complete |
| Episodes 486 | |||
| Episode boundaries | 0 | 0 | complete |
| Finite action and state | 0 | 0 | complete |
| Timestamp gaps | 0 | 0 | complete |
| Static actions | 0 | 0 | complete |
| Idle episodes | 0 | 0 | complete |
| Episode-camera pairs 972 | |||
| Duration mismatch | 242 | 60.2% | 402 assessed |
| Video/action sync | – | – | not measured |
| Frames 413,135 | |||
| Camera absent | 0 | 0 | complete |
| Camera dropout | 0 | 0 | complete |
| Blur | 30,372248 intervals | 7.4% | complete · episodes can’t be placed |
| Darkness | 0 | 0 | complete · episodes can’t be placed |
| Freeze | 0 | 0 | complete · episodes can’t be placed |
By camera
| Camera | Frames | Absent | Dropout | Blur | Darkness | Freeze |
|---|---|---|---|---|---|---|
| front | 206,568 | 0 | 0 | 0 | 0 | 0 |
| wrist | 206,567 | 0 | 0 | 14.7%248 intervals | 0 | 0 |
Evidence
Duration mismatches 100 stored of 242
| Episode | Camera | Data | Metadata interval | Difference | |
|---|---|---|---|---|---|
| 55 | front | 8.37 s | 253.30 s | +244.93 s | Inspect → |
| 151 | front | 6.90 s | 118.60 s | +111.70 s | Inspect → |
| 190 | front | 9.70 s | 80.20 s | +70.50 s | Inspect → |
| 190 | wrist | 9.70 s | 80.20 s | +70.50 s | Inspect → |
| 451 | front | 8.27 s | 73.80 s | +65.53 s | Inspect → |
| 451 | wrist | 8.27 s | 73.80 s | +65.53 s | Inspect → |
| 366 | front | 8.50 s | 73.63 s | +65.13 s | Inspect → |
| 366 | wrist | 8.50 s | 73.63 s | +65.13 s | Inspect → |
Show all 100 stored
| Episode | Camera | Data | Metadata interval | Difference | |
|---|---|---|---|---|---|
| 401 | front | 9.63 s | 55.00 s | +45.37 s | Inspect → |
| 401 | wrist | 9.63 s | 55.00 s | +45.37 s | Inspect → |
| 192 | front | 8.40 s | 53.63 s | +45.23 s | Inspect → |
| 192 | wrist | 8.40 s | 53.63 s | +45.23 s | Inspect → |
| 70 | front | 6.93 s | 49.77 s | +42.83 s | Inspect → |
| 295 | front | 7.50 s | 36.47 s | +28.97 s | Inspect → |
| 295 | wrist | 7.50 s | 36.47 s | +28.97 s | Inspect → |
| 171 | front | 8.67 s | 33.00 s | +24.33 s | Inspect → |
| 171 | wrist | 8.67 s | 33.00 s | +24.33 s | Inspect → |
| 140 | front | 7.47 s | 31.50 s | +24.03 s | Inspect → |
| 225 | front | 9.23 s | 30.93 s | +21.70 s | Inspect → |
| 225 | wrist | 9.23 s | 30.93 s | +21.70 s | Inspect → |
| 191 | front | 10.83 s | 28.43 s | +17.60 s | Inspect → |
| 191 | wrist | 10.83 s | 28.43 s | +17.60 s | Inspect → |
| 391 | front | 10.07 s | 26.97 s | +16.90 s | Inspect → |
| 391 | wrist | 10.07 s | 26.97 s | +16.90 s | Inspect → |
| 62 | front | 6.63 s | 23.33 s | +16.70 s | Inspect → |
| 141 | front | 7.37 s | 23.07 s | +15.70 s | Inspect → |
| 150 | front | 6.67 s | 22.33 s | +15.67 s | Inspect → |
| 193 | front | 8.20 s | 23.10 s | +14.90 s | Inspect → |
| 193 | wrist | 8.20 s | 23.10 s | +14.90 s | Inspect → |
| 15 | front | 8.70 s | 22.47 s | +13.77 s | Inspect → |
| 15 | wrist | 8.70 s | 22.47 s | +13.77 s | Inspect → |
| 419 | front | 9.07 s | 20.93 s | +11.87 s | Inspect → |
| 419 | wrist | 9.07 s | 20.93 s | +11.87 s | Inspect → |
| 195 | front | 7.83 s | 19.63 s | +11.80 s | Inspect → |
| 195 | wrist | 7.83 s | 19.63 s | +11.80 s | Inspect → |
| 45 | front | 7.53 s | 19.00 s | +11.47 s | Inspect → |
| 411 | front | 7.50 s | 18.27 s | +10.77 s | Inspect → |
| 411 | wrist | 7.50 s | 18.27 s | +10.77 s | Inspect → |
| 50 | front | 7.33 s | 17.93 s | +10.60 s | Inspect → |
| 144 | front | 8.97 s | 19.50 s | +10.53 s | Inspect → |
| 199 | front | 9.27 s | 19.53 s | +10.27 s | Inspect → |
| 199 | wrist | 9.27 s | 19.53 s | +10.27 s | Inspect → |
| 238 | front | 9.53 s | 19.73 s | +10.20 s | Inspect → |
| 238 | wrist | 9.53 s | 19.73 s | +10.20 s | Inspect → |
| 135 | front | 6.63 s | 16.40 s | +9.77 s | Inspect → |
| 85 | front | 12.73 s | 22.43 s | +9.70 s | Inspect → |
| 85 | wrist | 12.73 s | 22.43 s | +9.70 s | Inspect → |
| 222 | front | 10.37 s | 20.03 s | +9.67 s | Inspect → |
| 222 | wrist | 10.37 s | 20.03 s | +9.67 s | Inspect → |
| 393 | front | 11.40 s | 21.07 s | +9.67 s | Inspect → |
| 393 | wrist | 11.40 s | 21.07 s | +9.67 s | Inspect → |
| 229 | front | 8.37 s | 17.60 s | +9.23 s | Inspect → |
| 229 | wrist | 8.37 s | 17.60 s | +9.23 s | Inspect → |
| 204 | front | 7.67 s | 16.70 s | +9.03 s | Inspect → |
| 204 | wrist | 7.67 s | 16.70 s | +9.03 s | Inspect → |
| 461 | front | 5.43 s | 14.33 s | +8.90 s | Inspect → |
| 461 | wrist | 5.43 s | 14.33 s | +8.90 s | Inspect → |
| 210 | front | 12.60 s | 21.47 s | +8.87 s | Inspect → |
| 210 | wrist | 12.60 s | 21.47 s | +8.87 s | Inspect → |
| 386 | front | 14.57 s | 23.43 s | +8.87 s | Inspect → |
| 386 | wrist | 14.57 s | 23.43 s | +8.87 s | Inspect → |
| 392 | front | 13.27 s | 22.10 s | +8.83 s | Inspect → |
| 392 | wrist | 13.27 s | 22.10 s | +8.83 s | Inspect → |
| 196 | front | 8.80 s | 17.50 s | +8.70 s | Inspect → |
| 196 | wrist | 8.80 s | 17.50 s | +8.70 s | Inspect → |
| 406 | front | 8.63 s | 16.87 s | +8.23 s | Inspect → |
| 406 | wrist | 8.63 s | 16.87 s | +8.23 s | Inspect → |
| 353 | front | 8.50 s | 16.63 s | +8.13 s | Inspect → |
| 353 | wrist | 8.50 s | 16.63 s | +8.13 s | Inspect → |
| 100 | front | 10.33 s | 18.37 s | +8.03 s | Inspect → |
| 100 | wrist | 10.33 s | 18.37 s | +8.03 s | Inspect → |
| 208 | front | 7.57 s | 15.57 s | +8.00 s | Inspect → |
| 208 | wrist | 7.57 s | 15.57 s | +8.00 s | Inspect → |
| 221 | front | 9.97 s | 17.23 s | +7.27 s | Inspect → |
| 221 | wrist | 9.97 s | 17.23 s | +7.27 s | Inspect → |
| 153 | front | 8.30 s | 15.50 s | +7.20 s | Inspect → |
| 207 | front | 7.63 s | 14.77 s | +7.13 s | Inspect → |
| 207 | wrist | 7.63 s | 14.77 s | +7.13 s | Inspect → |
| 223 | front | 14.30 s | 21.27 s | +6.97 s | Inspect → |
| 223 | wrist | 14.30 s | 21.27 s | +6.97 s | Inspect → |
| 468 | front | 5.20 s | 12.13 s | +6.93 s | Inspect → |
| 468 | wrist | 5.20 s | 12.13 s | +6.93 s | Inspect → |
| 145 | front | 8.33 s | 15.10 s | +6.77 s | Inspect → |
| 170 | front | 9.17 s | 15.80 s | +6.63 s | Inspect → |
| 170 | wrist | 9.17 s | 15.80 s | +6.63 s | Inspect → |
| 203 | front | 7.27 s | 13.87 s | +6.60 s | Inspect → |
| 203 | wrist | 7.27 s | 13.87 s | +6.60 s | Inspect → |
| 455 | front | 6.13 s | 12.33 s | +6.20 s | Inspect → |
| 455 | wrist | 6.13 s | 12.33 s | +6.20 s | Inspect → |
| 420 | front | 7.13 s | 13.30 s | +6.17 s | Inspect → |
| 420 | wrist | 7.13 s | 13.30 s | +6.17 s | Inspect → |
| 389 | front | 12.20 s | 18.30 s | +6.10 s | Inspect → |
| 389 | wrist | 12.20 s | 18.30 s | +6.10 s | Inspect → |
| 152 | front | 7.63 s | 13.57 s | +5.93 s | Inspect → |
| 181 | front | 8.03 s | 13.97 s | +5.93 s | Inspect → |
| 181 | wrist | 8.03 s | 13.97 s | +5.93 s | Inspect → |
| 402 | front | 8.50 s | 14.40 s | +5.90 s | Inspect → |
| 402 | wrist | 8.50 s | 14.40 s | +5.90 s | Inspect → |
| 202 | front | 7.80 s | 13.63 s | +5.83 s | Inspect → |
| 202 | wrist | 7.80 s | 13.63 s | +5.83 s | Inspect → |
Longest video intervals up to 4 per signal · times are within the video file
| Signal | Camera | Episode | File | Start | End | Duration | |
|---|---|---|---|---|---|---|---|
| Blur | wrist | – | file-000.mp4 | 11:08.8 | 14:08.1 | 2:59.3 | Inspect → |
| Blur | wrist | – | file-003.mp4 | 0:43.5 | 1:15.9 | 32.4 s | Inspect → |
| Blur | wrist | – | file-004.mp4 | 1:34.1 | 1:58.1 | 24.1 s | Inspect → |
| Blur | wrist | – | file-005.mp4 | 0:05.3 | 0:28.7 | 23.4 s | Inspect → |
Provenance
- Revision
- 7d498de99414e4767c63f3204a3054af702caf79
- Scanned
- 2026-10-10 00:21 UTC · NVIDIA L4
- Flag method
- rule-based-video-events-v1
- Episode method
- episode-motion-v1
- Code
- 9f54cd5fa0437e2c lock 282482d5a82a
Pinned dataset on Hugging Face ↗Result JSONMethodologyReport an issue with this result →