LeBoard
Leaderboard / SO101 coffee subtask 2

SO101 coffee subtask 2

aailabkaist/so101_coffee_subtask_2rev 7d498de99414486 episodesrobot so_follower1.2 h at 30 fps413,135 camera frames
Camera dropoutShare of frames from live episode cameras that are almost entirely one flat black or white value. A camera blank for a whole episode is counted as absent, shown underneath, not as a dropout. Method →
0
0 frames
BlurShare of camera frames inside an interval at least 0.5 s long where the image is much blurrier than that camera's typical frame. Method →
7.4%
30,372 frames
DarknessShare of camera frames inside an interval at least 0.5 s long where 60% or more of the pixels are near-black. Method →
0
0 frames
FreezeShare of camera frames inside an interval at least 1 s long where the video repeats the exact same image. Method →
0
0 frames
Duration mismatchShare of assessed episode-camera pairs whose metadata video length disagrees with the Parquet frame count by more than 1 frame. A hatched cell with * means only some pairs could be assessed (the small number shows how many); the rest are unknown, not clean. –* means none could be assessed. Method →
60.2%*
242 flagged · only 402 of 972 assessed
Flagged episodesEpisodes flagged by any episode check: actions that never change, a robot that barely moves, non-finite values, broken row indexes or timestamp gaps. The count is on top, its share of assessed episodes underneath. Method →
0
of 486 assessed episodes

Video offsets in this dataset are inconsistent, so video intervals can’t be assigned to episodes. Counts still cover every decoded frame.

All checks

CheckFlaggedShareCoverage
Files 24
Video decoding00complete
Episodes 486
Episode boundaries00complete
Finite action and state00complete
Timestamp gaps00complete
Static actions00complete
Idle episodes00complete
Episode-camera pairs 972
Duration mismatch24260.2%402 assessed
Video/action sync––not measured
Frames 413,135
Camera absent00complete
Camera dropout00complete
Blur30,372248 intervals7.4%complete · episodes can’t be placed
Darkness00complete · episodes can’t be placed
Freeze00complete · episodes can’t be placed

By camera

CameraFramesAbsentDropoutBlurDarknessFreeze
front206,56800000
wrist206,5670014.7%248 intervals00

Evidence

Duration mismatches 100 stored of 242

EpisodeCameraDataMetadata intervalDifference
55front8.37 s253.30 s+244.93 sInspect →
151front6.90 s118.60 s+111.70 sInspect →
190front9.70 s80.20 s+70.50 sInspect →
190wrist9.70 s80.20 s+70.50 sInspect →
451front8.27 s73.80 s+65.53 sInspect →
451wrist8.27 s73.80 s+65.53 sInspect →
366front8.50 s73.63 s+65.13 sInspect →
366wrist8.50 s73.63 s+65.13 sInspect →
Show all 100 stored
EpisodeCameraDataMetadata intervalDifference
401front9.63 s55.00 s+45.37 sInspect →
401wrist9.63 s55.00 s+45.37 sInspect →
192front8.40 s53.63 s+45.23 sInspect →
192wrist8.40 s53.63 s+45.23 sInspect →
70front6.93 s49.77 s+42.83 sInspect →
295front7.50 s36.47 s+28.97 sInspect →
295wrist7.50 s36.47 s+28.97 sInspect →
171front8.67 s33.00 s+24.33 sInspect →
171wrist8.67 s33.00 s+24.33 sInspect →
140front7.47 s31.50 s+24.03 sInspect →
225front9.23 s30.93 s+21.70 sInspect →
225wrist9.23 s30.93 s+21.70 sInspect →
191front10.83 s28.43 s+17.60 sInspect →
191wrist10.83 s28.43 s+17.60 sInspect →
391front10.07 s26.97 s+16.90 sInspect →
391wrist10.07 s26.97 s+16.90 sInspect →
62front6.63 s23.33 s+16.70 sInspect →
141front7.37 s23.07 s+15.70 sInspect →
150front6.67 s22.33 s+15.67 sInspect →
193front8.20 s23.10 s+14.90 sInspect →
193wrist8.20 s23.10 s+14.90 sInspect →
15front8.70 s22.47 s+13.77 sInspect →
15wrist8.70 s22.47 s+13.77 sInspect →
419front9.07 s20.93 s+11.87 sInspect →
419wrist9.07 s20.93 s+11.87 sInspect →
195front7.83 s19.63 s+11.80 sInspect →
195wrist7.83 s19.63 s+11.80 sInspect →
45front7.53 s19.00 s+11.47 sInspect →
411front7.50 s18.27 s+10.77 sInspect →
411wrist7.50 s18.27 s+10.77 sInspect →
50front7.33 s17.93 s+10.60 sInspect →
144front8.97 s19.50 s+10.53 sInspect →
199front9.27 s19.53 s+10.27 sInspect →
199wrist9.27 s19.53 s+10.27 sInspect →
238front9.53 s19.73 s+10.20 sInspect →
238wrist9.53 s19.73 s+10.20 sInspect →
135front6.63 s16.40 s+9.77 sInspect →
85front12.73 s22.43 s+9.70 sInspect →
85wrist12.73 s22.43 s+9.70 sInspect →
222front10.37 s20.03 s+9.67 sInspect →
222wrist10.37 s20.03 s+9.67 sInspect →
393front11.40 s21.07 s+9.67 sInspect →
393wrist11.40 s21.07 s+9.67 sInspect →
229front8.37 s17.60 s+9.23 sInspect →
229wrist8.37 s17.60 s+9.23 sInspect →
204front7.67 s16.70 s+9.03 sInspect →
204wrist7.67 s16.70 s+9.03 sInspect →
461front5.43 s14.33 s+8.90 sInspect →
461wrist5.43 s14.33 s+8.90 sInspect →
210front12.60 s21.47 s+8.87 sInspect →
210wrist12.60 s21.47 s+8.87 sInspect →
386front14.57 s23.43 s+8.87 sInspect →
386wrist14.57 s23.43 s+8.87 sInspect →
392front13.27 s22.10 s+8.83 sInspect →
392wrist13.27 s22.10 s+8.83 sInspect →
196front8.80 s17.50 s+8.70 sInspect →
196wrist8.80 s17.50 s+8.70 sInspect →
406front8.63 s16.87 s+8.23 sInspect →
406wrist8.63 s16.87 s+8.23 sInspect →
353front8.50 s16.63 s+8.13 sInspect →
353wrist8.50 s16.63 s+8.13 sInspect →
100front10.33 s18.37 s+8.03 sInspect →
100wrist10.33 s18.37 s+8.03 sInspect →
208front7.57 s15.57 s+8.00 sInspect →
208wrist7.57 s15.57 s+8.00 sInspect →
221front9.97 s17.23 s+7.27 sInspect →
221wrist9.97 s17.23 s+7.27 sInspect →
153front8.30 s15.50 s+7.20 sInspect →
207front7.63 s14.77 s+7.13 sInspect →
207wrist7.63 s14.77 s+7.13 sInspect →
223front14.30 s21.27 s+6.97 sInspect →
223wrist14.30 s21.27 s+6.97 sInspect →
468front5.20 s12.13 s+6.93 sInspect →
468wrist5.20 s12.13 s+6.93 sInspect →
145front8.33 s15.10 s+6.77 sInspect →
170front9.17 s15.80 s+6.63 sInspect →
170wrist9.17 s15.80 s+6.63 sInspect →
203front7.27 s13.87 s+6.60 sInspect →
203wrist7.27 s13.87 s+6.60 sInspect →
455front6.13 s12.33 s+6.20 sInspect →
455wrist6.13 s12.33 s+6.20 sInspect →
420front7.13 s13.30 s+6.17 sInspect →
420wrist7.13 s13.30 s+6.17 sInspect →
389front12.20 s18.30 s+6.10 sInspect →
389wrist12.20 s18.30 s+6.10 sInspect →
152front7.63 s13.57 s+5.93 sInspect →
181front8.03 s13.97 s+5.93 sInspect →
181wrist8.03 s13.97 s+5.93 sInspect →
402front8.50 s14.40 s+5.90 sInspect →
402wrist8.50 s14.40 s+5.90 sInspect →
202front7.80 s13.63 s+5.83 sInspect →
202wrist7.80 s13.63 s+5.83 sInspect →

Longest video intervals up to 4 per signal · times are within the video file

SignalCameraEpisodeFileStartEndDuration
Blurwrist–file-000.mp411:08.814:08.12:59.3Inspect →
Blurwrist–file-003.mp40:43.51:15.932.4 sInspect →
Blurwrist–file-004.mp41:34.11:58.124.1 sInspect →
Blurwrist–file-005.mp40:05.30:28.723.4 sInspect →

Provenance

Revision
7d498de99414e4767c63f3204a3054af702caf79
Scanned
2026-10-10 00:21 UTC · NVIDIA L4
Flag method
rule-based-video-events-v1
Episode method
episode-motion-v1
Code
9f54cd5fa0437e2c lock 282482d5a82a