Leaderboard / libero plus
libero plus
Camera dropoutShare of frames from live episode cameras that are almost entirely one flat black or white value. A camera blank for a whole episode is counted as absent, shown underneath, not as a dropout. Method →
0
0 frames
BlurShare of camera frames inside an interval at least 0.5 s long where the image is much blurrier than that camera's typical frame. Method →
11.8%
526,877 frames
DarknessShare of camera frames inside an interval at least 0.5 s long where 60% or more of the pixels are near-black. Method →
0.2%
6,770 frames
FreezeShare of camera frames inside an interval at least 1 s long where the video repeats the exact same image. Method →
<0.1%
1,807 frames
Duration mismatchShare of assessed episode-camera pairs whose metadata video length disagrees with the Parquet frame count by more than 1 frame. A hatched cell with * means only some pairs could be assessed (the small number shows how many); the rest are unknown, not clean. –* means none could be assessed. Method →
0
0 of 28,694 assessed
Flagged episodesEpisodes flagged by any episode check: actions that never change, a robot that barely moves, non-finite values, broken row indexes or timestamp gaps. The count is on top, its share of assessed episodes underneath. Method →
0
of 14,347 assessed episodes
All checks
| Check | Flagged | Share | Coverage |
|---|---|---|---|
| Files 76 | |||
| Video decoding | 0 | 0 | complete |
| Episodes 14,347 | |||
| Episode boundaries | 0 | 0 | complete |
| Finite action and state | 0 | 0 | complete |
| Timestamp gaps | 0 | 0 | complete |
| Static actions | 0 | 0 | complete |
| Idle episodes | 0 | 0 | complete |
| Episode-camera pairs 28,694 | |||
| Duration mismatch | 0 | 0 | complete |
| Video/action sync | – | – | not measured |
| Frames 4,476,072 | |||
| Camera absent | 0 | 0 | complete |
| Camera dropout | 0 | 0 | complete |
| Blur | 526,8778,033 intervals | 11.8% | complete |
| Darkness | 6,77097 intervals | 0.2% | complete |
| Freeze | 1,80745 intervals | <0.1% | complete |
By camera
| Camera | Frames | Absent | Dropout | Blur | Darkness | Freeze |
|---|---|---|---|---|---|---|
| front | 2,238,036 | 0 | 0 | 14.5%3,482 intervals | <0.1%2 intervals | 0.1%45 intervals |
| wrist | 2,238,036 | 0 | 0 | 9.0%4,551 intervals | 0.3%95 intervals | 0 |
Evidence
Longest video intervals up to 4 per signal · times are within the video file
| Signal | Camera | Episode | File | Start | End | Duration | |
|---|---|---|---|---|---|---|---|
| Blur | front | 10715 | file-030.mp4 | 1:39.8 | 2:02.6 | 22.8 s | Inspect → |
| Blur | front | 9043 | file-025.mp4 | 13:05.1 | 13:27.9 | 22.7 s | Inspect → |
| Blur | front | 11094 | file-031.mp4 | 4:33.4 | 4:55.8 | 22.4 s | Inspect → |
| Blur | front | 5761 | file-016.mp4 | 11:26.4 | 11:48.8 | 22.4 s | Inspect → |
| Darkness | wrist | 8339 | file-020.mp4 | 25:47.5 | 25:56.0 | 8.5 s | Inspect → |
| Darkness | wrist | 7873 | file-019.mp4 | 19:34.7 | 19:43.2 | 8.5 s | Inspect → |
| Darkness | wrist | 3971 | file-009.mp4 | 42:33.6 | 42:39.9 | 6.3 s | Inspect → |
| Darkness | wrist | 2545 | file-006.mp4 | 13:23.1 | 13:29.4 | 6.3 s | Inspect → |
| Freeze | front | 10178 | file-028.mp4 | 26:47.3 | 26:52.0 | 4.7 s | Inspect → |
| Freeze | front | 5163 | file-014.mp4 | 28:32.2 | 28:36.2 | 4.0 s | Inspect → |
| Freeze | front | 1455 | file-004.mp4 | 7:10.6 | 7:13.9 | 3.3 s | Inspect → |
| Freeze | front | 13332 | file-037.mp4 | 7:09.1 | 7:12.0 | 2.9 s | Inspect → |
Provenance
- Revision
- f3f49f426d75030177b18778374005bc12ccd588 (main)
- Scanned
- 2026-10-10 00:34 UTC · NVIDIA RTX PRO 6000 Blackwell Server Edition
- Flag method
- rule-based-video-events-v1
- Episode method
- episode-motion-v1
- Code
- 9f54cd5fa0437e2c lock 282482d5a82a
Pinned dataset on Hugging Face ↗Result JSONMethodologyReport an issue with this result →