vision robustnessvla-robustness-kit
Camera shift causes VLA failure cluster
camera_shift appears as a repeated failure cluster
vla-robustness-kit run examples/mock_episode_set --policy mock --out report.md
Read the synthetic and approved failure cases here, free, in the browser. The real review — your own teleop and VLA datasets — runs in Robotics Studio on your machine. Your data stays local. Nothing is pooled on our servers.
camera_shift appears as a repeated failure cluster
vla-robustness-kit run examples/mock_episode_set --policy mock --out report.md
episode is excluded until dropped frames and action gaps are reviewed
lerobot-quality-gates scan examples/so101_quality_gate --format markdown --out report.md
AV sync warning is attached before the reviewed subset is exported
robostudio inspect examples/mock_multi_format/lerobot_v3 --sensor-qa --out qa.md
manual recovery span must be labeled before benchmark scoring
robot-recovery-bench score examples/recovery_episode --taxonomy intervention --out recovery.md