Locomotion & Control
Train and compare humanoid walking policies across simulators, disturbances, and terrain.
Result & current limits
R1HO qualified all three fine-tuning seeds: 30/30 turns and 9/9 straight walks, with push qualification also passed. These 22-DoF simulation policies share one parent and use simulator yaw. Separately, 12-DoF randomization recorded 0/360 flat falls versus 77/360 without it. Terrain films are demonstrations; hardware transfer remains unvalidated.
Problem
A high training reward can hide a walking policy that fails in another simulator. Walking, turning, and balance need repeatable checks before a checkpoint is promoted.
Solution
Trained PPO policies in Isaac Lab, exported ONNX, and evaluated them with the upstream deployment controller in MuJoCo. Built randomization studies, terrain rollouts, and qualification gates for turning, straight walking, and pushes. The new terrain films show recorded simulation rollouts; the full-body arms clip uses an existing upstream policy.
What I built
Built task overlays, headless MuJoCo scoring, checkpoint qualification, replay checks, and rollout visualizations. Kept the upstream observation path and published failed gates alongside positive results.
Technologies
More demos, engineering decisions, and evaluation notes
Terrain and full-body rollouts
Dirt relief is about 8 cm; gravel includes 100 physical stones. Footprints are contact-triggered visual marks and do not change collision geometry. The main capture includes 24 robots and eight falls. The arms clip is a separate run using the upstream 22-joint policy. In the descent, stereo/lidar are display-only; native IMU feeds the gait and scripted routes use simulated pose.
Training reward and transfer can disagree
The flat-ground study covers five settings and three trained policies per setting. Default randomization transfers better than the unrandomized configuration even when training reward suggests a different ranking. The 0/360 versus 77/360 comparison belongs to the 12-DoF biped study, not to the new full-body clip. Confirmation evidence.
Later R1HO qualifies across three fine-tuning seeds
The command-latched heading recipe passes the declared joint qualification gate for 3/3 fine-tuning seeds: 30/30 turns, 9/9 straight walks, and push falls of 8/60, 9/60, and 8/60. These are 22-DoF simulated policies, with simulator yaw and independently seeded fine-tunes of one selected R1H-s2 parent. They use existing benchmark cases, not a new hardware or from-scratch study. H4 report and source records.
Earlier actor-clock R1 qualified only one of three seeds and failed its recipe gate. That negative result remains in the October 2 record.
Terrain control on held-out mild courses
A separate native FAST-LIO2 study recorded 180/180 clean goals with heading pursuit versus 19/180 for the baseline, within 480 total trials. It uses three frozen 12-DoF actors and 20 reserved reset seeds on flat ground, 1 cm steps, and 3° ramps. Estimated pose feeds control; evaluator truth is separate. This cohort is distinct from the 11° ramp and relief visualizations above. Terrain confirmation.
Corrected stereo pose and a retracted ice claim
Isaac Lab 3.0 read camera quaternions as (x, y, z, w) after they were written
(w, x, y, z). Correcting the order pointed stereo down at the terrain. The
earlier ice-hazard result is retracted: patches spawned a median 72 m away.
The findings ledger
preserves both corrections.
These are simulation results, not hardware validation: learned locomotion has not transferred to hardware.
The robot design and upstream controller are from Berkeley Humanoid Lite. Related work: Perception & Navigation and Language-Guided Manipulation.