← Selected work

Locomotion & Control

Train and compare humanoid walking policies across simulators, disturbances, and terrain.

FIG. 01 — Step descent with stereo + lidar displays and IMU feedback. Selected simulation rollout at real time.

Result & current limits

R1HO qualified all three fine-tuning seeds: 30/30 turns and 9/9 straight walks, with push qualification also passed. These 22-DoF simulation policies share one parent and use simulator yaw. Separately, 12-DoF randomization recorded 0/360 flat falls versus 77/360 without it. Terrain films are demonstrations; hardware transfer remains unvalidated.

Problem

A high training reward can hide a walking policy that fails in another simulator. Walking, turning, and balance need repeatable checks before a checkpoint is promoted.

Solution

Trained PPO policies in Isaac Lab, exported ONNX, and evaluated them with the upstream deployment controller in MuJoCo. Built randomization studies, terrain rollouts, and qualification gates for turning, straight walking, and pushes. The new terrain films show recorded simulation rollouts; the full-body arms clip uses an existing upstream policy.

What I built

Built task overlays, headless MuJoCo scoring, checkpoint qualification, replay checks, and rollout visualizations. Kept the upstream observation path and published failed gates alongside positive results.

Technologies

More demos, engineering decisions, and evaluation notes

Terrain and full-body rollouts

Dirt relief is about 8 cm; gravel includes 100 physical stones. Footprints are contact-triggered visual marks and do not change collision geometry. The main capture includes 24 robots and eight falls. The arms clip is a separate run using the upstream 22-joint policy. In the descent, stereo/lidar are display-only; native IMU feeds the gait and scripted routes use simulated pose.

FIG. 01A — Gravel traversal: 100 physical stones; footprints are contact-triggered visual effects.
FIG. 01B — Bumpy terrain with about 8 cm of relief. A selected simulation rollout.
FIG. 01C — 22-joint MuJoCo rollout using the upstream full-body policy. Separate demonstration, not a new trained result.
FIG. 01D — Selected 11° ramp traversal. Separate from the scored mild-terrain study.

Training reward and transfer can disagree

The flat-ground study covers five settings and three trained policies per setting. Default randomization transfers better than the unrandomized configuration even when training reward suggests a different ranking. The 0/360 versus 77/360 comparison belongs to the 12-DoF biped study, not to the new full-body clip. Confirmation evidence.

Later R1HO qualifies across three fine-tuning seeds

The command-latched heading recipe passes the declared joint qualification gate for 3/3 fine-tuning seeds: 30/30 turns, 9/9 straight walks, and push falls of 8/60, 9/60, and 8/60. These are 22-DoF simulated policies, with simulator yaw and independently seeded fine-tunes of one selected R1H-s2 parent. They use existing benchmark cases, not a new hardware or from-scratch study. H4 report and source records.

Earlier actor-clock R1 qualified only one of three seeds and failed its recipe gate. That negative result remains in the October 2 record.

Terrain control on held-out mild courses

A separate native FAST-LIO2 study recorded 180/180 clean goals with heading pursuit versus 19/180 for the baseline, within 480 total trials. It uses three frozen 12-DoF actors and 20 reserved reset seeds on flat ground, 1 cm steps, and 3° ramps. Estimated pose feeds control; evaluator truth is separate. This cohort is distinct from the 11° ramp and relief visualizations above. Terrain confirmation.

Corrected stereo pose and a retracted ice claim

Isaac Lab 3.0 read camera quaternions as (x, y, z, w) after they were written (w, x, y, z). Correcting the order pointed stereo down at the terrain. The earlier ice-hazard result is retracted: patches spawned a median 72 m away. The findings ledger preserves both corrections.

These are simulation results, not hardware validation: learned locomotion has not transferred to hardware.

The robot design and upstream controller are from Berkeley Humanoid Lite. Related work: Perception & Navigation and Language-Guided Manipulation.

Links