Skip to content

Latest commit

 

History

History
83 lines (69 loc) · 7.58 KB

File metadata and controls

83 lines (69 loc) · 7.58 KB

Examples

Each example is a small closed-loop robotics lesson. All examples provide a run(...) function for notebooks/tests and a script entry point for direct use.

Run any example headless with its --no-render flag when available.

Runtime

Example Run Loop
runtime/01_sense_act_loop.py python examples/runtime/01_sense_act_loop.py observe -> act -> observe
runtime/26_trace_replay.py python examples/runtime/26_trace_replay.py run loop -> record trace -> replay

Navigation

Example Run Loop
navigation/02_reactive_obstacle_avoidance.py python examples/navigation/02_reactive_obstacle_avoidance.py fake lidar -> reactive avoidance
navigation/03_dynamic_obstacle_avoidance.py python examples/navigation/03_dynamic_obstacle_avoidance.py observe moving obstacle -> avoid -> observe again
navigation/04_online_replanning_astar.py python examples/navigation/04_online_replanning_astar.py map update -> A* replanning
navigation/05_frontier_exploration.py python examples/navigation/05_frontier_exploration.py choose frontier -> observe unknown space
navigation/06_belief_based_navigation.py python examples/navigation/06_belief_based_navigation.py update pose belief -> choose action
navigation/07_active_slam_toy.py python examples/navigation/07_active_slam_toy.py act to reduce map and pose uncertainty
navigation/08_interactive_mpc.py python examples/navigation/08_interactive_mpc.py predict -> control -> replan
navigation/09_blocked_path_recovery.py python examples/navigation/09_blocked_path_recovery.py detect blocked path -> recover -> replan
navigation/10_localization_uncertainty_recovery.py python examples/navigation/10_localization_uncertainty_recovery.py ambiguous pose -> information action -> resume goal
navigation/24_information_gain_navigation.py python examples/navigation/24_information_gain_navigation.py scout observation -> reveal gate -> A* with full info
navigation/27_multi_agent_avoidance.py python examples/navigation/27_multi_agent_avoidance.py observe agents -> predict next -> A* around predictions
navigation/29_safety_filter_cbf.py python examples/navigation/29_safety_filter_cbf.py nominal u -> CBF projection -> safe u
navigation/31_options_with_interrupts.py python examples/navigation/31_options_with_interrupts.py option β / interrupt -> dock_and_charge -> resume go_to_goal
navigation/34_human_correction_replanning.py python examples/navigation/34_human_correction_replanning.py plan shortcut -> human correction -> cost update -> replan
navigation/38_monte_carlo_localization.py python examples/navigation/38_monte_carlo_localization.py particle filter -> kidnapped -> inject particles -> recover
navigation/40_potential_field_escape.py python examples/navigation/40_potential_field_escape.py gradient descent -> local minimum -> boundary follow -> goal
navigation/41_rrt_replanning.py python examples/navigation/41_rrt_replanning.py RRT plan -> sense hidden obstacle -> path blocked -> replan

Manipulation

Example Run Loop
manipulation/01_pick_and_retry.py python examples/manipulation/01_pick_and_retry.py grasp miss -> belief update -> retry
manipulation/02_reactive_grasping.py python examples/manipulation/02_reactive_grasping.py visual servo -> miss -> correct -> grasp
manipulation/03_closed_loop_ik.py python examples/manipulation/03_closed_loop_ik.py observe target -> Jacobian step -> observe error
manipulation/04_moving_target_reaching.py python examples/manipulation/04_moving_target_reaching.py estimate velocity -> predict through occlusion -> reach
manipulation/05_object_search_and_pick.py python examples/manipulation/05_object_search_and_pick.py search viewpoint -> memory -> pick -> retry
manipulation/06_push_then_grasp.py python examples/manipulation/06_push_then_grasp.py blocked grasp -> push world -> grasp
manipulation/07_probabilistic_suction_sorting.py python examples/manipulation/07_probabilistic_suction_sorting.py suction miss -> update probability -> prepare -> sort
manipulation/08_belief_grasp_selection.py python examples/manipulation/08_belief_grasp_selection.py pose belief -> grasp choice -> miss -> update -> retry
manipulation/09_active_viewpoint_for_grasp.py python examples/manipulation/09_active_viewpoint_for_grasp.py choose view -> reduce occlusion -> grasp
manipulation/25_clear_path_before_pick.py python examples/manipulation/25_clear_path_before_pick.py try pick -> precondition fails -> clear obstacle -> retry
manipulation/30_conformal_ask_for_help.py python examples/manipulation/30_conformal_ask_for_help.py conformal calibration -> prediction set -> ask oracle when ambiguous
manipulation/37_behavior_tree_recovery.py python examples/manipulation/37_behavior_tree_recovery.py reactive behavior tree -> grasp fails -> fallback re-looks -> retry

Embodied AI

Example Run Loop
embodied_ai/01_goal_command_pick.py python examples/embodied_ai/01_goal_command_pick.py "find the red block and pick it" parse goal -> search -> pick -> retry
embodied_ai/10_door_search_pomdp.py python examples/embodied_ai/10_door_search_pomdp.py room belief -> door/container action -> belief update
embodied_ai/18_goal_conditioned_minikitchen.py python examples/embodied_ai/18_goal_conditioned_minikitchen.py "bring mug to table" goal -> container search -> pick -> place
embodied_ai/19_tiny_vla_loop.py python examples/embodied_ai/19_tiny_vla_loop.py "place red block in blue bin" language -> visual tokens -> skill -> retry
embodied_ai/21_object_permanence_toy.py python examples/embodied_ai/21_object_permanence_toy.py see object -> memory persists across occlusion -> peek
embodied_ai/28_curiosity_grid_exploration.py python examples/embodied_ai/28_curiosity_grid_exploration.py visit counts -> novelty score -> A* to novel cell -> coverage
embodied_ai/32_empowerment_navigation.py python examples/embodied_ai/32_empowerment_navigation.py k-step empowerment -> shaped A* -> prefer open routes
embodied_ai/33_inverse_reward_from_demo.py python examples/embodied_ai/33_inverse_reward_from_demo.py demo feature expectation -> learned weights -> shaped A* to new goal
embodied_ai/35_clarifying_question.py python examples/embodied_ai/35_clarifying_question.py "pick the block" --answer red ambiguous command -> ask question -> answer -> act
embodied_ai/36_household_task_agent.py python examples/embodied_ai/36_household_task_agent.py "put the block away" --answer red clarify -> plan -> safety check -> retry -> human replan
embodied_ai/39_saycan_affordance_grounding.py python examples/embodied_ai/39_saycan_affordance_grounding.py LLM score x affordance -> feasible skill -> retry slip -> goal

World Models

Example Run Loop
world_models/20_tiny_world_model_planning.py python examples/world_models/20_tiny_world_model_planning.py predict -> act -> observe model error -> update -> replan
world_models/23_model_error_recovery.py python examples/world_models/23_model_error_recovery.py predict -> error spike -> probe -> update model -> resume

Verification

pip install -e ".[dev]"
python scripts/run_all_smoke_tests.py
python scripts/run_all_smoke_tests.py --gifs --check-gifs