You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A new manipulation example that demonstrates calibrated uncertainty as a
runtime "ask for help" signal. The agent offline-calibrates a conformal
threshold q_hat from a small holdout, then for each item on a toy
conveyor builds a prediction set {c : score_c >= 1 - q_hat}. Singletons
are placed directly; non-singletons trigger an ask of a toy oracle that
returns the true label.
This is structurally different from 08_belief_grasp_selection.py and
09_active_viewpoint_for_grasp.py, which reduce uncertainty by acting in
the world (another grasp, another viewpoint). Here uncertainty is
reduced by deferring to a human.
Exposes counters q_hat, sorted_count, help_request_count,
correct_no_help_count, correct_after_help_count, wrong_sort_count, and
coverage_violation_count. Structured failures: wrong_sort (recoverable
- the agent committed without asking and got the wrong bin), timeout,
invalid_action.
Tests: smoke test pins seed=0 and asserts sorted_count=16,
help_request_count>=1, no wrong sorts or coverage violations, that the
ask action (2) actually appears, and that both singleton and
non-singleton prediction sets are produced. A second test verifies
empirical 1-alpha coverage on the calibration set by construction.
Counts: 33 examples / 32 GIFs / 82 tests / 11 manipulation examples.
Copy file name to clipboardExpand all lines: docs/implementation_gap_audit.md
+6-4Lines changed: 6 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,10 +6,10 @@ continuous-control Gymnasium adapter, and the curiosity exploration example.
6
6
7
7
## Current Stable Surface
8
8
9
-
-32 runnable examples
10
-
- 20 numbered learning-path examples plus 12 extras
11
-
-31 generated README GIFs with nonblank checks
12
-
-80 smoke, adapter, and regression tests
9
+
-33 runnable examples
10
+
- 20 numbered learning-path examples plus 13 extras
11
+
-32 generated README GIFs with nonblank checks
12
+
-82 smoke, adapter, and regression tests
13
13
- CI green on Python 3.10, 3.11, and 3.12
14
14
- Gymnasium-style adapters for `GridWorld2D`, `DynamicObstacleGridWorld`,
15
15
`BlockedPathWorld`, `MovingObstacleWorld`, and `Tabletop2D`
@@ -35,6 +35,8 @@ continuous-control Gymnasium adapter, and the curiosity exploration example.
35
35
|`27_multi_agent_avoidance.py`| A* over predicted-next cells of two goal-seeking agents. |
36
36
|`MovingObstacleWorld` extraction | Moved from the example file into `pir/worlds/moving_obstacle.py`, with `MovingObstacleWorldGymnasiumAdapter` and five adapter tests. |
37
37
|`28_curiosity_grid_exploration.py`| Visit-count-driven novelty target selection with A* commitment. |
38
+
|`29_safety_filter_cbf.py`| Runtime CBF safety filter on a nominal go-to-goal policy; `dh/dt >= -alpha * h` projection per obstacle. |
39
+
|`30_conformal_ask_for_help.py`| Offline conformal calibration; place when the prediction set is a singleton, defer to a toy oracle when not. Counters: `q_hat`, `help_request_count`, `coverage_violation_count`. |
0 commit comments