Skip to content

Commit 8ebd2ff

Browse files
Jammy2211claude
authored andcommitted
prompt(research/graphical_ep): hand-fixed header + grounding for EP hierarchical slope prompt
Type docs→research, Target PyAutoLens→graphical_ep, verified concr paths, added sampler-decision, HPC/RAL and backlog-relationship grounding. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
1 parent f0a3eef commit 8ebd2ff

3 files changed

Lines changed: 104 additions & 19 deletions

File tree

active/rename_the_morning_skill_to_wake_up.md

Lines changed: 0 additions & 14 deletions
This file was deleted.
Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
## wake-up-skill-rename
2+
- issue: https://github.com/PyAutoLabs/PyAutoBrain/issues/114 (closed)
3+
- completed: 2026-07-16
4+
- library-pr: https://github.com/PyAutoLabs/PyAutoBrain/pull/115 (merged 6caa6c4, merge commit)
5+
- repos: PyAutoBrain
6+
- summary: Renamed the /morning composition skill to /wake_up to fit the organism analogy (the organism wakes: syncs its body, checks its vitals, remembers what it was doing). Pure behaviour-preserving rename: skills/morning/ -> skills/wake_up/ (body file + SKILL.md name), /morning references updated in COMMANDS.md, AGENTS.md, AUTONOMY.md, bin/overnight_status.sh and nightly.sh comments. Deliberately untouched: Heart's morning_health/morning_status Slack webhooks (separately named automation), historical Mind records, time-of-day prose, and the SKILL.md discovery trigger "morning status/cleanup pass". Post-merge: bin/install.sh re-run refreshed the ~/.claude surfaces; stale morning symlinks pruned.
7+
8+
## Original prompt
9+
10+
# Rename the morning skill to wake_up (PyAutoBrain)
11+
12+
Type: refactor
13+
Target: PyAutoBrain
14+
Repos:
15+
- PyAutoBrain
16+
Difficulty: small
17+
Autonomy: supervised
18+
Priority: normal
19+
Status: formalised
20+
21+
Rename the morning skill to wake_up in @PyAutoBrain (skills/morning/ -> skills/wake_up/), adjusting all linked files accordingly (symlinks in ~/.claude/commands and ~/.claude/skills, COMMANDS.md, AGENTS.md, AUTONOMY.md, bin/overnight_status.sh, nightly.sh references) so it fits the PyAutoScientist organism analogy. The skill is proving very valuable; keep behaviour identical. Include a short assessment of what else the skill could absorb without becoming information overload.
22+
23+
<!-- formalised by the Intake (Conception) Agent on 2026-07-16 from user-intake -->

draft/research/graphical_ep/ep_hierarchical_power_law_slopes.md

Lines changed: 81 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,19 @@
1-
# I want to use the autolens_assistant to perform Expectation Propagation
1+
# EP hierarchical power-law slope recovery — autolens_assistant science project
22

3-
Type: docs
4-
Target: PyAutoLens
3+
Type: research
4+
Target: graphical_ep
55
Repos:
6-
- PyAutoLens
76
- autolens_assistant
7+
- PyAutoFit
8+
- PyAutoLens
89
- autolens_workspace
910
Difficulty: too-large
1011
Autonomy: supervised
1112
Priority: high
1213
Status: formalised
1314

15+
## Original request (verbatim)
16+
1417
I want to use the autolens_assistant to perform Expectation Propagation (EP) analysis of a Cosmology science case.
1518

1619
The science case is inferring the Hubble constant from time delay lensed quasars, and a example package already
@@ -40,4 +43,77 @@ The goal are:
4043

4144
4) To test all the graphical EP diagnostics and result analysis code, especially tyhe recent EP updates we did last week.
4245

43-
<!-- formalised by the Intake (Conception) Agent on 2026-07-16 from file:/tmp/claude-1000/-home-jammy-Code-PyAutoLabs/32708468-5918-4dbc-a763-583805364341/scratchpad/intake_ep_cosmology.md -->
46+
## Intake corrections & grounding (2026-07-16)
47+
48+
**Corrected source paths** (verified on disk; the request has typos):
49+
50+
- Legacy EP scripts: `/mnt/c/Users/Jammy/Science/concr/scripts/cosmology/`
51+
`ep.py`, `graphical.py`, `one_by_one.py`, `simple_plot.py`. These are the
52+
"main scripts" to port: EP fit, joint graphical fit, and one-by-one fits.
53+
- Legacy simulator: `/mnt/c/Users/Jammy/Science/concr/simulators/cosmology.py`;
54+
an existing simulated dataset lives at `concr/dataset/cosmology__time_delay`.
55+
- Workspace examples: `autolens_workspace/scripts/guides/modeling/advanced/`
56+
`expectation_propagation.py`, `graphical.py`, `hierarchical.py`.
57+
- Expect API drift in the `concr` package (old PyAutoLens); brush up against
58+
the installed stack, grounding via the PyAuto API gate / `dir()` rather than
59+
guessing.
60+
61+
**Descoped goal (this task).** No H0 / time delays yet. Simulate N power-law +
62+
shear lenses with slopes drawn from a hierarchical (parent) distribution;
63+
example scripts recover the per-lens slopes and — the primary metric — the
64+
mean and scatter of the parent slope distribution. Keep the project layout
65+
H0-compatible so time-delay cosmography can be re-scoped in later.
66+
67+
**Project home.** New science project stamped from
68+
`autolens_assistant/skills/start-new-project.md` (project skeleton: `scripts/`,
69+
`dataset/`, `results/`, `hpc/`, `wiki/project/profile.md`). Private science
70+
project, same pattern as PJ011646.
71+
72+
**Goal 1 sampler — the `(SPECIFY)` decision, to settle at start_dev.**
73+
Candidates now first-class in PyAutoFit: multi-start JAX gradient optimizers
74+
(`MultiStartAdam` / ADABelief / Lion — promoted across lib + workspaces) for
75+
MAP-style recovery, and gradient-based posterior sampling (blackjax NUTS/HMC)
76+
for errors. The non-EP baseline must produce parent mean+scatter *with
77+
uncertainties*, so a sampling (not just optimization) path is needed for the
78+
comparison in goal 2.
79+
80+
**Goal 4 context.** The "recent EP updates last week" are the diagnostics /
81+
result-analysis work shipped under `ep_framework_review.md` (this folder,
82+
execution-complete 2026-07-08, wrap-up on PyAutoFit#1330). This project is the
83+
end-to-end exercise of that shipped tooling on a realistic lensing case.
84+
85+
**HPC (goal 3).** Run path is RAL via the assistant HPC link:
86+
87+
- Cluster access: SSH alias `euclid_jump` (ProxyJump through `jump_finan`);
88+
projects under `/mnt/ral/jnightin/<project>`; PyAuto venv at
89+
`/mnt/ral/jnightin/PyAuto` kept in sync with local `main`s (`HPCPullPyAuto`),
90+
activated via `activate.sh` (never pip-install PyAuto* into the venv).
91+
- Project machinery: copy the assistant's `hpc/` (batch_cpu/, batch_gpu/,
92+
`sync`, `template.py`) into the new project per the start-new-project HPC
93+
step; docs at `autolens_assistant/wiki/core/operations/hpc_infrastructure.md`.
94+
Pipeline scripts must preserve the `template.py` HPC interface
95+
(`parse_fit_args`, `--sample`/`--dataset`/`--use_cpu`/`--number_of_cores`).
96+
- Drive runs with `hpc/sync push-submit gpu <script>` (SLURM array, one
97+
dataset per task, JAX auto-uses the GPU), then `hpc/sync jobs`/`tail`/`pull`.
98+
The legacy `concr/hpc/` uses the same layout — port its `sync.conf` pattern,
99+
not its stale scripts.
100+
- RAL `/mnt/ral` is NFS-slow: detach long remote work (nohup+setsid, poll a
101+
log), never foreground-`timeout` an ssh.
102+
- N-lens array scaling is the design driver: one lens per SLURM array task for
103+
the one-by-one/EP factor fits; the joint graphical fit needs a single
104+
larger-memory task.
105+
106+
**Relationship to existing backlog** (this folder):
107+
108+
- `ep_scoping.md` — EP per-fit overhead / scale-up (performance): directly
109+
relevant once N grows; do not duplicate its profiling work here.
110+
- `graphical_scoping.md` — joint-graph scale-up (performance): the joint-fit
111+
baseline in goal 1/2 will hit exactly the dimensionality limits it maps.
112+
- `ep_framework_review.md` — execution-complete; its diagnostics are what
113+
goal 4 validates.
114+
115+
**Sizing.** too-large is right: expect phased delivery at start_dev
116+
(project stamp + simulator port → one-by-one/JAX-gradient baseline → EP fit +
117+
diagnostics → HPC scale-up), one PR per phase.
118+
119+
<!-- formalised by the Intake (Conception) Agent on 2026-07-16 from file:/tmp/claude-1000/-home-jammy-Code-PyAutoLabs/32708468-5918-4dbc-a763-583805364341/scratchpad/intake_ep_cosmology.md; header + grounding hand-fixed at review (docs/autolens → research/graphical_ep) -->

0 commit comments

Comments
 (0)