Skip to content

PreOptimizationTimes runtime baseline — imaging + interferometer + datacube (local CPU) #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Jammy2211 merged 7 commits into from
Jul 11, 2026
Merged

PreOptimizationTimes runtime baseline — imaging + interferometer + datacube (local CPU) #62

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
39544d6
maint: sweep instrument axis + build_baseline snapshot tool (#56)
Jul 8, 2026
5d35288
maint: sweep --skip-existing — resume interrupted campaigns without r…
Jul 8, 2026
6d1a2ef
fix: drop inherently-blocked mge alma+ cells from the campaign grid (…
Jul 9, 2026
3831550
maint: CPU-usability policy — timeout-and-classify, GPU-only tier (#56)
Jul 9, 2026
71f2ccd
fix: array-safe check_pinned + cell-prefixed config stems in aggregat…
Jul 9, 2026
1bc3fca
data(profiling): datacube delaunay runtime results — sma fp64/mp + al…
Jul 11, 2026
2717148
data(profiling): freeze PreOptimizationTimes runtime baseline (#56)
Jul 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 16 additions & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,12 +28,27 @@ Results are framed by **astronomy instrument** (HST, Euclid, JWST, …) rather t

**Likelihood runtime** — full-pipeline per-call cost per cell × config:

_No data yet — run `likelihood_runtime/sweep.py` then `aggregate.py` to populate._
| Cell | local_cpu_fp64 | local_cpu_mp | local_cpu_fp64_sparse | local_cpu_mp_sparse | PreOptimizationTimes |
|---|---|---|---|---|---|
| `datacube/delaunay/sma` | — | — | — | — | — |
| `imaging/delaunay/hst` | 16.73 s | 17.84 s | 4.14 s | 4.49 s | 4.49 s |
| `imaging/delaunay/jwst` | 48.81 s | 22.43 s | 10.42 s | 14.05 s | 14.05 s |
| `imaging/mge/ao` | 3.11 s | 5.71 s | — | — | 5.71 s |
| `imaging/mge/hst` | 117.7 ms | 164.3 ms | 256.1 ms | 140.5 ms | 140.5 ms |
| `imaging/mge/jwst` | 716.2 ms | 678.5 ms | 387.3 ms | 488.7 ms | 488.7 ms |
| `imaging/pixelization/hst` | 13.72 s | 14.78 s | 5.79 s | 5.25 s | 5.25 s |
| `imaging/pixelization/jwst` | 21.78 s | 43.58 s | 9.57 s | 9.42 s | 9.42 s |
| `interferometer/delaunay/alma` | **GPU-only** | 6.51 s | — | — | 6.51 s |
| `interferometer/delaunay/sma` | 2.58 s | 3.34 s | — | — | 3.34 s |
| `interferometer/mge/sma` | 230.7 ms | 231.5 ms | — | — | 231.5 ms |
| `interferometer/pixelization/sma` | 2.04 s | 2.39 s | — | — | 2.39 s |

**Likelihood breakdown** — latest per-step decompositions:

| Cell | Instrument | Inversion path | Step-sum total | PyAutoLens version |
|------|------------|----------------|----------------|--------------------|
| `cluster/image_plane` | — | dense (mapping) | 4.99 s | v2026.7.6.649 |
| `cluster/source_plane` | — | dense (mapping) | 3.1 ms | v2026.7.6.649 |
| `imaging/delaunay` | hst | dense (mapping) | 11.29 s | v2026.5.29.4 |
| `imaging/delaunay` | hst | sparse (w-tilde) | 7.96 s | v2026.5.29.4 |
| `imaging/mge` | hst | dense (mapping) | 178.2 ms | v2026.5.29.4 |
Expand Down
7 changes: 5 additions & 2 deletions _profile_cli.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -271,8 +271,11 @@ def check_pinned(got, expected, *, label: str, rtol: float = 1e-4):
profiling job (the timing numbers are still data; the flag marks them
non-comparable to the pinned baseline).
"""
got_f = float(got)
rel = abs(got_f - expected) / max(abs(expected), 1e-300)
import numpy as _np

arr = _np.asarray(got, dtype=float).ravel()
rel = float(_np.max(_np.abs(arr - expected)) / max(abs(expected), 1e-300))
got_f = float(arr[0]) if arr.size == 1 else float(arr[int(_np.argmax(_np.abs(arr - expected)))])
if rel <= rtol:
return None
print(
Expand Down
Binary file added dataset/imaging/ao/data.fits
View file
Open in desktop
Binary file not shown.
Binary file added dataset/imaging/ao/noise_map.fits
View file
Open in desktop
Binary file not shown.
28 changes: 28 additions & 0 deletions dataset/imaging/ao/positions.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
{
"type": "instance",
"class_path": "autoarray.structures.grids.irregular_2d.Grid2DIrregular",
"arguments": {
"values": {
"type": "ndarray",
"array": [
[
-1.499375,
0.19521655976974225
],
[
-0.270625,
-1.673233248895184
],
[
0.270625,
1.6732332488951842
],
[
1.499375,
-0.1952165597697422
]
],
"dtype": "float64"
}
}
}
Binary file added dataset/imaging/ao/psf.fits
View file
Open in desktop
Binary file not shown.
110 changes: 110 additions & 0 deletions dataset/imaging/ao/tracer.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,110 @@
{
"type": "instance",
"class_path": "autolens.lens.tracer.Tracer",
"arguments": {
"cosmology": {
"type": "instance",
"class_path": "autogalaxy.cosmology.model.Planck15",
"arguments": {}
},
"galaxies": {
"type": "list",
"values": [
{
"type": "instance",
"class_path": "autogalaxy.galaxy.galaxy.Galaxy",
"arguments": {
"label": null,
"redshift": 0.5,
"bulge": {
"type": "instance",
"class_path": "autogalaxy.profiles.light.standard.sersic.Sersic",
"arguments": {
"sersic_index": 3.0,
"ell_comps": {
"type": "tuple",
"values": [
0.05263157894736841,
3.2227547345982974e-18
]
},
"centre": {
"type": "tuple",
"values": [
0.0,
0.0
]
},
"intensity": 2.0,
"effective_radius": 0.6
}
},
"mass": {
"type": "instance",
"class_path": "autogalaxy.profiles.mass.total.isothermal.Isothermal",
"arguments": {
"centre": {
"type": "tuple",
"values": [
0.0,
0.0
]
},
"einstein_radius": 1.6,
"ell_comps": {
"type": "tuple",
"values": [
0.05263157894736841,
3.2227547345982974e-18
]
}
}
},
"shear": {
"type": "instance",
"class_path": "autogalaxy.profiles.mass.sheets.external_shear.ExternalShear",
"arguments": {
"gamma_1": 0.05,
"gamma_2": 0.05
}
}
}
},
{
"type": "instance",
"class_path": "autogalaxy.galaxy.galaxy.Galaxy",
"arguments": {
"label": null,
"redshift": 1.0,
"bulge": {
"type": "instance",
"class_path": "autogalaxy.profiles.light.standard.sersic_core.SersicCore",
"arguments": {
"sersic_index": 1.0,
"ell_comps": {
"type": "tuple",
"values": [
0.0962250448649376,
-0.05555555555555551
]
},
"centre": {
"type": "tuple",
"values": [
0.0,
0.0
]
},
"intensity": 4.0,
"effective_radius": 0.1,
"radius_break": 0.025,
"gamma": 0.25,
"alpha": 3.0
}
}
}
}
]
}
}
}
Binary file added dataset/imaging/jwst/data.fits
View file
Open in desktop
Binary file not shown.
Binary file added dataset/imaging/jwst/noise_map.fits
View file
Open in desktop
Binary file not shown.
28 changes: 28 additions & 0 deletions dataset/imaging/jwst/positions.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
{
"type": "instance",
"class_path": "autoarray.structures.grids.irregular_2d.Grid2DIrregular",
"arguments": {
"values": {
"type": "ndarray",
"array": [
[
0.2709375,
1.6730528269360623
],
[
-1.4990625,
0.19539698172886397
],
[
1.4990625,
-0.1953969817288639
],
[
-0.2709375,
-1.6730528269360623
]
],
"dtype": "float64"
}
}
}
Binary file added dataset/imaging/jwst/psf.fits
View file
Open in desktop
Binary file not shown.
110 changes: 110 additions & 0 deletions dataset/imaging/jwst/tracer.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,110 @@
{
"type": "instance",
"class_path": "autolens.lens.tracer.Tracer",
"arguments": {
"galaxies": {
"type": "list",
"values": [
{
"type": "instance",
"class_path": "autogalaxy.galaxy.galaxy.Galaxy",
"arguments": {
"redshift": 0.5,
"label": null,
"bulge": {
"type": "instance",
"class_path": "autogalaxy.profiles.light.standard.sersic.Sersic",
"arguments": {
"intensity": 2.0,
"sersic_index": 3.0,
"ell_comps": {
"type": "tuple",
"values": [
0.05263157894736841,
3.2227547345982974e-18
]
},
"centre": {
"type": "tuple",
"values": [
0.0,
0.0
]
},
"effective_radius": 0.6
}
},
"mass": {
"type": "instance",
"class_path": "autogalaxy.profiles.mass.total.isothermal.Isothermal",
"arguments": {
"ell_comps": {
"type": "tuple",
"values": [
0.05263157894736841,
3.2227547345982974e-18
]
},
"einstein_radius": 1.6,
"centre": {
"type": "tuple",
"values": [
0.0,
0.0
]
}
}
},
"shear": {
"type": "instance",
"class_path": "autogalaxy.profiles.mass.sheets.external_shear.ExternalShear",
"arguments": {
"gamma_1": 0.05,
"gamma_2": 0.05
}
}
}
},
{
"type": "instance",
"class_path": "autogalaxy.galaxy.galaxy.Galaxy",
"arguments": {
"redshift": 1.0,
"label": null,
"bulge": {
"type": "instance",
"class_path": "autogalaxy.profiles.light.standard.sersic_core.SersicCore",
"arguments": {
"intensity": 4.0,
"sersic_index": 1.0,
"radius_break": 0.025,
"ell_comps": {
"type": "tuple",
"values": [
0.0962250448649376,
-0.05555555555555551
]
},
"centre": {
"type": "tuple",
"values": [
0.0,
0.0
]
},
"alpha": 3.0,
"effective_radius": 0.1,
"gamma": 0.25
}
}
}
}
]
},
"cosmology": {
"type": "instance",
"class_path": "autogalaxy.cosmology.model.Planck15",
"arguments": {}
}
}
}
Binary file added dataset/interferometer/alma/data.fits
View file
Open in desktop
Binary file not shown.
Binary file added dataset/interferometer/alma/noise_map.fits
View file
Open in desktop
Binary file not shown.
20 changes: 20 additions & 0 deletions dataset/interferometer/alma/positions.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
{
"type": "instance",
"class_path": "autoarray.structures.grids.irregular_2d.Grid2DIrregular",
"arguments": {
"values": {
"type": "ndarray",
"array": [
[
-1.35078125,
-0.5056325404387271
],
[
0.77734375,
1.6648436277960226
]
],
"dtype": "float64"
}
}
}
Loading
Loading