Skip to content

feat(startup): hot startup — load hotStartupHours synchronously, fill retentionHours in background #1187

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
efiten wants to merge 12 commits into
base: master
Choose a base branch
from
Open

feat(startup): hot startup — load hotStartupHours synchronously, fill retentionHours in background #1187

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
814d168
feat(startup): add packetStore.hotStartupHours config field and Packe…
efiten May 9, 2026
e5e2347
feat(startup): Load() uses hotStartupHours as WHERE cutoff when set
efiten May 10, 2026
5bd5194
feat(startup): implement loadChunk — SQL scan outside lock, merge und…
efiten May 10, 2026
99c2e8b
feat(startup): implement loadBackgroundChunks — progressive daily chu…
efiten May 10, 2026
4e6bf6f
feat(startup): SQL fallback in QueryPackets/QueryGroupedPackets when …
efiten May 10, 2026
96caade
feat(startup): expose hotStartupHours/backgroundLoadComplete/Progress…
efiten May 10, 2026
2fe8560
feat(startup): start loadBackgroundChunks goroutine in main after sto…
efiten May 10, 2026
0efa336
docs: document packetStore.hotStartupHours in config.example.json
efiten May 10, 2026
a6f8d3b
fix(startup): fix data race in GetPerfStoreStats and byObserver doubl…
efiten May 10, 2026
5d16d42
Merge branch 'master' into feat/hot-startup
efiten May 11, 2026
fa7d8bd
test(e2e): reset groupbyhash before hex pane test to fix hidden-row t…
efiten May 11, 2026
3fb57b2
test(e2e): fix hex pane test isolation — force full reload after loca…
efiten May 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions cmd/server/config.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -134,9 +134,10 @@ type NeighborGraphConfig struct {

// PacketStoreConfig controls in-memory packet store limits.
type PacketStoreConfig struct {
RetentionHours float64 `json:"retentionHours"` // max age of packets in hours (0 = unlimited)
MaxMemoryMB int `json:"maxMemoryMB"` // hard memory ceiling in MB (0 = unlimited)
MaxResolvedPubkeyIndexEntries int `json:"maxResolvedPubkeyIndexEntries"` // warning threshold for index size (0 = 5M default)
RetentionHours float64 `json:"retentionHours"` // max age of packets in hours (0 = unlimited)
MaxMemoryMB int `json:"maxMemoryMB"` // hard memory ceiling in MB (0 = unlimited)
MaxResolvedPubkeyIndexEntries int `json:"maxResolvedPubkeyIndexEntries"` // warning threshold for index size (0 = 5M default)
HotStartupHours float64 `json:"hotStartupHours"` // load only this many hours synchronously; 0 = disabled
}

// GeoFilterConfig is an alias for the shared geofilter.Config type.
Expand Down
Loading
Loading