Add streaming one-wesolowski compaction APIs

[hoffmang9]

Summary

• add a new c_bindings/fast_wrapper API surface for streaming one-wesolowski proof generation when y_ref is known up front
• include incremental GetBlock and memory-budgeted (k, l) tuning to improve compaction-worker throughput/memory behavior
• add minimal embedding/build support (vdf_fast_pairindex, quiet_mode, fastlib target, PIC/PIE options) and document the path in docs/bluebox_compaction.md
• fix merge blockers from this review cycle: guard fast counter-slot configuration against zero and export Homebrew cmake into PATH for macOS wheel/c-library workflows

Scope and follow-up plan

• This PR is intentionally scoped to PR1 (streaming prover + supporting infra).
• enable_threads remains unchanged (true) upstream; downstream can force single-thread proving via repeated_square_fast_single_thread as discussed with @Ealrann.
• @Ealrann clarified that Trick 2 is already merged on bbr (f3c73bf046e155aad2a8a9417496550b1e2d8cd5) and highlighted the important RSS/memory-leak fix (445cb0d54fbd43e479e9479c2605bbd3d0c2ddd5).
• Planned follow-up PR will upstream discriminant-reuse batch proving (Trick 2) and include the memory-leak/RSS stabilization work.

Test plan

• Verify commit signature on branch tip (git log -1 --show-signature)
• Confirm branch diff against origin/main only includes intended PR1 files
• Address unresolved review thread(s)
• Build/test on target platforms (Linux x86_64, macOS Intel, macOS ARM, Windows)

Made with Cursor

---

Note

Medium Risk
Adds a new C API and a substantial new proving path that hooks into repeated_square, plus changes fast-path counter-slot selection and output suppression; regressions could affect VDF correctness/performance in embedded or multi-threaded use.

Overview
Adds a new src/c_bindings/fast_wrapper C API for fast one-Wesolowski proving, including a streaming variant that requires known y_ref and supports progress callbacks, batch jobs, optional incremental GetBlock mapping, and memory-budgeted (k,l) tuning with per-thread debug stats.

Updates the VDF engine to better support embedding/multi-worker execution by introducing quiet_mode (to suppress stdout diagnostics), adding WesolowskiCallback batch lifecycle hooks (OnBatchStart/OnBatchReplay) for fast-path fallback handling, and allocating per-thread vdf_fast counter slots via vdf_fast_pairindex() with a configurable CHIA_VDF_FAST_COUNTER_SLOTS guard.

Build/CI support is extended by adding a fastlib static library target (libchiavdf_fastc.a), optional PIC/PIE flags in Makefile.vdf-client, improved clean rules/asm compilation, macOS workflows that ensure Homebrew cmake is installed/on PATH, and new documentation in docs/bluebox_compaction.md.

^{Reviewed by Cursor Bugbot for commit 91a2af9. Bugbot is set up for automated code reviews on this repo. Configure here.}

[hoffmang9]

@Ealrann I'm hoping to cleanly upstream your changes so you can rely on chiavdf directly and not a fork. See the plan here:
https://gist.github.com/hoffmang9/6a848ff22f7cd29f4b6507600b099a5c

[Ealrann]

Oh, yes the plan is perfect. I'll definitely update the wesoforge client to use the main chiavdf.
It's ok if you keep enable_threads=true indeed, I'll use repeated_square_fast_single_thread instead.

Note: the plan mentions "Trick 2 (unreleased, on side branch)", but in fact trick 2 was properly merged on bbr branch (it's the commit Ealrann@f3c73bf). This one is important because it allows the group optimisation.
Commit Ealrann@445cb0d is also very important because it fixes a memory leak (also in bbr branch), it was problematic on high core count servers.

[github-actions]

'This PR has been flagged as stale due to no activity for over 60
days. It will not be automatically closed, but it has been given
a stale-pr label and should be manually reviewed.'

[hoffmang9]

Pushed follow-up commit 0c11002 to address remaining blockers.

• fixed unresolved Bugbot thread by hard-guarding fast counter-slot count (CHIA_VDF_FAST_COUNTER_SLOTS > 0) so % kSlots cannot be undefined
• fixed macOS workflow fragility by exporting Homebrew cmake into PATH in both wheel and C-library workflows before cmake --version
• updated PR description scope to match @Ealrann’s note: Trick 2 is already on bbr (f3c73bf046e155aad2a8a9417496550b1e2d8cd5) and memory-leak/RSS fix (445cb0d54fbd43e479e9479c2605bbd3d0c2ddd5) is tracked for follow-up upstreaming

I’ll keep watching CI and triage anything else that pops up.

[cursor]

Cursor Bugbot has reviewed your changes and found 2 potential issues.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit 61e9280. Configure here.}