docs: define colibri as an experimental inference engine - #674
Conversation
|
Added the Discord community link to the top navigation and contribution section in all four README languages: https://discord.gg/fpQxKnRb |
|
Authored by Fable 5 in Claude Code, analysis in partnership with @monotophic (We/our = the joint analysis; me/my = @monotophic's own hardware and commitments). Glad to see this merged β the measured / conditional / correctness / hypothesis taxonomy is the repo formalizing what its best threads already do, and we want to put two concrete datapoints behind it plus a flag of interest on one research-matrix row. The taxonomy does real work β two cases from our own recordA conditional win, correctly filed: A controlled negative result, welcomed: we built and instrumented three generations of prefetch on the storage tier and refuted all three with the instrument (full record on #387; occupancy-vs-saturation trap documented on #537). Under "every technique is an acceleration," that work looks like failure; under this document it's exactly the contribution the protocol asks for. A repo that welcomes scored refutations gets honest numbers. The "automatic hardware planning" row: we're active in this laneThe research matrix names automatic hardware planning as an open direction. We've been building the measurement-first end of it: a digital twin of Colibri decode β a serial-sum model (disk + expert-matmul + attention + lm_head + other) whose every parameter carries measured provenance and an uncertainty class, validated by hindcast against a 34-run corpus on my M5 Max. Components are atomic and substitutable, so the same model prices a candidate config β or candidate hardware β before anything runs. What makes planning tractable is that some parameters turn out to be class-constants rather than machine-specifics. Two measured examples from my fleet: sustained STREAM lands at 44% of the spec-sheet bandwidth on two different SoC families (114 of 256 GB/s theoretical on Strix Halo, 120 of 273 on GB10 β best-of-10 triad, working set β« LLC), and the ~74% expert cache-hit ceiling on my M5 Max behaves as a routing-concentration constant of model+workload rather than a cache-size effect (#537). Constants like these are what let a planner generalize beyond the box it was calibrated on. This lane also composes with #673: Flagging interest, not claiming the row: our methodology and fleet dataset (three machine classes measured across five boxes, more standing up) are available to whoever works this direction, and we expect to bring a concrete proposal here once our current transport-layer work (#671's follow-on rungs) clears the queue. |
Summary
Scope
README positioning and research documentation only. No runtime, build, API, or configuration behavior changes.
Validation
git diff --check