-
Notifications
You must be signed in to change notification settings - Fork 0
Project Tracker
This page tracks XAI OS milestones from the original QEMU bring-up work through the full OS milestone, then lists the CPU implementation backlog that starts only after the full OS core is complete.
The tracker is intentionally conservative. A checked item means the local repository and QEMU gate already have code, tests, or documentation proving that milestone. An unchecked item means it remains future engineering work.
- Status Legend
- Current Phase Summary
- Milestones 0-33: QEMU Readiness Track
- Milestones 34-42: Full OS Completion Track
- Milestones 43-51: Intel Desktop QEMU Track
- Milestones 52-59: QEMU-Only Hardening Track
- Milestones 60-71: QEMU 100 Completion Track
- Post-Full-OS CPU Implementation Backlog
- Current Rule
- Related Pages
| Marker | Meaning |
|---|---|
| ✅ Done | Implemented and covered by the current QEMU gates. |
| 🔵 Active | Current or next planned engineering work. |
| ⬜ Pending | Planned but not implemented yet. |
| Waiting on prerequisite design, code, hardware, or tooling. |
| Range | Phase | Status | Gate |
|---|---|---|---|
| 0-7 | Repository, toolchain, boot foundation | ✅ Done | make |
| 8-15 | Kernel, memory, devices, AI Cell MVP | ✅ Done | make qemu-smoke |
| 16-22 | EL0 userspace, heap, VMM, VirtIO, filesystem, telemetry | ✅ Done | make qemu-readiness-gate |
| 23-33 | QEMU release-candidate readiness | ✅ Done | make qemu-readiness-gate |
| 34-42 | Full OS completion | ✅ Done | make qemu-full-os-rc |
| 43-51 | Intel Desktop QEMU bring-up and hardware gate | ✅ Done | make intel-desktop-gate |
| 52-59 | QEMU-only hardening after Intel Desktop QEMU path | ✅ Done | make qemu-post51-gate |
| 60-71 | QEMU 100 completion | ✅ Done | make qemu-100-gate |
| 72+ | CPU and hardware implementations | 🔵 Active later | physical hardware and follow-on ports |
These milestones establish the current QEMU release-candidate readiness gate. They do not mean XAI OS is a production-complete OS.
| Milestone | Phase | Deliverable | Status |
|---|---|---|---|
| 0 | Repository foundation | Clean repo layout, docs split, wiki, build artifact ignores | ✅ Done |
| 1 | macOS toolchain | QEMU, LLVM, LLD, Python, mtools, firmware checks | ✅ Done |
| 2 | Build system | Build scripts and AArch64 image generation | ✅ Done |
| 3 | UEFI loader | AArch64 UEFI loader loads kernel.elf
|
✅ Done |
| 4 | Kernel entry | Kernel starts after UEFI ExitBootServices
|
✅ Done |
| 5 | Serial logging | Deterministic serial console and boot markers | ✅ Done |
| 6 | UEFI memory map | Memory map passed from loader and parsed by kernel | ✅ Done |
| 7 | Physical memory manager | PMM tracks total, free, and reserved pages | ✅ Done |
| 8 | AArch64 VMM | Page tables, map/unmap checks, MMIO mappings | ✅ Done |
| 9 | Exceptions | Controlled exception path and page fault reporting | ✅ Done |
| 10 | Timer and GIC | Generic timer and interrupt-controller discovery | ✅ Done |
| 11 | SMP state | PSCI CPU bring-up and per-core registry | ✅ Done |
| 12 | VirtIO block | Split VirtIO block path with read/write/error/reset tests | ✅ Done |
| 13 | VirtIO net | Split VirtIO net path with malformed/drop/reset tests | ✅ Done |
| 14 | Minimal control plane | Early supervisor/control-plane boot logic | ✅ Done |
| 15 | AI Cell MVP | AI Cell lifecycle, core lease metadata, shared model arena MVP | ✅ Done |
| 16 | Real EL0 userspace | User/kernel split, EL0 return path, syscall ABI, real /init ELF |
✅ Done |
| 17 | Kernel heap | PMM/VMM-backed heap and page-backed allocations | ✅ Done |
| 18 | VMM enforcement | RO/NX tests, guard pages, segment separation, map/unmap APIs | ✅ Done |
| 19 | VirtIO cleanup | Shared VirtIO transport plus block and net drivers | ✅ Done |
| 20 | Filesystem payload | VirtIO-backed read-only filesystem with /init and config |
✅ Done |
| 21 | AI Cell enforcement | Core, arena, NIC queue, workspace, and conflict checks | ✅ Done |
| 22 | Telemetry harness | Standard boot markers and JSON-like counters | ✅ Done |
| 23 | Process lifecycle | Process table, loaded/running/exited/failed states, kernel resume | ✅ Done |
| 24 | Userspace control plane |
/bin/service-manager, status, restart, rollback, update syscalls |
✅ Done |
| 25 | Disk persistence | Serialized state records, reboot reload, rollback behavior | ✅ Done |
| 26 | Networking depth | Queue-backed packet flow, UDP flow table, TCP timeout smoke path | ✅ Done |
| 27 | CPU-only AI runtime depth | Model-loader boundary, tokenizer/runtime boundary, shared weights, private KV/cache | ✅ Done |
| 28 | Security enforcement | Capability, filesystem, workspace, sandbox, update, rollback checks | ✅ Done |
| 29 | QEMU release candidate | Single readiness gate across boot, runtime, security, docs | ✅ Done |
| 30 | QEMU CPU matrix | ARM64 boot tiers and x86_64 command tiers | ✅ Done |
| 31 | ABI freeze | Syscall ABI and telemetry schema frozen for QEMU RC | ✅ Done |
| 32 | Format freeze | Filesystem, persistence, and service descriptor formats frozen | ✅ Done |
| 33 | Hardware-readiness gate |
make qemu-readiness-gate passes and emits readiness report |
✅ Done |
These milestones are the remaining QEMU full-OS work before starting CPU-specific implementation work. They should be completed in QEMU first so Intel, Xeon, AMD, and ARM/NVIDIA ports inherit a stable OS contract instead of half-finished platform-specific code.
| Milestone | Phase | Deliverable | Status |
|---|---|---|---|
| 34 | Full filesystem | Allocator-backed mutable filesystem with directories, multi-sector files, journal replay, service/workspace/update records, commit/rollback telemetry | ✅ Done |
| 35 | Process supervisor | Real service tree, child restart policy, crash handling, process cleanup, service logs | ✅ Done |
| 36 | Network stack maturity | Queue-backed UDP/TCP beyond smoke paths, timeouts, retransmit policy, per-core flow ownership | ✅ Done |
| 37 | CPU-only model runtime | Real model file loader, tokenizer binding, CPU kernel dispatch boundary, admission checks | ✅ Done |
| 38 | AI Cell production contract | Stable AI Cell descriptor ABI, resource admission, arena accounting, queue binding, workspace lifecycle | ✅ Done |
| 39 | Security hardening | Signed update policy, key handling, admin capability model, sandbox escape tests, rollback authorization | ✅ Done |
| 40 | Update and rollback system | Install/update transaction records, rollback points, boot fallback, failed-update recovery | ✅ Done |
| 41 | Admin control plane | SSH-only/admin shell plan, service inspection, status export, log retrieval, remote-safe commands | ✅ Done |
| 42 | Full OS release candidate | Full QEMU OS gate with stable ABI, filesystem, process, networking, AI Cell, security, and telemetry contracts | ✅ Done |
These milestones start after the QEMU full OS release candidate. They are implementation work for CPU and hardware targets, not performance claims.
| Milestone | Phase | Deliverable | Status |
|---|---|---|---|
| 43 | Intel Desktop x86_64 boot | Build and boot an x86_64 UEFI image in QEMU with deterministic serial markers | ✅ Done |
| 44 | Intel Desktop early exceptions | IDT, fault reporting, and early panic path for x86_64 | ✅ Done |
| 45 | Intel Desktop memory map | Parse x86_64 UEFI descriptors into PMM/VMM state | ✅ Done |
| 46 | Intel Desktop page tables | Higher-half/user split, RO/NX enforcement, MMIO mappings, stack guards | ✅ Done |
| 47 | Intel Desktop timers/APIC | Local APIC, IOAPIC planning, HPET/TSC-deadline policy | ✅ Done |
| 48 | Intel Desktop PCI/NVMe/NIC discovery | PCIe enumeration sufficient for NVMe and NIC bring-up | ✅ Done |
| 49 | Intel Desktop placement policy | P-core/E-core metadata, SMT policy, hot-core isolation telemetry | ✅ Done |
| 50 | Intel Desktop OS contract port | Bring QEMU full OS contracts onto x86_64: userspace, filesystem, networking, AI Cell, security, telemetry | ✅ Done |
| 51 | Intel Desktop hardware gate | QEMU release-candidate gate for Intel Desktop with physical hardware and tuned Linux/BSD baselines still required before performance claims | ✅ Done |
These milestones stay on macOS with QEMU while physical hardware is not yet available. They deepen correctness and regression coverage without claiming hardware performance.
| Milestone | Phase | Deliverable | Status |
|---|---|---|---|
| 52 | QEMU regression suite | Process, filesystem rollback, AI Cell conflict, network state, security denial, and telemetry regression report | ✅ Done |
| 53 | Fault injection | Controlled page/RO/NX faults plus expected bad syscall, malformed packet, block error, corrupt state, update, rollback, and AI Cell denial paths | ✅ Done |
| 54 | ABI contract tests | Source-level syscall/capability, initramfs, telemetry, CPU-AI model, AI Cell, persistence, service, security, update, admin, and CPU matrix contract checks | ✅ Done |
| 55 | Deterministic boot loop | Three repeated QEMU smoke boots with invariant checks for boot shape and zero hot-path migration/context switch counters | ✅ Done |
| 56 | Userspace expansion | Userland control-plane checks plus /bin example apps: shell command engine, hello, sysinfo, systest, app-requested smptest, app-callable nettest, and CPU-AI-backed LSTM XOR benchmark |
✅ Done |
| 57 | Network stack tests | UDP flow lifecycle, TCP timeout/retransmit, malformed drops, per-core queue ownership, latency counters, and app-facing UDP/TCP QEMU syscall paths | ✅ Done |
| 58 | CPU-only AI runtime simulator | Deterministic CPU-only model loader, tokenizer/runtime boundary, shared weights, private KV/cache, GPU rejection, admission, checksum checks, and app-facing decode syscall | ✅ Done |
| 59 | Developer UX | Make target coverage, documentation markers, QEMU dry-run validation, and aggregate post-51 gate report | ✅ Done |
These milestones define the remaining work to make XAI OS complete for the macOS/QEMU target. They do not include physical hardware validation and do not authorize performance claims.
| Milestone | Phase | Deliverable | Status | Gate |
|---|---|---|---|---|
| 60 | Real scheduler and process model | Multiple EL0 processes, runnable/waiting/exited/failed states, wait/exit, parent/child supervision, cleanup telemetry | ✅ Done | make qemu-process-gate |
| 61 | Real userspace command surface |
osctl status, ps, services, cells, fs, net, telemetry, update, rollback, parser and permission tests |
✅ Done | make qemu-osctl-gate |
| 62 | Minimal real filesystem surface | Directory listing, create/read/write/delete, rename, metadata, open/read/write/close syscalls, corruption and capacity tests | ✅ Done | make qemu-filesystem-gate |
| 63 | App-agent workspace flow | Source fixture, source index, patch stage/apply/revert, deterministic build/test, Git sync metadata, rollback | ✅ Done | make qemu-app-agent-gate |
| 64 | Network stack completion for QEMU | Packet buffer pool, UDP/TCP lifecycle, per-core queue ownership, malformed packet/drop tests, packet telemetry | ✅ Done | make qemu-network-full-gate |
| 65 | CPU-only AI runtime MVP | QEMU model ABI, metadata parser, tokenizer table, deterministic tiny inference kernel, shared weights, private KV/cache | ✅ Done | make qemu-cpu-ai-runtime-gate |
| 66 | AI Cell production semantics in QEMU | AI Cell descriptor ABI, resource enforcement, telemetry, duplicate core/queue/workspace/missing model conflict tests | ✅ Done | make qemu-ai-cell-gate |
| 67 | Security and capability hardening | Capability audit, per-process/service checks, filesystem/workspace/update policy, credential denial, security matrix | ✅ Done | make qemu-security-gate |
| 68 | Update, rollback, and recovery | Transaction format, staged/committed/failed states, boot fallback, rollback points, update rejection tests | ✅ Done | make qemu-update-gate |
| 69 | Long-run stability and stress | Configurable soak loop, repeated QEMU smoke boots, report generation, leak-sensitive telemetry checks | ✅ Done | make qemu-soak-gate |
| 70 | QEMU release artifact | QEMU image manifest with contracts, reports, checksums, release metadata, and performance-claim lockout | ✅ Done | make qemu-release |
| 71 | Final QEMU 100 gate | Aggregate gate proving milestones 62-71, OpenSSH bridge access, and writing the final QEMU target report | ✅ Done | make qemu-100-gate |
QEMU completion scope: milestones marked done are complete for the current macOS/QEMU integration target. The repository now includes QEMU-native remote-login, an OpenSSH-compatible local bridge, external-session TCP/UDP, user thread-group, and generic CPU-only ML syscall surfaces. Full public-network interoperability, drop-in POSIX pthreads, and hosted ML frameworks remain outside the current QEMU completion definition.
CPU-specific implementation work starts after the QEMU target is complete or when hardware becomes available for a dedicated branch. QEMU CPU profiles remain useful for compatibility and command-shape testing, but real performance claims require physical hardware and tuned Linux/BSD baselines.
| Profile | CPU type | Status | QEMU support | QEMU matrix status | Hardware implementation status | Notes |
|---|---|---|---|---|---|---|
| Apple Silicon local smoke | host |
✅ QEMU gated | yes, HVF | ✅ Passing default smoke | 🔵 Ready for hardware planning | Fast local correctness profile on the M3 development host. |
| ARMv8 weak baseline | cortex-a53 |
✅ QEMU gated | yes | ✅ Passing boot probe | 🔵 Ready for hardware planning | Minimum compatibility profile. |
| ARMv8 common baseline | cortex-a72 |
✅ QEMU gated | yes | ✅ Passing boot probe | 🔵 Ready for hardware planning | Portable AArch64 fallback profile. |
| Modern ARM client | cortex-a76 |
✅ QEMU gated | yes | ✅ Passing boot probe | ⬜ Planned after Intel Desktop | Useful for newer non-server ARM behavior. |
| Newer ARM client | cortex-a710 |
✅ QEMU gated | yes | ✅ Passing boot probe | ⬜ Planned after Intel Desktop | Useful for ARMv9-style compatibility planning. |
| ARM server baseline | neoverse-n1 |
✅ QEMU gated | yes | ✅ Passing boot probe | ⬜ Planned after Intel/Xeon | Graviton2-class approximation. |
| Modern ARM server | neoverse-n2 |
✅ QEMU gated | yes | ✅ Passing boot probe | ⬜ Planned after Intel/Xeon | Practical substitute for some newer ARM server behavior. |
| High-performance ARM server | neoverse-v1 |
✅ QEMU gated | yes | ✅ Passing boot probe | ⬜ Planned after Intel/Xeon | High-end ARM server feature path. |
| NVIDIA/Apple approximation | neoverse-v2 |
no local QEMU model | ⬜ Planned after Intel/Xeon | Use neoverse-n2, neoverse-v1, or max until hardware validation. |
||
| Future feature exposure | max |
✅ QEMU gated | yes | ✅ Passing boot probe | 🔵 Ready for compatibility planning | Broad QEMU feature exposure. |
| Profile | CPU type | Status | QEMU support | QEMU matrix status | Hardware implementation status | Notes |
|---|---|---|---|---|---|---|
| Conservative Intel Desktop | Skylake-Client |
✅ Done | yes | ✅ Passing smoke boot | ✅ Milestones 43-51 QEMU path done | First x86_64 desktop compatibility profile. |
| Intended Intel Desktop target | AlderLake |
✅ QEMU substitute gated | no local QEMU model | ✅ max smoke-boot stand-in |
✅ Placement policy represented by QEMU stand-in | Use max as the QEMU stand-in; validate on physical hardware. |
| Broad desktop feature exposure | max |
✅ QEMU gated | yes | ✅ Passing smoke boot | ✅ Placement policy represented in QEMU | Compatibility stress profile, not a real CPU generation. |
| Profile | CPU type | Status | QEMU support | QEMU matrix status | Hardware implementation status | Notes |
|---|---|---|---|---|---|---|
| Conservative Xeon baseline | Skylake-Server |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | First server x86_64 compatibility profile. |
| Post-Skylake Xeon | Cascadelake-Server |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Useful for server feature-detection paths. |
| Xeon compatibility | Cooperlake |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Server feature coverage. |
| Modern Xeon baseline | Icelake-Server |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Newer server features and paging planning. |
| High-end Xeon | SapphireRapids |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | AMX/vector policy planning. |
| Future Xeon | GraniteRapids |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Forward compatibility. |
| Future Xeon | DiamondRapids |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Very new Intel server feature detection. |
| Dense-core Xeon | SierraForest |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Server E-core policy planning. |
| Dense-core Xeon | ClearwaterForest |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Forward dense-core compatibility. |
| Server-edge Intel Atom | Denverton |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Lower-power server/edge profile. |
| Server-edge Intel Atom | Snowridge |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Network-edge profile. |
| Broad server feature exposure | max |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Compatibility stress profile. |
| Profile | CPU type | Status | QEMU support | QEMU matrix status | Hardware implementation status | Notes |
|---|---|---|---|---|---|---|
| AMD EPYC baseline | EPYC |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Zen-era server compatibility. |
| AMD EPYC Rome | EPYC-Rome |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Zen 2 server compatibility. |
| AMD EPYC Milan | EPYC-Milan |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Zen 3 server compatibility. |
| AMD EPYC Genoa | EPYC-Genoa |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Zen 4 server compatibility. |
| AMD EPYC Turin | EPYC-Turin |
✅ QEMU gated | yes | ✅ Passing smoke boot | ⬜ Planned after Intel Desktop | Newer AMD server compatibility. |
Milestones 43-51 are complete after make intel-desktop-gate builds build/xaios-x86_64.img, boots it through x86_64 OVMF in QEMU, reaches the Intel Desktop serial markers for boot, IDT exceptions, memory-map parsing, page tables, timer/APIC discovery, PCI discovery, placement policy, OS contract parity, and hardware gate, then writes build/intel-desktop-gate-report.json with status=pass. The broader CPU-profile matrix is complete when make qemu-cpu-matrix passes every supported ARM64 boot probe and every supported x86_64 smoke boot listed above. Milestones 52-59 are complete when make qemu-post51-gate writes build/qemu-post51-gate-report.json with status=pass. The macOS/QEMU target is complete when make qemu-100-gate writes build/qemu-100-report.json with status=pass; the latest readiness check also passes make qemu-readiness-gate. Physical Intel Desktop, Xeon, AMD, and ARM/NVIDIA hardware validation and tuned Linux/BSD baselines are still required before any performance claim.
This page defines the GitHub Wiki navigation sidebar.
- Architecture
- AI Cells
- CPU AI Runtime
- App Agents
- Memory System
- Networking
- Scheduler and Core Isolation
- Filesystem and Storage
- Driver Model
- Security Model
- Build System
- Build System
- Project Tracker
- Implementation Plan
- QEMU Full OS Core Workdown
- QEMU 100 Completion Plan
- Example Apps
- Codex Work Packages
- Testing and Benchmarking