Skip to content

Project Tracker

Node1 edited this page Jun 18, 2026 · 25 revisions

Project Tracker

Purpose

This page tracks XAI OS milestones from the original QEMU bring-up work through the full OS milestone, then lists the CPU implementation backlog that starts only after the full OS core is complete.

The tracker is intentionally conservative. A checked item means the local repository and QEMU gate already have code, tests, or documentation proving that milestone. An unchecked item means it remains future engineering work.

Contents

Status Legend

Marker Meaning
✅ Done Implemented and covered by the current QEMU gates.
🔵 Active Current or next planned engineering work.
⬜ Pending Planned but not implemented yet.
⚠️ Blocked Waiting on prerequisite design, code, hardware, or tooling.

Current Phase Summary

Range Phase Status Gate
0-7 Repository, toolchain, boot foundation ✅ Done make
8-15 Kernel, memory, devices, AI Cell MVP ✅ Done make qemu-smoke
16-22 EL0 userspace, heap, VMM, VirtIO, filesystem, telemetry ✅ Done make qemu-readiness-gate
23-33 QEMU release-candidate readiness ✅ Done make qemu-readiness-gate
34-42 Full OS completion ✅ Done make qemu-full-os-rc
43-51 Intel Desktop QEMU bring-up and hardware gate ✅ Done make intel-desktop-gate
52-59 QEMU-only hardening after Intel Desktop QEMU path ✅ Done make qemu-post51-gate
60-71 QEMU 100 completion ✅ Done make qemu-100-gate
72+ CPU and hardware implementations 🔵 Active later physical hardware and follow-on ports

Milestones 0-33: QEMU Readiness Track

These milestones establish the current QEMU release-candidate readiness gate. They do not mean XAI OS is a production-complete OS.

Milestone Phase Deliverable Status
0 Repository foundation Clean repo layout, docs split, wiki, build artifact ignores ✅ Done
1 macOS toolchain QEMU, LLVM, LLD, Python, mtools, firmware checks ✅ Done
2 Build system Build scripts and AArch64 image generation ✅ Done
3 UEFI loader AArch64 UEFI loader loads kernel.elf ✅ Done
4 Kernel entry Kernel starts after UEFI ExitBootServices ✅ Done
5 Serial logging Deterministic serial console and boot markers ✅ Done
6 UEFI memory map Memory map passed from loader and parsed by kernel ✅ Done
7 Physical memory manager PMM tracks total, free, and reserved pages ✅ Done
8 AArch64 VMM Page tables, map/unmap checks, MMIO mappings ✅ Done
9 Exceptions Controlled exception path and page fault reporting ✅ Done
10 Timer and GIC Generic timer and interrupt-controller discovery ✅ Done
11 SMP state PSCI CPU bring-up and per-core registry ✅ Done
12 VirtIO block Split VirtIO block path with read/write/error/reset tests ✅ Done
13 VirtIO net Split VirtIO net path with malformed/drop/reset tests ✅ Done
14 Minimal control plane Early supervisor/control-plane boot logic ✅ Done
15 AI Cell MVP AI Cell lifecycle, core lease metadata, shared model arena MVP ✅ Done
16 Real EL0 userspace User/kernel split, EL0 return path, syscall ABI, real /init ELF ✅ Done
17 Kernel heap PMM/VMM-backed heap and page-backed allocations ✅ Done
18 VMM enforcement RO/NX tests, guard pages, segment separation, map/unmap APIs ✅ Done
19 VirtIO cleanup Shared VirtIO transport plus block and net drivers ✅ Done
20 Filesystem payload VirtIO-backed read-only filesystem with /init and config ✅ Done
21 AI Cell enforcement Core, arena, NIC queue, workspace, and conflict checks ✅ Done
22 Telemetry harness Standard boot markers and JSON-like counters ✅ Done
23 Process lifecycle Process table, loaded/running/exited/failed states, kernel resume ✅ Done
24 Userspace control plane /bin/service-manager, status, restart, rollback, update syscalls ✅ Done
25 Disk persistence Serialized state records, reboot reload, rollback behavior ✅ Done
26 Networking depth Queue-backed packet flow, UDP flow table, TCP timeout smoke path ✅ Done
27 CPU-only AI runtime depth Model-loader boundary, tokenizer/runtime boundary, shared weights, private KV/cache ✅ Done
28 Security enforcement Capability, filesystem, workspace, sandbox, update, rollback checks ✅ Done
29 QEMU release candidate Single readiness gate across boot, runtime, security, docs ✅ Done
30 QEMU CPU matrix ARM64 boot tiers and x86_64 command tiers ✅ Done
31 ABI freeze Syscall ABI and telemetry schema frozen for QEMU RC ✅ Done
32 Format freeze Filesystem, persistence, and service descriptor formats frozen ✅ Done
33 Hardware-readiness gate make qemu-readiness-gate passes and emits readiness report ✅ Done

Milestones 34-42: Full OS Completion Track

These milestones are the remaining QEMU full-OS work before starting CPU-specific implementation work. They should be completed in QEMU first so Intel, Xeon, AMD, and ARM/NVIDIA ports inherit a stable OS contract instead of half-finished platform-specific code.

Milestone Phase Deliverable Status
34 Full filesystem Allocator-backed mutable filesystem with directories, multi-sector files, journal replay, service/workspace/update records, commit/rollback telemetry ✅ Done
35 Process supervisor Real service tree, child restart policy, crash handling, process cleanup, service logs ✅ Done
36 Network stack maturity Queue-backed UDP/TCP beyond smoke paths, timeouts, retransmit policy, per-core flow ownership ✅ Done
37 CPU-only model runtime Real model file loader, tokenizer binding, CPU kernel dispatch boundary, admission checks ✅ Done
38 AI Cell production contract Stable AI Cell descriptor ABI, resource admission, arena accounting, queue binding, workspace lifecycle ✅ Done
39 Security hardening Signed update policy, key handling, admin capability model, sandbox escape tests, rollback authorization ✅ Done
40 Update and rollback system Install/update transaction records, rollback points, boot fallback, failed-update recovery ✅ Done
41 Admin control plane SSH-only/admin shell plan, service inspection, status export, log retrieval, remote-safe commands ✅ Done
42 Full OS release candidate Full QEMU OS gate with stable ABI, filesystem, process, networking, AI Cell, security, and telemetry contracts ✅ Done

Milestones 43-51: Intel Desktop QEMU Track

These milestones start after the QEMU full OS release candidate. They are implementation work for CPU and hardware targets, not performance claims.

Milestone Phase Deliverable Status
43 Intel Desktop x86_64 boot Build and boot an x86_64 UEFI image in QEMU with deterministic serial markers ✅ Done
44 Intel Desktop early exceptions IDT, fault reporting, and early panic path for x86_64 ✅ Done
45 Intel Desktop memory map Parse x86_64 UEFI descriptors into PMM/VMM state ✅ Done
46 Intel Desktop page tables Higher-half/user split, RO/NX enforcement, MMIO mappings, stack guards ✅ Done
47 Intel Desktop timers/APIC Local APIC, IOAPIC planning, HPET/TSC-deadline policy ✅ Done
48 Intel Desktop PCI/NVMe/NIC discovery PCIe enumeration sufficient for NVMe and NIC bring-up ✅ Done
49 Intel Desktop placement policy P-core/E-core metadata, SMT policy, hot-core isolation telemetry ✅ Done
50 Intel Desktop OS contract port Bring QEMU full OS contracts onto x86_64: userspace, filesystem, networking, AI Cell, security, telemetry ✅ Done
51 Intel Desktop hardware gate QEMU release-candidate gate for Intel Desktop with physical hardware and tuned Linux/BSD baselines still required before performance claims ✅ Done

Milestones 52-59: QEMU-Only Hardening Track

These milestones stay on macOS with QEMU while physical hardware is not yet available. They deepen correctness and regression coverage without claiming hardware performance.

Milestone Phase Deliverable Status
52 QEMU regression suite Process, filesystem rollback, AI Cell conflict, network state, security denial, and telemetry regression report ✅ Done
53 Fault injection Controlled page/RO/NX faults plus expected bad syscall, malformed packet, block error, corrupt state, update, rollback, and AI Cell denial paths ✅ Done
54 ABI contract tests Source-level syscall/capability, initramfs, telemetry, CPU-AI model, AI Cell, persistence, service, security, update, admin, and CPU matrix contract checks ✅ Done
55 Deterministic boot loop Three repeated QEMU smoke boots with invariant checks for boot shape and zero hot-path migration/context switch counters ✅ Done
56 Userspace expansion Userland control-plane checks plus /bin example apps: shell command engine, hello, sysinfo, systest, app-requested smptest, app-callable nettest, and CPU-AI-backed LSTM XOR benchmark ✅ Done
57 Network stack tests UDP flow lifecycle, TCP timeout/retransmit, malformed drops, per-core queue ownership, latency counters, and app-facing UDP/TCP QEMU syscall paths ✅ Done
58 CPU-only AI runtime simulator Deterministic CPU-only model loader, tokenizer/runtime boundary, shared weights, private KV/cache, GPU rejection, admission, checksum checks, and app-facing decode syscall ✅ Done
59 Developer UX Make target coverage, documentation markers, QEMU dry-run validation, and aggregate post-51 gate report ✅ Done

Milestones 60-71: QEMU 100 Completion Track

These milestones define the remaining work to make XAI OS complete for the macOS/QEMU target. They do not include physical hardware validation and do not authorize performance claims.

Milestone Phase Deliverable Status Gate
60 Real scheduler and process model Multiple EL0 processes, runnable/waiting/exited/failed states, wait/exit, parent/child supervision, cleanup telemetry ✅ Done make qemu-process-gate
61 Real userspace command surface osctl status, ps, services, cells, fs, net, telemetry, update, rollback, parser and permission tests ✅ Done make qemu-osctl-gate
62 Minimal real filesystem surface Directory listing, create/read/write/delete, rename, metadata, open/read/write/close syscalls, corruption and capacity tests ✅ Done make qemu-filesystem-gate
63 App-agent workspace flow Source fixture, source index, patch stage/apply/revert, deterministic build/test, Git sync metadata, rollback ✅ Done make qemu-app-agent-gate
64 Network stack completion for QEMU Packet buffer pool, UDP/TCP lifecycle, per-core queue ownership, malformed packet/drop tests, packet telemetry ✅ Done make qemu-network-full-gate
65 CPU-only AI runtime MVP QEMU model ABI, metadata parser, tokenizer table, deterministic tiny inference kernel, shared weights, private KV/cache ✅ Done make qemu-cpu-ai-runtime-gate
66 AI Cell production semantics in QEMU AI Cell descriptor ABI, resource enforcement, telemetry, duplicate core/queue/workspace/missing model conflict tests ✅ Done make qemu-ai-cell-gate
67 Security and capability hardening Capability audit, per-process/service checks, filesystem/workspace/update policy, credential denial, security matrix ✅ Done make qemu-security-gate
68 Update, rollback, and recovery Transaction format, staged/committed/failed states, boot fallback, rollback points, update rejection tests ✅ Done make qemu-update-gate
69 Long-run stability and stress Configurable soak loop, repeated QEMU smoke boots, report generation, leak-sensitive telemetry checks ✅ Done make qemu-soak-gate
70 QEMU release artifact QEMU image manifest with contracts, reports, checksums, release metadata, and performance-claim lockout ✅ Done make qemu-release
71 Final QEMU 100 gate Aggregate gate proving milestones 62-71, OpenSSH bridge access, and writing the final QEMU target report ✅ Done make qemu-100-gate

QEMU completion scope: milestones marked done are complete for the current macOS/QEMU integration target. The repository now includes QEMU-native remote-login, an OpenSSH-compatible local bridge, external-session TCP/UDP, user thread-group, and generic CPU-only ML syscall surfaces. Full public-network interoperability, drop-in POSIX pthreads, and hosted ML frameworks remain outside the current QEMU completion definition.

Post-Full-OS CPU Implementation Backlog

CPU-specific implementation work starts after the QEMU target is complete or when hardware becomes available for a dedicated branch. QEMU CPU profiles remain useful for compatibility and command-shape testing, but real performance claims require physical hardware and tuned Linux/BSD baselines.

ARM64 and ARM/NVIDIA Profiles

Profile CPU type Status QEMU support QEMU matrix status Hardware implementation status Notes
Apple Silicon local smoke host ✅ QEMU gated yes, HVF ✅ Passing default smoke 🔵 Ready for hardware planning Fast local correctness profile on the M3 development host.
ARMv8 weak baseline cortex-a53 ✅ QEMU gated yes ✅ Passing boot probe 🔵 Ready for hardware planning Minimum compatibility profile.
ARMv8 common baseline cortex-a72 ✅ QEMU gated yes ✅ Passing boot probe 🔵 Ready for hardware planning Portable AArch64 fallback profile.
Modern ARM client cortex-a76 ✅ QEMU gated yes ✅ Passing boot probe ⬜ Planned after Intel Desktop Useful for newer non-server ARM behavior.
Newer ARM client cortex-a710 ✅ QEMU gated yes ✅ Passing boot probe ⬜ Planned after Intel Desktop Useful for ARMv9-style compatibility planning.
ARM server baseline neoverse-n1 ✅ QEMU gated yes ✅ Passing boot probe ⬜ Planned after Intel/Xeon Graviton2-class approximation.
Modern ARM server neoverse-n2 ✅ QEMU gated yes ✅ Passing boot probe ⬜ Planned after Intel/Xeon Practical substitute for some newer ARM server behavior.
High-performance ARM server neoverse-v1 ✅ QEMU gated yes ✅ Passing boot probe ⬜ Planned after Intel/Xeon High-end ARM server feature path.
NVIDIA/Apple approximation neoverse-v2 ⚠️ Blocked no local QEMU model ⚠️ Substitute required ⬜ Planned after Intel/Xeon Use neoverse-n2, neoverse-v1, or max until hardware validation.
Future feature exposure max ✅ QEMU gated yes ✅ Passing boot probe 🔵 Ready for compatibility planning Broad QEMU feature exposure.

Intel Desktop Profiles

Profile CPU type Status QEMU support QEMU matrix status Hardware implementation status Notes
Conservative Intel Desktop Skylake-Client ✅ Done yes ✅ Passing smoke boot ✅ Milestones 43-51 QEMU path done First x86_64 desktop compatibility profile.
Intended Intel Desktop target AlderLake ✅ QEMU substitute gated no local QEMU model max smoke-boot stand-in ✅ Placement policy represented by QEMU stand-in Use max as the QEMU stand-in; validate on physical hardware.
Broad desktop feature exposure max ✅ QEMU gated yes ✅ Passing smoke boot ✅ Placement policy represented in QEMU Compatibility stress profile, not a real CPU generation.

Intel Xeon and Server Profiles

Profile CPU type Status QEMU support QEMU matrix status Hardware implementation status Notes
Conservative Xeon baseline Skylake-Server ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop First server x86_64 compatibility profile.
Post-Skylake Xeon Cascadelake-Server ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Useful for server feature-detection paths.
Xeon compatibility Cooperlake ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Server feature coverage.
Modern Xeon baseline Icelake-Server ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Newer server features and paging planning.
High-end Xeon SapphireRapids ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop AMX/vector policy planning.
Future Xeon GraniteRapids ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Forward compatibility.
Future Xeon DiamondRapids ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Very new Intel server feature detection.
Dense-core Xeon SierraForest ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Server E-core policy planning.
Dense-core Xeon ClearwaterForest ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Forward dense-core compatibility.
Server-edge Intel Atom Denverton ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Lower-power server/edge profile.
Server-edge Intel Atom Snowridge ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Network-edge profile.
Broad server feature exposure max ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Compatibility stress profile.

AMD x86_64 Profiles

Profile CPU type Status QEMU support QEMU matrix status Hardware implementation status Notes
AMD EPYC baseline EPYC ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Zen-era server compatibility.
AMD EPYC Rome EPYC-Rome ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Zen 2 server compatibility.
AMD EPYC Milan EPYC-Milan ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Zen 3 server compatibility.
AMD EPYC Genoa EPYC-Genoa ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Zen 4 server compatibility.
AMD EPYC Turin EPYC-Turin ✅ QEMU gated yes ✅ Passing smoke boot ⬜ Planned after Intel Desktop Newer AMD server compatibility.

Current Rule

Milestones 43-51 are complete after make intel-desktop-gate builds build/xaios-x86_64.img, boots it through x86_64 OVMF in QEMU, reaches the Intel Desktop serial markers for boot, IDT exceptions, memory-map parsing, page tables, timer/APIC discovery, PCI discovery, placement policy, OS contract parity, and hardware gate, then writes build/intel-desktop-gate-report.json with status=pass. The broader CPU-profile matrix is complete when make qemu-cpu-matrix passes every supported ARM64 boot probe and every supported x86_64 smoke boot listed above. Milestones 52-59 are complete when make qemu-post51-gate writes build/qemu-post51-gate-report.json with status=pass. The macOS/QEMU target is complete when make qemu-100-gate writes build/qemu-100-report.json with status=pass; the latest readiness check also passes make qemu-readiness-gate. Physical Intel Desktop, Xeon, AMD, and ARM/NVIDIA hardware validation and tuned Linux/BSD baselines are still required before any performance claim.

Related Pages

Clone this wiki locally