CLLM

A bare-metal C unikernel for serving large language models -- no OS, no overhead.

Website · Docs · GitHub

Where a typical inference server runs inside a container on top of a Linux userland and kernel, CLLM removes the OS, the container, and the userland entirely -- it boots as a Multiboot unikernel straight into an HTTP inference server on bare x86, with its own libc subset, e1000 NIC driver, and REST API, for a minimal attack surface and no OS overhead.

What is CLLM?

CLLM is a Multiboot-compliant unikernel written in C that boots directly on bare metal (or in QEMU) and serves LLM inference over HTTP. It eliminates the operating system layer entirely -- the kernel is the application.

The kernel includes a custom libc subset, PCI bus enumeration, an Intel e1000 NIC driver, an HTTP server with REST API endpoints, and a model loading interface compatible with llama.cpp.

Quick Start

# Prerequisites: gcc (with -m32 support), make, qemu-system-i386
sudo apt-get install gcc gcc-multilib make qemu-system-x86

# Build and run
git clone git@github.com:cognisoc/cllm.git
cd cllm
make run

Serial output appears on your terminal. Press Ctrl-A X to exit QEMU.

Make Targets

Target	Description
make	Build release kernel (build/kernel.bin)
make debug	Build with debug symbols
make run	Build and boot in QEMU (serial on stdio)
make run-vga	Build and boot in QEMU (VGA window)
make run-debug	Build and boot paused for GDB on :1234
make clean	Remove build artifacts

Architecture

+-----------------------------------------------------------+
|  QEMU / Bare Metal  (x86, Multiboot)                     |
+-----------------------------------------------------------+
|  boot.S             Multiboot entry, stack, serial init   |
|  kernel.c           Kernel main, VGA terminal, serial I/O |
|  memory.c           Heap allocator (malloc/free)          |
|  string.c           libc subset (snprintf, memcpy, ...)   |
|  network.c          PCI enumeration + e1000 NIC driver    |
|  http.c / api.c     HTTP server, request routing          |
|  api_v1.c           llama.cpp-compatible REST API         |
|  llm.c              Model loading and inference interface |
+-----------------------------------------------------------+

The kernel boots via Multiboot, initializes serial and VGA output, brings up an e1000 network interface via PCI, and enters a packet-processing loop that serves HTTP requests for LLM inference.

Project Structure

src/            C source files (kernel, drivers, HTTP, LLM)
include/        Header files
build/          Build scripts, linker script, artifacts
documentation/  MkDocs documentation site
llama.cpp/      llama.cpp headers for model integration

Roadmap

• Multiboot kernel with VGA + serial output
• Custom libc (malloc, snprintf, string ops)
• PCI enumeration and e1000 NIC driver
• HTTP server with REST API endpoints
• llama.cpp-compatible API (v1 endpoints)
• Integrate llama.cpp inference engine
• GPU passthrough (CUDA backend)
• Streaming token generation
• vLLM optimizations for transformer serving

Documentation

• Architecture Overview
• Getting Started
• Project Specification
• GPU Backend Analysis
• llama.cpp Integration
• HTTP Server Design

License

See LICENSE for details.

---

Part of the Cognisoc stack

Cognisoc builds open-source LLM inference for every language and every device — LLM inference, everywhere. This project is one of six:

Project	Language	What it does
mullama	Python · Node · Go · PHP · Rust · C	Local LLM runtime & server, drop-in Ollama alternative
unillm	Rust	Modular inference runtime, 47 architectures
llamafu	Dart / Flutter	On-device inference for mobile apps
llmdot	C# / .NET	Local GGUF inference for the .NET ecosystem
cllm (this project)	C	Bare-metal unikernel — boots straight into inference
zigllm	Zig	Learn LLMs by building one, from tensors to text

🌐 cognisoc.com · 📚 docs.cognisoc.com · 🐙 github.com/cognisoc

---