[codex] Desktop local-first Rust daemon MVP by Git-on-my-level · Pull Request #7400 · BasedHardware/omi

Git-on-my-level · 2026-05-20T02:44:57Z

Summary

Adds a desktop-first local/hybrid MVP path for Omi Desktop built around a new lightweight Rust local daemon under desktop/local-backend.

Major pieces:

local Axum + SQLite/WAL daemon for profile/settings, conversations, transcript segments, search, memories, action items, and processing jobs
deterministic fallback conversation processing plus direct OpenAI-compatible provider support when explicitly configured
desktop local-daemon routing via OMI_DESKTOP_BACKEND_MODE=local and OMI_LOCAL_DAEMON_URL
local-mode guards for cloud-only or hosted surfaces including public sharing, folders/merge, managed agent VM, payments/quota, Crisp, Persona, AI profile sync, proactive/staged task paths, API-key fetches, and provider proxy helpers
local memory import/listing support including local batch memory import and pagination/filter routing
local MVP runbook, architecture docs, smoke tests, and expanded Swift routing tests

Why

This is intended to let developers run a useful Omi Desktop local-first profile without requiring Omi-hosted backend services for core MVP flows. Explicit user-configured provider egress remains allowed for hybrid LLM/STT usage, but Omi backend/Firebase/Firestore/Redis/GCS/pusher/agent-proxy are not prerequisites for local core flows.

Manual run

Start the local daemon:

cd desktop/local-backend
cargo run -- --bind 127.0.0.1:8765

Run the desktop dev app against it:

export OMI_DESKTOP_BACKEND_MODE=local
export OMI_LOCAL_DAEMON_URL=http://127.0.0.1:8765
cd desktop
./run.sh

Validation

Passed locally:

python3 .codex-autorunner/bin/lint_tickets.py
desktop/local-backend/tools/local_only_self_test.sh
cd desktop/local-backend && cargo fmt --check && cargo test
cd desktop && xcrun swift test --package-path Desktop --filter APIClientRoutingTests

Latest focused results:

local backend Rust tests: 25 passed
Swift APIClientRoutingTests: 82 passed
local-only MVP self-test: passed daemon smoke and desktop local-mode routing boundary

Notes

This is opened as a draft because the diff is large and should get manual developer testing on another machine before review-ready status.

…tion retry - Major APIClient.swift refactor: structured routing layer (+609/-1) - Add DesktopBackendEnvironment with configurable endpoint resolution (+62) - Harden TranscriptionRetryService with exponential backoff (+35/-19) - Add APIClientRoutingTests with comprehensive route coverage (+91) - Update .env.example with new backend environment variables

Map completed to status for PATCH v1/action-items in local mode, and add GET v1/conversations/count in the local Rust backend so the desktop client avoids loading full conversation rows just to count them.

…l-mode UI - Major ConversationDetailView.swift refactor (+2,378 lines changed) - Add local-mode toggle to SettingsPage - Update ConversationsPage with local-first indicators - Expand .env.example with local backend config - Update local-backend README and MVP runbook

Desktop routes chat, embeddings, vision, and Apple Speech STT through configurable local providers; the daemon gains folders, merge, chat sessions, and provider test/seed tooling for end-to-end hybrid dev. Co-authored-by: Cursor <cursoragent@cursor.com>

Route hybrid chat and proactive LLM through a localhost Codex proxy using ~/.codex auth, add Settings enrollment UX, local memory wiki + FTS for search, backend tier activation, and bundle the proxy in run.sh. Co-authored-by: Cursor <cursoragent@cursor.com>

Reuse a healthy loopback proxy instead of respawning, surface proxy stderr on failure, skip cloud enrollment in local daemon mode, and refresh Settings immediately via CodexAuthStore. Co-authored-by: Cursor <cursoragent@cursor.com>

…e for local profiles

Co-authored-by: Cursor <cursoragent@cursor.com>

(cherry picked from commit aad2f58)

(cherry picked from commit 65bfaa6)

(cherry picked from commit a18d2bb)

(cherry picked from commit c1e5d0d)

(cherry picked from commit b739064)

(cherry picked from commit 5e7bc7b)

(cherry picked from commit 5892f09)

…blocking (cherry picked from commit c649016)

(cherry picked from commit 3fcd52e)

(cherry picked from commit 938c01c)

…n, and storage (cherry picked from commit 6cfc3f9)

(cherry picked from commit 660155a)

(cherry picked from commit c8c87a9)

…tifacts (cherry picked from commit 85d5728)

Require X-ChatGPT-Fingerprint on requests for quota and subscription bypass, refresh enrollment heartbeat from desktop launch and throttled server updates, resolve Codex transport at call time in GeminiClient, label wiki search hits distinctly from tasks, and include memory id in wiki slugs to avoid collisions. (cherry picked from commit 63fde7b)

David Zhang and others added 30 commits May 18, 2026 20:55

Scaffold local Rust backend

fc61725

Add local backend SQLite storage

8f60686

Expose local backend MVP APIs

491246a

Fix desktop local daemon Swift validation

9f5d918

Add local conversation processing jobs

7c26d4f

Add local-first capability boundaries

25c4bae

Validate local backend MVP end to end

1977698

Add local MVP transcript import runbook

1d7cef1

Add local daemon dev supervision

dfc3f35

Fix local daemon action-item completion and conversation count API

d28259e

Map completed to status for PATCH v1/action-items in local mode, and add GET v1/conversations/count in the local Rust backend so the desktop client avoids loading full conversation rows just to count them.

Close local-mode conversation cloud leaks

b5dd990

Make local ingestion retries idempotent

c8722d9

Polish local daemon launch path

dc88c42

Add local-only MVP self-test

0e4dddf

Document desktop routing test command

2638675

Harden local daemon retry contract

1d8d95b

Close desktop local-mode cloud leaks

d0ea4d4

Localize visible local-mode surfaces

75bb204

Expand local MVP boundary verification

93aff70

Harden local daemon processing contracts

4e1203f

Polish local-mode desktop surfaces

dad7510

Harden desktop auth secret boundaries

1d3293a

Close local memory import and listing gaps

2792f49

Close local mode proactive cloud leaks

b3005d3

Update .gitignore to include cursor and desktop build artifacts

149d1a6

David Zhang and others added 28 commits May 20, 2026 13:13

feat(local-backend): add hybrid provider settings, routes, and storag…

22e2787

…e for local profiles

Add local model catalog defaults

f07100d

Run local processing through post transcript slot

cb6df9f

Route proactive assistants through local slots

0720be7

Make local Ask Omi use chat slot policy

58f06ad

Expose local provider slot readiness

90eb0b2

Keep hybrid local embeddings opt-in

37e59b2

Ignore local-asr-helper Rust build artifacts.

a82c529

Co-authored-by: Cursor <cursoragent@cursor.com>

Add desktop transcription provider architecture

818e2dd

(cherry picked from commit aad2f58)

Ignore nested target directories

1b6ff13

(cherry picked from commit 65bfaa6)

Add local ASR helper scaffold

22bb456

(cherry picked from commit a18d2bb)

Wire local PTT transcription routing

0e5cc29

(cherry picked from commit c1e5d0d)

Add local transcription desktop choice

b2063dc

(cherry picked from commit b739064)

Add real local ASR helper runtime

b6bcdd3

(cherry picked from commit 5e7bc7b)

Narrow local background transcription scope

4f48a48

(cherry picked from commit 5892f09)

Fix transcription word count corruption and main-thread engine probe …

9ee7db2

…blocking (cherry picked from commit c649016)

Reorient desktop local transcription settings

99e267e

(cherry picked from commit 3fcd52e)

Add local background ASR chunk queue

772d264

(cherry picked from commit 938c01c)

feat(desktop): wire local transcription state, ASR runtime integratio…

f0ab806

…n, and storage (cherry picked from commit 6cfc3f9)

feat(desktop): add local background ASR harness

e7f2873

(cherry picked from commit 660155a)

Fix local background transcription gating

6ffb6e0

(cherry picked from commit c8c87a9)

Update .gitignore files to exclude agent-generated plans and build ar…

e85360b

…tifacts (cherry picked from commit 85d5728)

Resolve cherry-pick integration warnings

5585c01

Fix local provider policy seeding

dae1f80

Track hybrid local tmux launcher

370e25e

Add local ASR add-on flow

0427505

Polish local desktop transcription setup

00756cd

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[codex] Desktop local-first Rust daemon MVP#7400

[codex] Desktop local-first Rust daemon MVP#7400
Git-on-my-level wants to merge 58 commits into
BasedHardware:mainfrom
Git-on-my-level:codex/ticket-003-local-backend-apis

Git-on-my-level commented May 20, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants