Skip to content
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🥽 Rokid OpenClaw

Rokid AI Glasses + OpenClaw — glasses-direct, voice-first wearable AI

The Rokid AI Glasses connect directly to OpenClaw Gateway over WiFi — no phone needed. Talk to Claude, capture your world through the 12MP camera, and get AI responses on your monochrome green HUD.


✨ Planned Features

Feature Description
🎤 Voice Input 4-mic array captures speech, transcribed and sent to OpenClaw
📸 Camera Capture 12MP camera frames sent to Claude's vision API
🖥️ HUD Display AI responses on 480×640 monochrome green micro-LED
🔊 TTS Responses Claude speaks back via built-in speakers
🔗 Session Management Persistent conversation sessions via OpenClaw Gateway
📡 Wake Word Always-on listening with configurable wake word
🗺️ Context Awareness Location, time, and sensor data piped into prompts

🏗️ Architecture

The Rokid AI Glasses run Android internally and can run sideloaded Jetpack Compose APKs. They connect directly to OpenClaw Gateway over WiFi — no phone middleman required.

┌─────────────────────────────────────────────────────────────────┐
│                      Rokid AI Glasses                           │
│                                                                 │
│  🎤 4-mic array ──► Voice capture & transcription               │
│  📸 12MP camera ──► Frame capture for Claude vision             │
│  🖥️ 480×640 green micro-LED ◄── HUD chat display              │
│  🔊 Built-in speakers ◄── TTS playback                         │
│  📡 WiFi ──► WebSocket client                                   │
└─────────────────────────────────────────────────────────────────┘
                              │
                              │  WiFi / WebSocket
                              ▼
┌─────────────────────────────────────────────────────────────────┐
│                     OpenClaw Gateway                            │
│  • Claude API (Anthropic)                                       │
│  • Tool execution (web search, memory, etc.)                    │
│  • Session persistence                                          │
└─────────────────────────────────────────────────────────────────┘
                              │
                              ▼
┌─────────────────────────────────────────────────────────────────┐
│                         Claude                                  │
│  • Vision (camera frames)                                       │
│  • Conversation                                                 │
│  • Tool use                                                     │
└─────────────────────────────────────────────────────────────────┘

No phone bridge needed — the glasses app handles everything:

  • glasses-app/ — Standalone Android app (Kotlin/Jetpack Compose) running on the glasses
  • phone-app/ — Reserved for future Rokid Max/AR line (requires phone bridge)
  • shared/ — Protocol definitions shared between components

🙏 Inspiration

This project is directly inspired by Clawsses by @dweddepohl — a Claude-powered smart glasses app. Clawsses proved the concept beautifully; Rokid OpenClaw adapts it for the Rokid AI Glasses with a direct WiFi connection to OpenClaw's persistent session architecture.

Go give Clawsses a ⭐!


📋 Requirements

  • Android Studio (latest stable)
  • OpenClaw Gateway — running locally or remote
  • Rokid AI Glasses (with WiFi connectivity)
  • WiFi network accessible to both glasses and Gateway

📚 Resources


🚀 Getting Started

🚧 This project is in early scaffolding phase. Check back soon!

  1. Clone this repo
  2. Open glasses-app/ in Android Studio
  3. Build and sideload the APK to your Rokid AI Glasses
  4. Connect the glasses to your WiFi network
  5. Configure your OpenClaw Gateway URL in the app settings
  6. Say the wake word and start chatting!

🔄 Self-Update System

The glasses app includes a built-in dynamic code loader that checks for updates on every launch:

  1. On launch, the LoaderActivity checks the GitHub releases API for the latest version
  2. If an update is available, the HUD prompts: "Update available v1.2 — Tap to update / Skip"
  3. On update, it downloads the new code bundle (DEX) from the release assets
  4. Loads dynamically via DexClassLoader — no reinstall needed
  5. Fallback: if offline or check fails, launches the last downloaded (or built-in) version

This means the app can self-update without needing to sideload a new APK. Just publish a new GitHub release with a .dex or .jar asset.

The loader UI matches the green-on-black monochrome aesthetic of the 480×640 micro-LED display.


📁 Project Structure

rokid-openclaw/
├── glasses-app/        # Standalone glasses app (Kotlin/Jetpack Compose)
│   └── src/main/java/.../loader/  # Self-update loader (static entry point)
├── phone-app/          # Future: phone companion for Rokid Max/AR line
├── shared/             # Protocol definitions & data models
└── README.md

📄 License

MIT — build on it, hack it, make it yours.

About

Rokid AI Glasses + OpenClaw integration — voice-first wearable AI

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages