AI-Driven 2D to 3D Jewelry Generation with Real-Time Customization

Team Name: GDuo

JewelAI is a high-end digital jewelry studio that bridges the gap between imagination and reality. By combining generative AI, computer vision, and interactive 3D rendering, our platform allows users to transform images and text descriptions into fully customizable 3D jewelry models with real-time AR try-on capabilities.

🌟 Key Features

1. 2D to 3D Neural Reconstruction

Transform any single image of a ring into a high-fidelity 3D model using state-of-the-art neural reconstruction (powered by Wonder3D).

2. Intelligent Jewelry Assistant

A sophisticated AI concierge (powered by Gemini) that understands your design preferences, detects jewelry components from your uploads, and helps you refine your dream design through natural conversation.

3. Real-Time Customization

Fine-tune every detail of your jewelry:

• Metal Selection: Gold, Silver, Platinum, Rose Gold, and more.
• Gemstone Studio: Choose stone types (Diamond, Ruby, Emerald, etc.) and precisely scale them.
• Structural Controls: Adjust band width, ring style (Solitaire, Halo, Eternity, Cluster), and profile in real-time.

4. Live Virtual Try-On (AR)

Experience your creations instantly. Using MediaPipe hand-tracking, the 3D model is projected directly onto your hand in a live camera feed for a virtual "fitting" experience.

5. Smart Insights & Pricing

Get real-time market value estimations based on your custom design, factoring in metal weight, gemstone quality, and architectural complexity.

---

🚀 Tech Stack

Frontend

• Framework: Next.js 14+ (App Router)
• 3D Engine: Three.js (via React Three Fiber & Drei)
• Computer Vision: MediaPipe (Hand & Pose Tracking)
• State Management: Zustand
• Animations: Tailwind CSS & Framer Motion

Backend

• Core: FastAPI (Python)
• AI/ML:
  • Gemini 1.5 Pro/Flash: LLM for chatbot and visual analysis.
  • Zero123 (optional): For 2D-to-3D generation if configured.
  • Wonder3D: Default 2D-to-3D generation.
  • TencentARC/InstantMesh: Fallback for stable 3D reconstruction.

---

🛠️ Installation & Setup

Prerequisites

• Node.js 18+
• Python 3.10+
• Gemini API Key (Google AI Studio)

Backend Setup

1. Navigate to the backend directory:

   cd backend

2. Create and activate a virtual environment:

   python -m venv venv
   .\venv\Scripts\Activate  # Windows
   source venv/bin/activate  # macOS/Linux

3. Install dependencies:

   pip install -r requirements.txt

4. Create a .env file and add your GEMINI_API_KEY.
5. Start the server:

   uvicorn main:app --reload

Frontend Setup

1. Navigate to the frontend directory:

   cd frontend

2. Install dependencies:

   npm install

3. Create a .env.local file and add:

   NEXT_PUBLIC_GEMINI_API_KEY=your_key_here
   NEXT_PUBLIC_API_URL=http://localhost:8000

4. Start the development server:

   npm run dev

---

📁 Project Structure

Syrus2026_GDuo/
├── frontend/
│   ├── app/                # Main application routes
│   ├── components/
│   │   ├── viewer/         # 3D Render & AR Logic
│   │   ├── chat/           # Gemini Chat Panel
│   │   └── controls/       # Jewelry Customization UI
│   ├── hooks/              # Hand & Pose tracking hooks
│   └── store/              # Zustand state (Ring & Pricing)
├── backend/
│   ├── routers/            # API endpoints (3D Gen, Chat)
│   ├── services/           # AI & Model Processing services
│   └── models/             # Data schemas
└── outputs/                # Generated 3D assets

---

🏆 GDuo Team

• Project Title: AI-Driven 2D to 3D Jewelry Generation with Real-Time Customization
• Repository: https://github.com/CMPN-CODECELL/Syrus2026_GDuo