AniZenith

An Anime Recommendation chatbot using Gradio, huggingface_hub, and the Hugging Face Inference API.

Models Used by AniZenith

Type of Model	Model Name (Hugging Face Path)
Local Model	Qwen/Qwen3-0.6B
Inference Client Model	openai/gpt-oss-20b

Working with UV (Ultra-Violet)

Install UV

Please download uv (Ultra-Violet) for Python Project Dependency Management: https://docs.astral.sh/uv/getting-started/installation/#installation-methods

Initializing a uv virtual env

Run following commands by navigating to the project directory:

cd /path/to/your/project
uv sync

Activating the virtual env

In the same project directory, execute the following (if virtual env is not already active):

source .venv/bin/activate

Adding any Libraries / Dependencies

To add any new dependencies (libraries):

uv add <library_name>

Case Study 3

Login to VM

ssh -i ssh_keys/group02_key -p 22000 group02@paffenroth-23.dyn.wpi.edu

Useful Links

1. Frontend (ngrok): https://misty-subpalmate-liza.ngrok-free.dev/
2. Grafana (ngrok): https://misty-subpalmate-liza.ngrok-free.dev/grafana

cURL commands to Test Backend Chat API

Remote Hosted Backend (on VMs)

For Using Online Model:

curl --location 'http://paffenroth-23.dyn.wpi.edu:22021/anizenith/chat' \
--header 'Content-Type: application/json' \
--data '{
    "messages": [
        {
            "role": "user",
            "content": "Give me action based anime"
        }
    ],
    "use_local": false
}'

For Using Local Model:

curl --location 'http://paffenroth-23.dyn.wpi.edu:22021/anizenith/chat' \
--header 'Content-Type: application/json' \
--data '{
    "messages": [
        {
            "role": "user",
            "content": "Give me action based anime"
        }
    ],
    "use_local": true
}'