Popular repositories Loading

1. amd-r9700-vllm-and-tuning-toolkit amd-r9700-vllm-and-tuning-toolkit Public

   AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking

   Shell 9 2

2. amd-vega-rocm-vulkan-llm-toolkit amd-vega-rocm-vulkan-llm-toolkit Public

   Run LLMs on AMD Vega8 / Vega10 APUs and GPUs (Ryzen 5700G / gfx90c and Vega 56/64): ROCm 7 gfx900 backport + Vulkan/RADV launchers, Docker images, benchmarks for llama.cpp and LM Studio

   Shell 8

3. bobcat-monitor bobcat-monitor Public

   Bobcat helium miner monitoring and reset/resync tool for Windows

   C# 3

4. amd-rocmfpx-for-win amd-rocmfpx-for-win Public

   ROCmFPX llama.cpp fork for Windows 🏆 — native build, headless OpenAI-compatible server & benchmarks. Tested on AMD Strix Halo (gfx1151), runs on other GPUs too.

   PowerShell 2 1

5. rag-chatbot rag-chatbot Public

   A locally running RAG chatbot with safety guardrails and RAGAS evaluation, reproduced from three upstream repositories on a single workstation with **rootless podman** and **Ollama on the host** — …

   Python 2

6. multi-gpu-llm multi-gpu-llm Public

   Run llama.cpp across two GPUs of different vendors at once (AMD ROCm/HIP or Vulkan + NVIDIA CUDA) in one llama-server process, no RPC server. Windows (PowerShell) and Linux (bash) implementations, …

   Shell