Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
-
Updated
Apr 13, 2026 - Python
#
ai-benchmark
Here are 130 public repositories matching this topic...
An agent benchmark with tasks in a simulated software company.
-
Updated
Nov 17, 2025 - Python
Frontier Models playing the board game Diplomacy.
-
Updated
Jun 1, 2026 - Python
Ranking LLMs on agentic tasks
-
Updated
May 21, 2026 - Jupyter Notebook
The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai
-
Updated
Jul 20, 2026 - Python
AI clothes swap prompt cookbook with 50 virtual try-on prompts, KIE GPT Image before/after examples, failure fixes, and a benchmark rubric for AIClothSwap.
image-editing before-after virtual-try-on fashion-ai prompt-examples outfit-generator ai-benchmark ecommerce-fashion gpt-image prompt-cookbook ai-clothes-swap ai-clothes-changer ai-dress-up clothes-color-changer aiclothswap virtual-try-on-prompts kie-gpt-image
-
Updated
Jul 9, 2026 - HTML
开源劳动者AI研究与评测项目：建设劳动知识、公开评测基准与共同治理机制｜Open worker-centered AI research and evaluation project.
labor-rights workers-rights ai-ethics working-class responsible-ai ai-evaluation ai-governance open-source-ai ai-benchmark worker-ai algorithmic-management worker-centered-ai working-class-ai labor-studies
-
Updated
Aug 10, 2026 - Python
llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while providing deep hardware intelligence.
-
Updated
Mar 15, 2026 - Python
🤖 A curated list of resources for testing AI agents - frameworks, methodologies, benchmarks, tools, and best practices for ensuring reliable, safe, and effective autonomous AI systems
testing qa benchmark machine-learning evaluation chaos artificial-intelligence chaos-monkey testing-tools awesome-list quality-assurance ai-safety ai-agents chaos-engineering llm llm-evaluation agentic-ai ai-benchmark agent-evaluation
-
Updated
May 28, 2025
A visual benchmark testing whether leading coding agents repeat the same design patterns across 100 neutral website briefs.
-
Updated
Jul 26, 2026 - HTML
Benchmarking and evaluation resources for trust, robustness, and reliability analysis in graph-based AI systems.
-
Updated
Aug 3, 2026 - Python
📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.
benchmark machine-learning ai leaderboard text-to-video llm lmsys ai-benchmark chatbot-arena arena-ai
-
Updated
Aug 17, 2026 - Python
Daily evidence-first radar for AI benchmarks, evaluations, datasets, and data quality.
benchmarking leaderboard evaluation datasets model-cards llm llm-evaluation ai-benchmark research-radar
-
Updated
Aug 17, 2026 - Python
MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments and tool use. Supports multiple providers (OpenAI, Google, Anthropic, DeepSeek, Mistral AI, xAI, Alibaba, Moonshot AI, OpenRouter), custom tasks in YAML, and HTML/CSV/JSON reports.
opensource openai xai artificial-intelligence-projects anthropic ai-tool openrouter qwen deepseek mistral-ai llm-evaluation-framework google-gemini-ai llm-benchmarking moonshot-ai language-models-ai llm-comparison ai-benchmark ai-evaluation-tools grok-ai ai-model-comparison
-
Updated
Aug 5, 2026 - Go
Precision-aware retrieval benchmark for LLM memory systems.
benchmark information-retrieval ai memory evaluation memory-benchmark ai-agents long-term-memory rag llm ai-memory ai-benchmark memory-evaluation
-
Updated
Jul 28, 2026 - TypeScript
GDB: GraphicDesignBench - A real-world benchmark for evaluating AI on graphic design tasks
svg design benchmark layout evaluation typography graphic-design lottie vlm multimodal vision-language-model ai-benchmark
-
Updated
May 5, 2026 - Python
Benchmark for evaluating AI epistemic reliability - testing how well LLMs handle uncertainty, avoid hallucinations, and acknowledge what they don't know.
python nlp benchmark machine-learning ai evaluation collaborate ai-safety llm llm-evaluation hallucination-detection ai-benchmark llm-benchmark
-
Updated
Mar 22, 2026 - Python
A curated list of evaluation tools, benchmark datasets, leaderboards, frameworks, and resources for assessing model performance.
-
Updated
Jul 28, 2026 - Python
Benchmark abierto en español de 170 modelos de IA (118 con 20+ runs, 69 rankeados, juez Phi-4 independiente). Calidad, costo, velocidad, long-context y fuga de credenciales como dimensiones separadas. Alternativas a Claude, GPT y Gemini para agentes n8n/Hermes. Calculadora interactiva con tus propios pesos.
ai-agents startup-tools n8n ai-models emprendedores openrouter ollama llm-evaluation llm-comparison ai-benchmark llm-benchmark spanish-ai openclaw hermes-agent claude-alternatives gpt-alternatives phi4-judge benchmark-en-espanol emprendedores-ia
-
Updated
Aug 17, 2026 - Python
GTA (Guess The Algorithm) Benchmark - A tool for testing AI reasoning capabilities
python docker flask benchmark machine-learning puzzle reverse-engineering educational pattern-recognition ctf binary-analysis algorithm-analysis computational-thinking algorithmic-reasoning ai-benchmark
-
Updated
Jan 12, 2025 - Python
Improve this page
Add a description, image, and links to the ai-benchmark topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-benchmark topic, visit your repo's landing page and select "manage topics."