RAGAS

[Copilotclaw]

can you do a simple ragas noebook with ollama which would run in collab as a tutorial for grags rag evaluation? Style like the graph notebook. linked in the readme.

[github-actions]

Let me look at the existing notebook style more carefully and then build the RAGAS notebook.

Now I have everything I need. Let me build the RAGAS notebook.

Now add it to the README:

Done! Here's what was created:

ragas-evaluation-ollama.ipynb — 25 cells, Colab-ready, fully offline with Ollama.

Covers:

• 📏 All 4 RAGAS metrics (Faithfulness, Answer Relevancy, Context Precision, Context Recall)
• Space Facts corpus → FAISS retrieval → llama3.2 generation → RAGAS scoring
• Deep dive explanations for what each metric actually measures
• 🧨 Degradation experiment (random context) to show scores tank when retrieval fails
• README linked

---

📊 Session | premium: 1 (claude-sonnet-4.6) | 🎟️ Copilot: 921/1500 (61%) | 🏃 CI: (ci-stats unavailable)