feat: add ovoscope end2end intent-routing tests#43
Conversation
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
I've scrutinized every line of your PR. Here's the report. 🧐I've aggregated the results of the automated checks for this PR below. 📊 CoverageEnsuring every change is backed by a test. ✅ 🏷️ Release PreviewEvaluating the excitement level for the next release. 🤩 Current:
✅ PR title follows conventional commit format. 🚀 Release Channel Compatibility Predicted next version:
🎙️ SkillChecking the skill's compatibility with various platforms. 💻 🎙️ (unknown skill_id) — 9 languages en-US: 10 intents · 12 dialogs · skill.json Translation coverage — 8 languages (8 complete)
🔒 Security (pip-audit)Scanning for any potential privilege escalations. 🪜 ✅ No known vulnerabilities found (69 packages scanned). 🔌 Skill Tests (ovoscope)I've tuned the Ovoscope to your skill's frequency. 📻 ❌ 0/46 passed, 46 failed ❌ **TestPadatious10_Query_langs_intent** — 0/5
❌ **TestPadatious1_Query_kernel_version_intent** — 0/4
❌ **TestPadatious2_Query_gpu_intent** — 0/4
❌ **TestPadatious3_Query_cpu_usage_intent** — 0/5
❌ **TestPadatious4_Query_memory_usage_intent** — 0/5
❌ **TestPadatious5_Query_user_location_intent** — 0/4
❌ **TestPadatious6_Query_ovos_location_intent** — 0/4
❌ **TestPadatious7_Query_user_lang_intent** — 0/5
❌ **TestPadatious8_Query_primary_lang_intent** — 0/5
❌ **TestPadatious9_Query_extra_langs_intent** — 0/5
🚌 Bus CoverageHow much of the bus logic is under the microscope? 🔬 ⚖️ License CheckI've checked the license history of this repo. 📜 ✅ No license violations found (50 packages). License distribution: 12× MIT License, 8× MIT, 7× Apache Software License, 6× Apache-2.0, 3× BSD-3-Clause, 2× ISC License (ISCL), 2× PSF-2.0, 2× Python Software Foundation License, +7 more Full breakdown — 50 packages
Copyright (c) 2022 Phil Ewels Permission is hereby granted, free of charge, to any person obtaining a copy The above copyright notice and this permission notice shall be included in all THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR Policy: Apache 2.0 (universal donor). StrongCopyleft / NetworkCopyleft / WeakCopyleft / Other / Error categories fail. MPL allowed. 🔍 LintChecking the status... yep, it's done! ✅ ❌ ruff: issues found — see job log 📋 Repo HealthChecking if we're following maintenance best practices. 📏 ✅ All required files present. Latest Version: ✅ 🔨 Build TestsThe build report has been filed and is ready. 📁
❌ 3.10: Install OK, tests failed Your automated companion in the OpenVoiceOS journey. 🤝 |
…ious assertions Suppresses speak/mycroft.audio.play_sound noise so message-count checks are not thrown off by extra bus events; routing verified via activation_points. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Auto-generated ovoscope intent-routing tests.
Covers Padatious intents (exact message-type assertions) and Adapt intents
(speak-response assertions). One test method per canonical utterance.
Generated by
tools/gen_ovoscope_tests.pyfrom the dataset atknowledge/datasets/ovoscope/test_dataset.jsonl.Run:
pytest test/end2end/ -v --timeout=60