Skip to content

Improve shared Stellaris game knowledge - #39

Draft
gitmaan wants to merge 7 commits into
mainfrom
codex/shared-game-knowledge
Draft

Improve shared Stellaris game knowledge#39
gitmaan wants to merge 7 commits into
mainfrom
codex/shared-game-knowledge

Conversation

@gitmaan

@gitmaan gitmaan commented Aug 2, 2026

Copy link
Copy Markdown
Owner

Summary

  • give Advisor and Chronicle one provider-neutral, versioned mechanics snapshot
  • correct high-risk Pegasus rules for growth, Trade, wars, the Stellar Cannon, and Nomad reserves
  • add human-reviewed provider evaluation cases for natural multi-fact questions and Chronicle evidence restraint

Why

Modern API and local models have different knowledge cutoffs and can confidently apply pre-4.x mechanics. This adds a compact current baseline without teaching each provider separately or treating general game rules as campaign events.

Impact

Gemini, OpenRouter, Ollama, LM Studio, and custom endpoints receive the same current mechanics context in both Advisor and Chronicle. Older or newer game versions are handled conservatively, and mods or save evidence remain authoritative.

Validation

  • python3 -m pytest -q (377 passed, 1 skipped)
  • Electron provider, Chronicle publishing, and updater tests (28 passed)
  • renderer production build
  • PyInstaller backend build and authenticated packaged health smoke
  • 84 production-limit live OpenRouter responses across DeepSeek V4 Flash, Claude Sonnet 5, Gemini 3.1 Flash Lite, and GPT-5.6 Luna; 75 accurate/acceptable, 9 concerning secondary details, 0 materially incorrect
  • 12 focused reruns after final clarifications; all central criteria passed with no provider or schema failures

gitmaan added 7 commits August 1, 2026 14:40
Centralize version-aware mechanics resolution with exact, partial, and unsupported coverage states so stale rules are not presented as current facts.

Inject the same evidence hierarchy and Pegasus 4.4.6 snapshot into Advisor and every Chronicle generation path, including structured retries and recaps.

Add bundle resource-path coverage, source maintenance guidance, and a provider-neutral raw-response harness for flexible human evaluation across current models.
Retry one empty provider response during structured Chronicle generation using the existing corrective-attempt budget.

Route Chronicle knowledge evaluations through the production Chronicle wrapper so provider tests cover schema fallback, validation, and retry behavior end to end.
Document how version-aware mechanics snapshots support models with different training cutoffs across Advisor and Chronicle. Record the human-reviewed stale-premise test outcome and the maintenance workflow for future game releases.
Audit every stable Stellaris 4.x release line and hotfix through Pegasus 4.4.6 against official Paradox announcements, then verify disputed values against the installed game data and representative save structure.\n\nCorrect the population growth floor guidance, add missing material systems from Lyra through Pegasus, record DLC and source provenance, and extend regression plus human-review model cases. Keep Cygnus open-beta mechanics excluded from the stable snapshot.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant