Skip to content

feat: add ER evaluation#4

Open
YongboYu wants to merge 2 commits into
mainfrom
feature/eval-er
Open

feat: add ER evaluation#4
YongboYu wants to merge 2 commits into
mainfrom
feature/eval-er

Conversation

@YongboYu
Copy link
Copy Markdown
Owner

@YongboYu YongboYu commented Dec 28, 2025

Note

Adds a fast, refactored entropic relevance evaluation pipeline with scripts and utilities, generating per-window and summary metrics.

  • New pmf_benchmark.metrics.entropic_relevance package: DFGConstructor, BackgroundModel, ER automaton/calculator, and orchestration (er_evaluation.py, run_fast.py) producing CSV/JSON and using caching
  • CLI entry run_er_evaluation.py and Hydra runner scripts/run_er_evaluation_hydra.py with config configs/er/er_fast.yaml
  • Packaging/tooling: update pyproject.toml to setuptools layout, add dev extras and Ruff config
  • Update .gitignore to include project data/results paths and uv.lock
  • Remove legacy configs under config/ (base and model/preprocessing YAMLs)

Written by Cursor Bugbot for commit af6f986. This will update automatically on new commits. Configure here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant