Skip to content

Fix/audit corrections - #117

Merged
alirezabayatmk merged 4 commits into
mainfrom
fix/audit-corrections
Jul 14, 2026
Merged

Fix/audit corrections#117
alirezabayatmk merged 4 commits into
mainfrom
fix/audit-corrections

Conversation

@alirezabayatmk

Copy link
Copy Markdown
Member

Summary 📝

A few steps could give wrong or degraded results on some models; this fixes them.

Details

  1. Model defaults dtype="auto": float32 for small models and bfloat16 for large ones, so small-model logits stay correct.
  2. The Intervene step now gives an error when a direction targets no hooked site, instead of returning the clean generation as the intervened one.
  3. LogitLens no longer stores the full vocab probabilities by default; pass store_full_probs=True to keep them.
  4. LogitAttribution now handles Gemma-family RMSNorm, so its completeness holds there.

Checks

  • Tested Changes: added tests for weight ablation, SAE capture, the logit-lens ground truth, and the dtype estimate; validated on gpt2, pythia-160m, Llama-3.2-1B, Qwen2.5-0.5B, and gemma-2-2b.

@alirezabayatmk
alirezabayatmk merged commit 7db36c9 into main Jul 14, 2026
5 checks passed
@alirezabayatmk
alirezabayatmk deleted the fix/audit-corrections branch July 14, 2026 21:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant