Geometric phase structure in Transformer hidden states. LayerNorm placement predicts manifold geometry — 6x difference in PCA concentration. 9 models, 13 experiments.
reproducible-research transformers pytorch open-science pca hidden-states ai-research layernorm mechanistic-interpretability manifold-geometry phase-extraction
-
Updated
Mar 30, 2026 - Python