GitHub - amudide/switch_sae: Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)

More soon!

Credits

This repository is adapted from dictionary_learning by Samuel Marks and Aaron Mueller.

Name		Name	Last commit message	Last commit date
Latest commit History 140 Commits
.vscode		.vscode
auto_interp		auto_interp
compare_geometry		compare_geometry
dictionary_learning		dictionary_learning
other		other
results		results
sae-auto-interp @ 118b067		sae-auto-interp @ 118b067
scaling_laws/attempt0		scaling_laws/attempt0
table		table
.gitignore		.gitignore
.gitmodules		.gitmodules
README.md		README.md
config.py		config.py
save_activations.py		save_activations.py
speed.ipynb		speed.ipynb
train-gated.py		train-gated.py
train-jump.py		train-jump.py
train-moe.py		train-moe.py
train-relu.py		train-relu.py
train-switch-1on.py		train-switch-1on.py
train-switch-flop.py		train-switch-flop.py
train-switch.py		train-switch.py
train-topk.py		train-topk.py