This repository contains the official implementation for the paper:
Orthogonal Finetuning Made Scalable (paper).
🚧 Work in Progress 🚧
This codebase is currently under development. The implementation will be made available soon.
If you find this work useful in your research, please cite our paper:
@article{qiu2025orthogonal,
title={Orthogonal Finetuning Made Scalable},
author={Qiu, Zeju and Liu, Weiyang and Weller, Adrian and Sch{\"o}lkopf, Bernhard},
journal={arXiv preprint arXiv:2506.19847},
year={2025}
}