Week of 06/17/2024 Running 3B Mamba2 with configuration suggested by Tri Dao and Albert Gu for 300B tokens on FineWeb-Edu