Pull in upstream changes from `argonne-lcf/Megatron-DeepSpeed`#1

Open

saforem2 wants to merge 702 commits intoramanathanlab:mainfrom

argonne-lcf:main

This pull request is big! We're only showing the most recent 250 commits

Commits on Dec 29, 2024

Merge pull request #73 from argonne-lcf/docs-ucp-bug
saforem2
authored

Commits on Jan 14, 2025

feat: Add `ALCF/examples/finetune_llama3/*`
saforem2
committed

Commits on Jan 16, 2025

Commits on Jan 17, 2025

Add {sunspot, sophia} in `ALCF/examples/finetune_llama3/*`
saforem2
committed

Commits on Jan 18, 2025

Merge branch 'main' into finetune-llama3
saforem2
authored

Commits on Jan 19, 2025

fix: Call `set_ccl_vars_on_aurora` only if `WORLD_SIZE > 1`
saforem2
committed

Commits on Jan 27, 2025

Commits on Jan 28, 2025

Commits on Jan 31, 2025

Commits on Mar 12, 2025

Commits on Mar 20, 2025

added muon
Marieme Ngom
committed

Commits on Mar 24, 2025

added muon optimizer
Marieme Ngom
committed
added muon optimizer
Marieme Ngom
committed

Commits on Mar 26, 2025

Commits on Apr 21, 2025

added infinite schedulers
Marieme Ngom
committed

Commits on Apr 22, 2025

fix: Fix imports in `pretrain_gpt_alcf.py`
saforem2
committed

Commits on May 1, 2025

chore: Fix unset `CFLAGS` in `ALCF/helpers.sh`
saforem2
committed

Commits on May 5, 2025

chore: Update `train_alcf.sh`
saforem2
committed

Commits on May 6, 2025

Commits on May 19, 2025

feat: Resolve conflicts in `train_alcf.sh`
saforem2
committed

Commits on Jun 18, 2025

Commits on Jul 3, 2025

infinite schedulers and learning rate finder
Marieme Ngom
committed

Commits on Jul 11, 2025

micromamba
Marieme Ngom
committed
emb_init branch changes added
Marieme Ngom
committed
cleaned up
Marieme Ngom
committed

Commits on Jul 14, 2025

Commits on Jul 15, 2025

Commits on Jul 22, 2025

fixed infinite schedulers bugs and dshampoo name in arguments
Marieme Ngom
committed

Commits on Aug 7, 2025

Commits on Aug 15, 2025

chore: Update `ALCF/helpers.sh`
saforem2
committed

Commits on Aug 16, 2025

cache indices support
zhenghh04
committed

Commits on Aug 21, 2025

Commits on Aug 22, 2025

chore: Update `ALCF/helpers.sh`
saforem2
committed

Commits on Aug 24, 2025

Added muonclip and fixed lr_finder logic
Marieme Ngom
committed

Commits on Aug 25, 2025

Commits on Aug 27, 2025

Commits on Sep 3, 2025

Merge pull request #93 from argonne-lcf/feature/cache_indices
saforem2
authored

Commits on Sep 8, 2025

Merge pull request #88 from argonne-lcf/saforem2/fix-formatting
saforem2
authored

Commits on Sep 17, 2025

Merge pull request #14 from argonne-lcf/main
saforem2
authored

Commits on Sep 23, 2025

Commits on Sep 24, 2025

chore: Update `train_aGPT_2B_large_batch.sh`
saforem2
committed

Commits on Sep 26, 2025

Update cpt.md
mngom2
authored

Commits on Sep 30, 2025

Commits on Oct 7, 2025

Commits on Oct 10, 2025

Commits on Oct 12, 2025

fix: Update `ALCF/helpers.sh`
saforem2
committed

Commits on Nov 11, 2025

Commits on Nov 18, 2025

fix: Update default `ROPE_THETA` in `ALCF/helpers.sh`
saforem2
committed

Commits on Dec 10, 2025

Merge pull request #18 from argonne-lcf/main
saforem2
authored

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Commits on Jan 28, 2026

Commits on Jan 29, 2026

Update large_batch_optimizers_settings.md
mngom2
authored

Commits on Jan 30, 2026

Update large_batch_optimizers_settings.md
mngom2
authored

Commits on Jan 31, 2026

Merge branch 'main' of https://github.com/argonne-lcf/Megatron-DeepSpeed into auto_cooldown_script
saforem2
committed

Commits on Mar 11, 2026

Merge branch 'main' into main
saforem2
authored