Merge branch 'zijiey/a2a_dispatcher_2nd' into 'main'

MoE alltoall token dispatcher optimizations (Token level alltoall dispatcher) Closes #240 See merge request ADLR/megatron-lm!1762
NVIDIA · Aug 23, 2024 · 4ff9e66 · 4ff9e66
2 parents 92f5448 + a110774
commit 4ff9e66
Show file tree

Hide file tree

Showing 15 changed files with 622 additions and 175 deletions.
diff --git a/.gitlab/stages/01.tests.yml b/.gitlab/stages/01.tests.yml
@@ -76,7 +76,7 @@ unit_tests:
   parallel:
     matrix:
       - TAG: latest
-      - TAG: a5efe829b1d34c691f0a7a5286e271b4f9c86b2a
+      - TAG: f2d356582247e1df5a4c0f7c426d33096a394dc1
   tags: [8xL40S]
   variables:
     GIT_STRATEGY: clone