optimal transport

Solving Moe Load Imbalance in LLM Training via Optimal Transport

TAOT method improves MoE training speed by 43% while reducing communication costs by 74%.