Visualization Rastrigin AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdamG AdamMini AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdaTAM AdEMAMix ADOPT AggMo Aida AliG Amos APOLLO ApolloDQN ASGD AvaGrad BSAM CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad EXAdam FAdam FOCUS Fromage FTRL GaLore Grams Gravity GrokFastAdamW Kate Kron Lamb LaProp LARS Lion MADGRAD MARS MSVAG Muon Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 Ranger25 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SGD SGDP SGDSaI SGDW Shampoo SignSGD SM3 SOAP SophiaH SPAM SRMM StableAdamW SWATS TAM Tiger Yogi Rosenbrock AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdamG AdamMini AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdaTAM AdEMAMix ADOPT AggMo Aida AliG Amos APOLLO ApolloDQN ASGD AvaGrad BSAM CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad EXAdam FAdam FOCUS Fromage FTRL GaLore Grams Gravity GrokFastAdamW Kate Kron Lamb LaProp LARS Lion MADGRAD MARS MSVAG Muon Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 Ranger25 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SGD SGDP SGDSaI SGDW Shampoo SignSGD SM3 SOAP SophiaH SPAM SRMM StableAdamW SWATS TAM Tiger Yogi
