#Adan

Showing 2 of 2 repositories tagged #adan, ranked by stars

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

★ 819 ⑂ 69 —

pytorch_optimizer

optimizer & lr scheduler & loss function collections in PyTorch

★ 421 ⑂ 42 +1/day

Related Topics

#deep-learning #optimizer #pytorch #artificial-intelligence #bert-model #convnext #cuda-programming #diffusion #dreamfusion #fairseq #gpt2 #llm-training