Adam and AdamW

Adam is an optimizer that adjusts each weight's step size using running averages of recent gradients; AdamW is a version that handles weight decay separately and is widely used to train large models.

Also known as AdamW.