Do you suppose this also holds true for AdEMAMix? https://arxiv.org/abs/2409.03137
Still elementwise, so yeah
Do you suppose this also holds true for AdEMAMix? https://arxiv.org/abs/2409.03137
Still elementwise, so yeah