Don’t Do Gradient Accumulation for Small Batch Sizes!

Don’t Do Gradient Accumulation for Small Batch Sizes!

a month ago
Anonymous $3GYXp5b5Gs