Don’t Do Gradient Accumulation for Small Batch Sizes!

Don’t Do Gradient Accumulation for Small Batch Sizes!

yesterday
Anonymous $3GYXp5b5Gs