Don’t Do Gradient Accumulation for Small Batch Sizes!

Don’t Do Gradient Accumulation for Small Batch Sizes!

2 months ago
Anonymous $3GYXp5b5Gs