https://techcrunch.com/2019/03/18/nvidia-announces-its-next-gen-rtx-servers-with-up-to-1280-gpus/

Nvidia wants to be a cloud powerhouse. While its history may be in graphics cards for gaming enthusiasts, its recent focus has been on its data center GPUs for AI, machine learning inference, inference and visualization. Today, at its GTC conference, the company announced its latest RTX server configuration for Hollywood studios and others who need to quickly generate visual content.

A full RTX server pod can support up to 1,280 Turing GPUs on 32 RTX blade servers. That’s 40 GPUs per server, with each server taking up an 8U space. The GPUs here are Quadro RTX 4000 or 6000 GPUs, depending on the configuration.