https://techcrunch.com/2022/05/24/vultr-will-now-let-you-rent-a-share-of-nvidias-a100-gpus-in-its-cloud/

Vultr, the cloud platform that specializes in providing access to basic infrastructure services at a relatively low cost, today announced the launch of Vultr Talon, a new service that will offer developers access to virtualized GPUs, starting with Nvidia’s A100 Tensor Core GPU, with prices as low as $0.134/hour (or $90/month) for access to a twentieth of the compute power of an A100.

Typically, when you need access to a high-end GPU for machine learning and similar use cases, the smallest unit you can buy is access to the entire GPU. On the CPU side of things, buying just a slice of CPU power is standard, but until now, that just wasn’t possible for GPUs, even though for many use cases, like inferencing, you would only need access to a fraction of the GPU’s compute power.