Vultr will now let you rent a share of Nvidia’s A100 GPUs in its cloud

Vultr will now let you rent a share of Nvidia’s A100 GPUs in its cloud

2 years ago
Anonymous $dy9SWuvIkX

https://techcrunch.com/2022/05/24/vultr-will-now-let-you-rent-a-share-of-nvidias-a100-gpus-in-its-cloud/

Vultr, the cloud platform that specializes in providing access to basic infrastructure services at a relatively low cost, today announced the launch of Vultr Talon, a new service that will offer developers access to virtualized GPUs, starting with Nvidia’s A100 Tensor Core GPU, with prices as low as $0.134/hour (or $90/month) for access to a twentieth of the compute power of an A100.

Typically, when you need access to a high-end GPU for machine learning and similar use cases, the smallest unit you can buy is access to the entire GPU. On the CPU side of things, buying just a slice of CPU power is standard, but until now, that just wasn’t possible for GPUs, even though for many use cases, like inferencing, you would only need access to a fraction of the GPU’s compute power.

Vultr will now let you rent a share of Nvidia’s A100 GPUs in its cloud

May 24, 2022, 12:47pm UTC
https://techcrunch.com/2022/05/24/vultr-will-now-let-you-rent-a-share-of-nvidias-a100-gpus-in-its-cloud/ > Vultr, the cloud platform that specializes in providing access to basic infrastructure services at a relatively low cost, today announced the launch of Vultr Talon, a new service that will offer developers access to virtualized GPUs, starting with Nvidia’s A100 Tensor Core GPU, with prices as low as $0.134/hour (or $90/month) for access to a twentieth of the compute power of an A100. > Typically, when you need access to a high-end GPU for machine learning and similar use cases, the smallest unit you can buy is access to the entire GPU. On the CPU side of things, buying just a slice of CPU power is standard, but until now, that just wasn’t possible for GPUs, even though for many use cases, like inferencing, you would only need access to a fraction of the GPU’s compute power.