https://towardsdatascience.com/installing-tensorflow-with-cuda-cudnn-and-gpu-support-on-windows-10-60693e46e781

In Part 1 of this series, I discussed how you can upgrade your PC hardware to incorporate a CUDA Toolkit compatible graphics processing card, such as an Nvidia GPU. This Part 2 covers the installation of CUDA, cuDNN and Tensorflow on Windows 10. This article below assumes that you have a CUDA-compatible GPU already installed on your PC; but if you haven’t got this already, Part 1 of this series will help you get that hardware set up, ready for these steps.

Assuming that Windows is already installed on your PC, the additional bits of software you will install as part of these steps are:-