https://medium.com/@ducminhngo871/how-to-improve-your-web-crawling-process-by-20-times-in-python-f35aae85d7ff