Quantize LLMs with GPTQ Using Hugging Face Transformers
Quantize LLMs with GPTQ Using Hugging Face Transformers
Sep 2, 2023, 3:24pm UTC
https://medium.com/@bnjmn_marie/quantize-llms-with-gptq-using-hugging-face-transformers-95a6297960cf