10
Quantize LLMs with GPTQ Using Hugging Face Transformers

Quantize LLMs with GPTQ Using Hugging Face Transformers

a year ago
Anonymous $pUsIN4hzN9

Quantize LLMs with GPTQ Using Hugging Face Transformers

Sep 2, 2023, 3:24pm UTC
https://medium.com/@bnjmn_marie/quantize-llms-with-gptq-using-hugging-face-transformers-95a6297960cf