AWQ: Activation-aware Weight Quantization for LLM

Category
Network Quantization
Year/Month
2023-06
Status
Publications
Preprint
Code