HyQuant: Hybrid-Precision Quantization for LLM Attention

arXiv:2608.27875v2 Announce Type: replace Abstract: Quantization has been widely adopted in LLM training and inference to reduce cost and improve efficiency. However, low-bit quantization of the \emph{attention} module often introduces large errors…

Read the full story at arXiv cs.AI ↗