HyperQuant
HyperQuant is MoonMath's rate-distortion-oriented quantization pipeline for large language and diffusion models. It combines randomized Hadamard transforms, lattice quantization, and entropy coding to compress weights and KV cache while preserving model quality.
- Weights and KV cache
- LLM and diffusion models
- Rate-distortion design
