Open source repositories tagged with #int4, ranked by health score.
A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包
