New quant types suggested: IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_K

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x8zj9j/new_quant_types_suggested_iq2_k_iq3_k_iq4_k_iq5_k/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-18 18:06:03
Reddit
From the LocalLLaMA community on Reddit: New quant types suggested: IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_K
From the LocalLLaMA community on Reddit: New quant types suggested: IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_K
Explore this post and more from the LocalLLaMA community