llama.cpp: Add FP8 KV-cache
🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xt9o3t/llamacpp_add_fp8_kvcache/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-11 13:36:19
🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xt9o3t/llamacpp_add_fp8_kvcache/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-11 13:36:19
Reddit
From the LocalLLaMA community on Reddit: llama.cpp: Add FP8 KV-cache
Explore this post and more from the LocalLLaMA community
