Rotate K/V read order for better L2 cache hit rates by gaugarg-nv · Pull Request #32407 · ggml-org/llama.cpp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xyi6hj/rotate_kv_read_order_for_better_l2_cache_hit/
🏷️ 分组: Reddit|AI·自托管·VPS
🕒 时间: 2026-11-17 19:34:46 From the LocalLLaMA community on Reddit: Rotate K/V read order for better L2 cache hit rates by gaugarg-nv · Pull Request #32407…