Rotate K/V read order for better L2 cache hit rates by gaugarg-nv · Pull Request #32407 · ggml-org/llama.cpp
🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xyi6hj/rotate_kv_read_order_for_better_l2_cache_hit/
🏷️ 分组: Reddit|AI·自托管·VPS
🕒 时间: 2026-11-17 19:34:46
🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xyi6hj/rotate_kv_read_order_for_better_l2_cache_hit/
🏷️ 分组: Reddit|AI·自托管·VPS
🕒 时间: 2026-11-17 19:34:46