Title: CUDA: few-row MMQ for BS 2-24 by anujj · Pull Request #31533 · ggml-org/llama.cpp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xudqle/title_cuda_fewrow_mmq_for_bs_224_by_anujj_pull/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-12 22:10:23
Reddit
From the LocalLLaMA community on Reddit: Title: CUDA: few-row MMQ for BS 2-24 by anujj · Pull Request #31533 · ggml-org/llama.cpp
From the LocalLLaMA community on Reddit: Title: CUDA: few-row MMQ for BS 2-24 by anujj · Pull Request #31533 · ggml-org/llama.cpp
Explore this post and more from the LocalLLaMA community