CUDA: fuse MoE gate/up matmuls and GLU in MMQ by anujj · Pull Request #31188 · ggml-org/llama.cpp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xhodj3/cuda_fuse_moe_gateup_matmuls_and_glu_in_mmq_by/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-28 21:40:41
Reddit
From the LocalLLaMA community on Reddit: CUDA: fuse MoE gate/up matmuls and GLU in MMQ by anujj · Pull Request #31188 · ggml-org/llama.cpp
From the LocalLLaMA community on Reddit: CUDA: fuse MoE gate/up matmuls and GLU in MMQ by anujj · Pull Request #31188 · ggml-org/llama.cpp
Explore this post and more from the LocalLLaMA community