llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request #30966 · ggml-org/llama.cpp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xqacka/llama_moe_cache_run_missed_experts_on_cpu_add/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-08 00:25:06
Reddit
From the LocalLLaMA community on Reddit: llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request…
From the LocalLLaMA community on Reddit: llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request…
Explore this post and more from the LocalLLaMA community