Running 35B MoE models on a Tesla K80 (2014) at ~21 tok/s, in plain C

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xaz06x/running_35b_moe_models_on_a_tesla_k80_2014_at_21/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-21 01:49:47
Reddit
From the LocalLLaMA community on Reddit: Running 35B MoE models on a Tesla K80 (2014) at ~21 tok/s, in plain C
From the LocalLLaMA community on Reddit: Running 35B MoE models on a Tesla K80 (2014) at ~21 tok/s, in plain C
Explore this post and more from the LocalLLaMA community