35B MoE running at 20.5 tok/s on an iPhone, without skipping experts

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xbmsgf/35b_moe_running_at_205_toks_on_an_iphone_without/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-21 21:12:08
Reddit
From the LocalLLaMA community on Reddit: 35B MoE running at 20.5 tok/s on an iPhone, without skipping experts
From the LocalLLaMA community on Reddit: 35B MoE running at 20.5 tok/s on an iPhone, without skipping experts
Explore this post and more from the LocalLLaMA community