I squoze Raon-1-mini-preview (29B MoE, 4B active) onto my 16GB RTX 5070 Ti and went from 50 to 232 tok/s

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xi7k3y/i_squoze_raon1minipreview_29b_moe_4b_active_onto/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-29 10:05:00
Reddit
From the LocalLLaMA community on Reddit: I squoze Raon-1-mini-preview (29B MoE, 4B active) onto my 16GB RTX 5070 Ti and went from…
From the LocalLLaMA community on Reddit: I squoze Raon-1-mini-preview (29B MoE, 4B active) onto my 16GB RTX 5070 Ti and went from…
Explore this post and more from the LocalLLaMA community