Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.

1. 

   消息推送

   Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.

   3小时前

   Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.
   
   🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xhkwlm/two_days_tuning_a_single_tesla_p40_35b_moe_full/
   🏷️ 分组: Reddit｜AI·自托管·VPS
   🕒 时间: 2026-10-28 18:58:16

   Reddit

   

   From the LocalLLaMA community on Reddit

   Explore this post and more from the LocalLLaMA community

   3小时前