8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xlk43x/8_agents_250k_context_concurrently_on_two_3090s/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-02 09:19:59
Reddit
From the LocalLLaMA community on Reddit: 8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)
From the LocalLLaMA community on Reddit: 8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)
Explore this post and more from the LocalLLaMA community