A 4B model faster than a 395M encoder? 14 ms vs 31 ms (2.2x). Another 4B model: 150 ms (10x slower)

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xdkl55/a_4b_model_faster_than_a_395m_encoder_14_ms_vs_31/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-24 01:35:20
Reddit
From the LocalLLaMA community on Reddit: A 4B model faster than a 395M encoder? 14 ms vs 31 ms (2.2x). Another 4B model: 150 ms…
From the LocalLLaMA community on Reddit: A 4B model faster than a 395M encoder? 14 ms vs 31 ms (2.2x). Another 4B model: 150 ms…
Explore this post and more from the LocalLLaMA community