Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090
🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xx1cu9/basalt_040_more_models_still_as_fast_qwen_27b_up/
🏷️ 分组: Reddit|AI·自托管·VPS
🕒 时间: 2026-11-16 01:30:31
🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xx1cu9/basalt_040_more_models_still_as_fast_qwen_27b_up/
🏷️ 分组: Reddit|AI·自托管·VPS
🕒 时间: 2026-11-16 01:30:31