DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.

1. 

   消息推送

   DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.

   3天前

   DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license. https://github.com/deepseek-ai/DeepInfer Supported features: - Optimized kernels, model and sampler runtime - Parallelism: Attention DP / balanced CP, MoE EP + EPLB - DSpark and confidence-scheduled verification - SWA bounded replay - Asynchronous scheduling (zero-overhead batch schedu...
   
   🌐 链接: https://x.com/tianyi/status/2112471106426900677
   🏷️ 分组: X｜为你推荐
   🕒 时间: 2026-10-20 17:08:54

   GitHub

   

   GitHub - deepseek-ai/DeepInfer: DeepInfer: High-performance, large-scale inference framework for DeepSeek models

   DeepInfer: High-performance, large-scale inference framework for DeepSeek models - deepseek-ai/DeepInfer

   3天前