I built an RK3588 NPU runtime without any proprietary inference libraries: Qwen3.5-4B at ~10 tok/s, ~2x faster than vendor SDK.

1. 

   消息推送

   I built an RK3588 NPU runtime without any proprietary inference libraries: Qwen3.5-4B at ~10 tok/s, ~2x faster than vendor SDK.

   2天前

   I built an RK3588 NPU runtime without any proprietary inference libraries: Qwen3.5-4B at ~10 tok/s, ~2x faster than vendor SDK.
   
   🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xb45bq/i_built_an_rk3588_npu_runtime_without_any/
   🏷️ 分组: Reddit｜AI·自托管·VPS
   🕒 时间: 2026-10-21 05:03:58

   Reddit

   

   From the LocalLLaMA community on Reddit

   Explore this post and more from the LocalLLaMA community

   2天前