Olla v0.1.0 - Lightweight open-source LLM proxy for homelabs & on-prem inference (Ollama, vLLM, SGLang, llama.cpp, oMLX with failover, sticky sessions & load balancing)

1. 

   消息推送

   Olla v0.1.0 - Lightweight open-source LLM proxy for homelabs & on-prem inference (Ollama, vLLM, SGLang, llama.cpp, oMLX with failover, sticky sessions & load balancing)

   3小时前

   Olla v0.1.0 - Lightweight open-source LLM proxy for homelabs & on-prem inference (Ollama, vLLM, SGLang, llama.cpp, oMLX with failover, sticky sessions & load balancing)
   
   🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xmq913/olla_v010_lightweight_opensource_llm_proxy_for/
   🏷️ 分组: Reddit｜AI·自托管·VPS
   🕒 时间: 2026-11-03 19:13:25

   Reddit

   

   From the LocalLLaMA community on Reddit: Olla v0.1.0 - Lightweight open-source LLM proxy for homelabs & on-prem inference (Ollama…

   Explore this post and more from the LocalLLaMA community

   3小时前