Reverse proxy for LLMs which can wake and/or shut-down your inference server in response to incoming requests

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1x71uju/reverse_proxy_for_llms_which_can_wake_andor/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-10-16 08:13:25
Reddit
From the LocalLLaMA community on Reddit: Reverse proxy for LLMs which can wake and/or shut-down your inference server in response…
From the LocalLLaMA community on Reddit: Reverse proxy for LLMs which can wake and/or shut-down your inference server in response…
Explore this post and more from the LocalLLaMA community