KubeAI: Private Open AI on K8s
Serve LLMs privately with an OpenAI API compatible API
•0 reviews•20 followers
What is KubeAI: Private Open AI on K8s?
✅️ Drop-in replacement for OpenAI with API compatibility 🚀 Serve OSS LLMs on CPUs or GPUs ⚖️ Autoscaling with scale from 0 🛠️ Zero dependencies (no Istio, Knative, etc.) 🤖 Operates OSS model servers (vLLM and Ollama) 🔋 Chat UI included
Do you use KubeAI: Private Open AI on K8s?
Recent KubeAI: Private Open AI on K8s Launches
KubeAI: Private Open AI on K8s Serve LLMs privately with an OpenAI API compatible API
Launched on August 28th, 2024