liteLLM

One library to standardize all LLM APIs

5.0•20 reviews•

172 followers

One library to standardize all LLM APIs

5.0•20 reviews•

172 followers

Visit website

Unified API

•

AI Infrastructure Tools

Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models

liteLLM Reviews

The community submitted 20 reviews to tell us what they like about liteLLM, what liteLLM can do better, and more.

5.0

Based on 20 reviews

Review liteLLM?

Reviewers describe liteLLM as a practical LLM proxy and abstraction layer for teams juggling multiple providers. The lone user review highlights caching, load balancing across services like Groq, OpenRouter, and local Ollama, plus broad compatibility through an OpenAI-style API and monitoring via Langfuse. Founder feedback from the makers of Budibase, JDoodle.ai, and Crossnode echoes that: it helps avoid vendor lock-in, switch models, add fallbacks, and move faster. No concrete downsides appear in the provided reviews.