liteLLM

One library to standardize all LLM APIs

5.0•18 reviews•

150 followers

One library to standardize all LLM APIs

5.0•18 reviews•

150 followers

Visit website

Unified API

•

AI Infrastructure Tools

Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models

Free

Launch tags:API•Open Source•Developer Tools

Launch Team

Framer — Launch websites with enterprise needs at startup speeds.

Launch websites with enterprise needs at startup speeds.

Promoted

liteLLM

Maker

📌

Hi Producthunt, @krrish_dholakia and I are super excited to be launching 🚅 liteLLM An Open Source Python library to standardize LLM Inputs/Outputs for 50+ models (OpenAI, Anthropic, Cohere etc) :https://github.com/BerriAI/litellm 🚨Why did we build liteLLM We needed simplicity Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere, Anthropic, Replicate LLM APIs. 🚀How does it work liteLLM is a Python package that enables calling 50+ LLM API models using a consistent input/output interface - in the chatGPT format here’s an example of how liteLLM works response = completion(model="gpt-3.5-turbo", messages=messages) response = completion("claude-2", messages) response = completion("command-nightly", messages) 📞 Interested in using liteLLM? You can try out liteLLM today for free: https://github.com/BerriAI/litellm/ If you're interested in liteLLM you can meet with me https://calendly.com/d/4mp-gd3-k... or reach me on Twitter: https://twitter.com/ishaan_jaff

Report

2yr ago

Product Hunt Launch Checklist

@krrish_dholakia @ishaan_jaffer Amazing work guys! Congratulations on the launch.

Report

2yr ago

Congrats on the launch! Litellm is really useful for reliably and easily calling LLM APIs.

Report

2yr ago

liteLLM

Maker

@kaushik_s Thank you !

Report

2yr ago

liteLLM

Maker

@krrish_dholakia @falak_sher Thank you !

Report

2yr ago

Congrats on your launch.

Report

2yr ago

liteLLM

Maker

@daniel_oreson Thank you !

Report

2yr ago

LFG

Report

2yr ago

liteLLM

Maker

@yi_ding Thanks for the support❤️

Report

2yr ago

CloudFunnels AI

The product looks good, will check it out

Report

2yr ago

liteLLM

Maker

@cyriljeet Thank you !

Report

2yr ago

5.0

Based on 18 reviews

Review liteLLM?

Reviewers describe liteLLM as a practical LLM proxy that makes it easier to work across multiple providers, including Groq, OpenRouter, and local models through Ollama, while using an OpenAI-compatible API that fits into many apps when the base URL can be set. The lone user review highlights useful caching, load balancing, and pairing with Langfuse for prompt and session monitoring. Founder feedback from the makers of

Budibase

and

JDoodle.ai

echoes that it is efficient, speeds implementation, and reduces vendor lock-in.