BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Topics
What it does
LiteLLM is a Python SDK and Proxy Server that allows developers to call over 100 large language models in OpenAI format, offering features like cost tracking, guardrails, load balancing, and logging. It simplifies the process of integrating various LLM APIs into applications.
Star history
Not enough history yet — 1 day(s) recorded. The daily snapshot builds this up.
Tracking
- Last trending
- 2026-04-25
Creator kit
Hook
Simplify your AI integration with LiteLLM, a Python SDK and Proxy Server that supports over 100 LLM APIs in OpenAI format!
Content angles
- Create tutorials on how to integrate different LLM providers using LiteLLM.
- Develop case studies showcasing the cost-saving benefits of LiteLLM's load balancing feature.
- Demonstrate the ease of setting up a proxy server for secure and efficient API calls with LiteLLM.
Who should care
Python developers, AI researchers, data scientists, and DevOps engineers working on projects involving large language models.