36,423 stars | 5,895 forks | Python
Sponsor
Star
BerriAI /
litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
What it does
LiteLLM is a Python SDK and proxy server that enables users to call over 100 LLM APIs in a unified OpenAI format, complete with features like cost tracking and load balancing. This tool simplifies access to various AI models, making it easier for developers to integrate advanced AI capabilities into their applications.
Why it matters: Unlock the power of 100+ LLMs with LiteLLM - your gateway to seamless AI integration!
Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.



