GitHub Trending

BerriAI/litellm — Sponsor Star

43 sec read62 views0 listens

36,423 stars | 5,895 forks | Python

Sponsor

      Star









  
    BerriAI /

  litellm  


  Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

What it does

LiteLLM is a Python SDK and proxy server that enables users to call over 100 LLM APIs in a unified OpenAI format, complete with features like cost tracking and load balancing. This tool simplifies access to various AI models, making it easier for developers to integrate advanced AI capabilities into their applications.

Why it matters: Unlock the power of 100+ LLMs with LiteLLM - your gateway to seamless AI integration!

View on GitHub

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

You Might Like

GitHub Trending2 days ago45 sec read

wshobson/agents — Multi-harness agentic plugin marketplace for Claude Code, Codex, Cursor, OpenCod

41,307 stars | 4,396 forks | Python Multi-harness agentic plugin marketplace for Claude Code, Codex, Cursor, OpenCode, GitHub Copilot, Google Antigravity, and Pi What it does This repository, 'agents,' provides a centralized marketplace of plugins, a...

Ali Nemati

GitHub Trending2 days ago34 sec read

vllm-project/vllm — A high-throughput and memory-efficient inference and serving engine for LLMs

94,317 stars | 23,654 forks | Python A high-throughput and memory-efficient inference and serving engine for LLMs What it does vLLM is a high-throughput and memory-efficient inference and serving engine for Large Language Models (LLMs). It's designed...

Ali Nemati

GitHub Trending3 days ago46 sec read

headroomlabs-ai/headroom — Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20

76,077 stars | 5,913 forks | Python Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server. What it does Headroom is a p...

Ali Nemati