GitHub Trending

NVIDIA-NeMo/Switchyard — Switchyard lets LLM applications route traffic across models and providers while

36 sec read5 views0 listens

1,289 stars | 70 forks | Rust

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

What it does

Switchyard is a Rust-based proxy and library that enables seamless routing of requests across different large language model providers, facilitating protocol translation and multi-backend routing for developers working with AI models.

Why it matters: 🚀 Dive into the world of LLMs with Switchyard, a Rust proxy that simplifies multi-provider routing and protocol translation. #AI #RustLang

View on GitHub

Trending today with 408 new stars

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

You Might Like

GitHub Trending3 hours ago34 sec read

MakazhanAlpamys/Soup — Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB lapto

1,535 stars | 238 forks | Python Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. What it does Soup simplifies fine-tuning large language models with a single YAML configuration, enabling efficient training on li...

Ali Nemati

GitHub Trending6 hours ago32 sec read

macro-inc/macro — Macro is a unified workspace for teams: email, chat, docs, tasks, agents, calls,

3,080 stars | 176 forks | Rust Macro is a unified workspace for teams: email, chat, docs, tasks, agents, calls, and CRM — @-linked together with shared AI memory. What it does Macro is a unified workspace that integrates email, chat, docs, tasks, age...

Ali Nemati

GitHub Trending6 hours ago36 sec read

infiniflow/ragflow — RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine tha

88,431 stars | 10,292 forks | Go RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs What it does RAGFlow is an open-source RAG e...

Ali Nemati