SemiAnalysisAI/InferenceX — Star SemiAnalysisAI / InferenceX

Ali NematiFeb 2137 sec read48 views

503 stars | 89 forks | Python

Star

    SemiAnalysisAI /

  InferenceX  


  Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 &amp; soon™ TPUv6e/v7/Trainium2/3

What it does

InferenceX™ is an open-source benchmarking tool that continuously evaluates the performance of popular inference frameworks in real-time. It addresses the rapid advancements in AI software by providing up-to-date performance metrics, ensuring developers can rely on accurate data for optimization.

Why it matters: Discover InferenceX™: the tool that keeps AI inference benchmarks up-to-date with real-time performance tracking!

View on GitHub

Trending today with 6 new stars

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

Comments

OpenBB-finance/OpenBB — Financial data platform for analysts, quants and AI agents.

60,964 stars | 5,941 forks | Python Financial data platform for analysts, quants and AI agents. What it does OpenBB-finance/OpenBB is an open-source f...60,964 stars | 5,941 forks | Python Financial data platform for analysts, quants and AI agents. What it does OpenBB-finance/OpenBB is an open-source financial data platform that enables seamless integration of various data sources for quants, analyst...

Ali Nemati

GitHub TrendingFeb 2126 sec read

Arlm12/oat — OpenAgentTrace from LearnChain

2 stars | 0 forks | Python OpenAgentTrace from LearnChain What it does OpenAgentTrace (OAT) is an open-source observability platform designed specific...2 stars | 0 forks | Python OpenAgentTrace from LearnChain What it does OpenAgentTrace (OAT) is an open-source observability platform designed specifically for AI agents, enabling detailed tracking of their decision-making processes. It addresses the ...

Ali Nemati

GitHub TrendingFeb 2125 sec read

Robbyant/lingbot-world — Advancing Open-source World Models

2,873 stars | 234 forks | Python Advancing Open-source World Models What it does LingBot-World is an open-source world simulator that excels in video ...2,873 stars | 234 forks | Python Advancing Open-source World Models What it does LingBot-World is an open-source world simulator that excels in video generation, offering high-fidelity environments and real-time interactivity. Its innovative features...

Ali Nemati

GitHub TrendingFeb 2130 sec read

open-webui/open-webui — Star open-webui / open-webui

124,432 stars | 17,583 forks | Python Star open-webui / open-webui User-friendly AI Interface (Supports Ollama, OpenAI API, ...) What it ...124,432 stars | 17,583 forks | Python Star open-webui / open-webui User-friendly AI Interface (Supports Ollama, OpenAI API, ...) What it does Open WebUI is a user-friendly, self-hosted AI platform that supports various LLM runners like O...

Ali Nemati

GitHub Trending2 days ago42 sec read

alibaba/OpenSandbox — OpenSandbox is a general-purpose sandbox platform for AI applications, offering

1,311 stars | 104 forks | Python OpenSandbox is a general-purpose sandbox platform for AI applications, offering multi-language SDKs, unified sandbox ...1,311 stars | 104 forks | Python OpenSandbox is a general-purpose sandbox platform for AI applications, offering multi-language SDKs, unified sandbox APIs, and Docker/Kubernetes runtimes for scenarios like Coding Agents, GUI Agents, Agent Evaluation,...

Ali Nemati

SemiAnalysisAI/InferenceX — Star SemiAnalysisAI / InferenceX

What it does

Related Articles

OpenBB-finance/OpenBB — Financial data platform for analysts, quants and AI agents.

Arlm12/oat — OpenAgentTrace from LearnChain

Robbyant/lingbot-world — Advancing Open-source World Models

open-webui/open-webui — Star open-webui / open-webui

alibaba/OpenSandbox — OpenSandbox is a general-purpose sandbox platform for AI applications, offering