SemiAnalysisAI/InferenceX
Star SemiAnalysisAI / InferenceX Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3
Topics
What it does
InferenceX™ is an open-source benchmarking tool that continuously evaluates the performance of popular inference frameworks in real-time. It addresses the rapid advancements in AI software by providing up-to-date performance metrics, ensuring developers can rely on accurate data for optimization.
Star history
Not enough history yet — 1 day(s) recorded. The daily snapshot builds this up.
Tracking
- Last trending
- 2026-02-21
Creator kit
Hook
Discover InferenceX™: the tool that keeps AI inference benchmarks up-to-date with real-time performance tracking!
Content angles
- Create a tutorial on how to set up and use InferenceX™ for benchmarking AI models.
- Write a comparison article on the performance of different inference frameworks using InferenceX™ results.
- Develop a video series showcasing the evolution of AI inference performance over time with InferenceX™ data.
Who should care
AI developers, data scientists, and machine learning engineers interested in performance optimization.