pierrrrrballeu/onnx-llm
ortクレートを使用した推論
Rust0 stars0 forks
What it does
Onnx-LLM is a Rust-based library that utilizes the ort crate for inference with models like GPT-2 and Qwen. This repository is significant for developers looking to implement efficient machine learning inference in their applications.
Star history
Tracking
- Last trending
- 2026-02-21
Creator kit
Hook
Explore how Onnx-LLM can streamline your machine learning inference process with Rust!
Content angles
- A tutorial on setting up and using Onnx-LLM for GPT-2 inference.
- Comparative analysis of Onnx-LLM and other inference libraries in Rust.
- Case studies showcasing the performance of Onnx-LLM in real-world applications.
Who should care
Developers and data scientists interested in efficient inference with Rust.