GitHub Trending

pierrrrrballeu/onnx-llm — ortクレートを使用した推論

25 sec read7 views0 listens

0 stars | 0 forks | Rust

ortクレートを使用した推論

What it does

Onnx-LLM is a Rust-based library that utilizes the ort crate for inference with models like GPT-2 and Qwen. This repository is significant for developers looking to implement efficient machine learning inference in their applications.

Why it matters: Explore how Onnx-LLM can streamline your machine learning inference process with Rust!

View on GitHub

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

You Might Like

GitHub TrendingAug 1536 sec read

NVIDIA-NeMo/Switchyard — Switchyard lets LLM applications route traffic across models and providers while

1,289 stars | 70 forks | Rust Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimizati...

Ali Nemati

GitHub TrendingAug 1532 sec read

macro-inc/macro — Macro is a unified workspace for teams: email, chat, docs, tasks, agents, calls,

3,080 stars | 176 forks | Rust Macro is a unified workspace for teams: email, chat, docs, tasks, agents, calls, and CRM — @-linked together with shared AI memory. What it does Macro is a unified workspace that integrates email, chat, docs, tasks, age...

Ali Nemati

GitHub TrendingJul 2028 sec read

openinterpreter/openinterpreter — A coding agent for open models like Kimi K3

66,524 stars | 5,645 forks | Rust A coding agent for open models like Kimi K3 What it does Open Interpreter is a coding agent optimized for low-cost AI models, enabling developers to run commands in native sandboxes and switch between various model p...

Ali Nemati