GitHub Trending

vllm-project/vllm-omni — A framework for efficient model inference with omni-modality models

34 sec read206 views0 listens

3,389 stars | 582 forks | Python

A framework for efficient model inference with omni-modality models

What it does

vLLM-Omni is a Python framework that extends the capabilities of vLLM to support efficient inference and serving for omni-modality models, including text, image, video, and audio data. It matters because it enables developers to work with multi-modal AI more effectively.

Why it matters: 🚀 Dive into the future of omni-modality model inference with vLLM-Omni, now supporting text, image, video & audio data processing! #vllmOmni

View on GitHub

Trending today with 110 new stars

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

You Might Like

GitHub TrendingMay 1831 sec read

NVlabs/Sana — SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transforme

6,401 stars | 454 forks | Python SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer What it does SANA is an efficient codebase for generating high-resolution images and videos, offering complete training and inference p...

Ali Nemati

GitHub TrendingApr 2531 sec read

AIDC-AI/Pixelle-Video — 🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine

6,092 stars | 862 forks | Python 🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine What it does Pixelle-Video is an AI-driven platform that automates the creation of short videos by generating scripts, visuals, audio, and music based on a given t...

Ali Nemati

GitHub Trending2 days ago31 sec read

marin-community/marin — Open-source framework for the research and development of foundation models.

1,898 stars | 184 forks | Python Open-source framework for the research and development of foundation models. What it does Marin is an open-source framework for developing foundation models, focusing on training large language and multimodal models w...

Ali Nemati