GitHub Trending

microsoft/BitNet — Star microsoft / BitNet

Ali NematiFeb 2129 sec read9 views

28,530 stars | 2,337 forks | Python

Star

    microsoft /

  BitNet  


  Official inference framework for 1-bit LLMs

What it does

BitNet is an official inference framework designed for 1-bit large language models (LLMs), enabling fast and energy-efficient inference on both CPU and GPU. Its optimizations significantly enhance performance, making it a game-changer for deploying LLMs on local devices.

Why it matters: Unlock the power of 1-bit LLMs with BitNet's fast and efficient inference framework!

View on GitHub

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

Comments

volcengine/OpenViking — OpenViking is an open-source context database designed specifically for AI Agent

9,944 stars | 683 forks | Python OpenViking is an open-source context database designed specifically for AI Agents(such as openclaw). OpenViking unifies the management of context (memory, resources, and skills) that Agents need through a file system ...

Ali Nemati

GitHub Trending3 days ago26 sec read

vectorize-io/hindsight — Hindsight: Agent Memory That Learns

2,884 stars | 215 forks | Python Hindsight: Agent Memory That Learns What it does Hindsight is an advanced agent memory system that enables AI agents to learn and improve over time, surpassing traditional techniques like RAG in long-term memory tasks...

Ali Nemati

GitHub TrendingMar 531 sec read

inclusionAI/AReaL — Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.

3,914 stars | 335 forks | Python Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible. What it does AReaL is an open-source asynchronous reinforcement learning system designed for large-scale reasoning and agent models, enabling...

Ali Nemati

GitHub TrendingMar 331 sec read

agentscope-ai/agentscope — Build and run agents you can see, understand and trust.

16,819 stars | 1,512 forks | Python Build and run agents you can see, understand and trust. What it does AgentScope is a Python framework for building and deploying production-ready agents that leverage large language models' capabilities. It offers ...

Ali Nemati

GitHub TrendingFeb 2532 sec read

NVIDIA/Megatron-LM — Ongoing research training transformer models at scale

15,306 stars | 3,624 forks | Python Ongoing research training transformer models at scale What it does Megatron-LM is a GPU-optimized library for training large transformer models at scale, offering both pre-configured scripts and composable building...

Ali Nemati

microsoft/BitNet — Star microsoft / BitNet

What it does

Related Articles

volcengine/OpenViking — OpenViking is an open-source context database designed specifically for AI Agent

vectorize-io/hindsight — Hindsight: Agent Memory That Learns

inclusionAI/AReaL — Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.

agentscope-ai/agentscope — Build and run agents you can see, understand and trust.

NVIDIA/Megatron-LM — Ongoing research training transformer models at scale