gpt-oss

ollama/ollama

+894

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

vllm

+685

A high-throughput and memory-efficient inference and serving engine for LLMs

sglang

+639

SGLang is a high-performance serving framework for large language models and multimodal models.

LEANN

+602

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Atomic-Chat

+54

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

tokenspeed

+55

TokenSpeed is a speed-of-light LLM inference engine.

GenieX

+24

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Automodel

+17

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

oumi-ai/oumi

+8

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!