llamacpp

janhq/jan

+107

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

llama-swap

+67

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Atomic-Chat

+48

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

khoj-ai/khoj

+108

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

Bonsai-demo

+34

Bonsai Demo

Spark-X2.6

+30

Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

shimmy

+12

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

inference

+10

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

cactus

+18

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.