llama2

lmdeploy

+13

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

ludwig

+12

Low-code framework for building custom LLMs, neural networks, and other AI models

OpenLLM

+12

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

maxtext

+9

A simple, performant, and scalable Jax LLM!

distributed-llama

+10

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

h2o-llmstudio

+5

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

LLamaSharp

+2

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

llama-cookbook

+3

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

llm_aided_ocr

+2

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs