ggml

YuE2-Studio

+401

Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.

voxcpm2-turkce-ses-tasarimi

+122

Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read Turkish text. Patched audio.cpp, local UI, 7 synthetic voices.

llama.cpp

+727

LLM inference in C/C++

audio.cpp

+165

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

stable-diffusion.cpp

+58

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

transcribe.cpp

+35

ggml speech-to-text inference for 16+ model families

NeMo-Speech.cpp

+22

NeMo-Speech.cpp is a lightweight C++ inference runtime for Speech models

speech.cpp

+17

Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.

llamAmpere

+15

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx