cuda-kernels

LeetCUDA

+23

An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.

lucebox

+17

LLM speculative inference server for heterogeneous hardware & consumer GPUs

NVIDIA/cccl

+16

CUDA Core Compute Libraries

lmdeploy

+13

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

cuda-samples

+14

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

rust-cuda

+6

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

cudarc

+2

Safe rust wrapper around CUDA toolkit

GPU-Perf-Playground

+2

GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构

v100-skinny

+1

Hand-written NVFP4 W4A16 CUDA kernels for Volta