The Compute Library is a collection of low-level machine learning functions optimized for Arm® Cortex®-A, Arm® Neoverse™ and Arm® Mali™ GPUs architectures.

The library provides superior performance to other open source alternatives and immediate support for new Arm® technologies e.g. SVE2.

Key Features:

• Open source software available under a permissive MIT license
• Over 100 machine learning functions for CPU and GPU
• Multiple convolution algorithms (GeMM, Winograd, FFT, Direct and indirect-GeMM)
• Support for multiple data types: FP32, FP16, INT8, UINT8, BFLOAT16
• Micro-architecture optimization for key ML primitives
• Highly configurable build options enabling lightweight binaries
• Advanced optimization techniques such as kernel fusion, Fast math enablement and texture utilization
• Device and workload specific tuning using OpenCL tuner and GeMM optimized heuristics

Note: The documentation includes the reference API, changelogs, build guide, contribution guide, errata, etc.

All the binaries can be downloaded from here.

Pre-build binaries are generated with the following security / good coding practices related flags:

-Wall, -Wextra, -Wformat=2, -Winit-self, -Wstrict-overflow=2, -Wswitch-default, -Woverloaded-virtual, -Wformat-security, -Wctor-dtor-privacy, -Wsign-promo, -Weffc++, -pedantic, -fstack-protector-strong

• Arm® CPUs:

  • Arm® Cortex®-A processor family using Arm® Neon™ technology
  • Arm® Neoverse™ processor family
  • Arm® Cortex®-R processor family with Armv8-R AArch64 architecture using Arm® Neon™ technology
  • Arm® Cortex®-X1 processor using Arm® Neon™ technology

• Arm® Mali™ GPUs:

  • Arm® Mali™-G processor family
  • Arm® Mali™-T processor family

• x86