arrow

pola-rs/polars

+70

Extremely fast Query Engine for DataFrames, written in Rust

datafusion

+34

Apache DataFusion SQL Query Engine

apache/arrow

+30

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

datafusion-comet

+9

Apache DataFusion Comet Spark Accelerator

arrow-rs

+8

Official Rust implementation of Apache Arrow

Daft

+8

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

lakehq/sail

+7

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

quail

+6

An open-source inference engine for AI functions in SQL

vortex

+3

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.