pyspark

lakehq/sail

+11

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

ibis

+6

the portable Python dataframe library

narwhals

+4

Lightweight and extensible compatibility layer between dataframe libraries!

SynapseML

+3

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

graphframes

+1

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

apache/linkis

+1

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.