Apache DataFusion SQL Query Engine

the portable Python dataframe library

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

Apache DataFusion Comet Spark Accelerator

LakeSail's computation framework with a mission to unify stream processing, batch processing, and compute-intensive (AI) workloads.

Analytical database for data-driven Web applications 🪶

DuckDB-powered analytics for Postgres

Next-generation decentralized data lakehouse and a multi-party stream processing network

Query and transform data with PRQL

An opinionated and batteries included DataFusion implementation.

Rust implementation of Apache Iceberg with integration for Datafusion

A lightweight Logging and Tracing observability solution for Rust, built with Apache Arrow, Apache Parquet and Apache DataFusion.

Java binding to Apache DataFusion

etl engine 轻量级 跨平台 流批一体ETL引擎 数据抽取-转换-装载 ETL engine lightweight cross platform batch flow integration ETL engine data extraction transformation loading

A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between the two. Uses Apache Arrow in-memory format and respective query engine DataFusion.

Python binding for DataFusion

S3 as an ObjectStore for DataFusion

Exon is an OLAP query engine specifically for biology and life science applications.