#Datafusion
Showing 19 of 19 repositories tagged #datafusion, ranked by stars
Apache DataFusion SQL Query Engine
the portable Python dataframe library
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query processing
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
Lakehouse native graph engine with git-style workflows
Analytical database for data-driven Web applications 🪶
Next-generation decentralized data lakehouse and a multi-party stream processing network
Unofficial rust implementation of Apache Iceberg with integration for Datafusion
Blazing-Fast Bioinformatic Operations on Python DataFrames
Fast parquet command line tool with many functions, nailed it!
Fast psql-style database CLI/workbench for PostgreSQL, MySQL, SQLite, ClickHouse, MongoDB, Elasticsearch, and SQL over Parquet/CSV/JSON — with optional AI, SSH/Vault, Python & Django.
Skardi is an agent data plane that gives AI agents data autonomy.
Data streaming runtime focused on performance, consistency, and extensibility. Write plugins in Rust or WASM and process data with data guarantees.
Awesome list of alternative dataframe libraries in Python.
Notes on Data Engineering with Pandas, PySpark, Dask, Ray, Arrow DataFusion, Polars etc.
Rust-native time-series table format with gap/overlap tracking and SQL queries