#Apache-arrow

Showing 21 of 21 repositories tagged #apache-arrow, ranked by stars

lance-format
lance-format
lance

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Score
100
β˜… 6.8k β‘‚ 750 +1/day
Rust
pixie-io
pixie-io
pixie

Instant Kubernetes-Native Application Observability

Score
100
β˜… 6.5k β‘‚ 501 +7/day
C++
aws
aws
aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Score
80
β˜… 4.1k β‘‚ 735 +1/day
Python
polarsignals
polarsignals
frostdb

❄️ Coolest database around 🧊 Embeddable column database written in Go.

Score
0
β˜… 1.5k β‘‚ 76 +1/day
Go
scikit-hep
scikit-hep
awkward

Manipulate JSON-like data with NumPy-like idioms.

Score
60
β˜… 965 β‘‚ 129 β€”
Python
developmentseed
developmentseed
lonboard

Fast, interactive geospatial data visualization in Jupyter.

Score
40
β˜… 951 β‘‚ 52 β€”
Python
pola-rs
pola-rs
geopolars

Geospatial extensions for Polars

Score
0
β˜… 903 β‘‚ 30 +1/day
Python
xbbg-org
xbbg-org
xbbg

Intuitive Data Workflows

Score
20
β˜… 826 β‘‚ 66 β€”
Rust
ModernRelay
ModernRelay
omnigraph

Lakehouse native graph engine with git-style workflows

Score
100
β˜… 811 β‘‚ 84 +100/day
Rust
kylebarron
kylebarron
parquet-wasm

Rust-based WebAssembly bindings to read and write Apache Parquet data

Score
67
β˜… 658 β‘‚ 31 +3/day
Rust
unum-cloud
unum-cloud
UStore

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang πŸ—„οΈ

Score
100
β˜… 635 β‘‚ 36 β€”
C++
1duo
1duo
awesome-ai-infrastructures

Infrastructuresβ„’ for Machine Learning Training/Inference in Production.

Score
0
β˜… 454 β‘‚ 88 β€”
abdenlab
abdenlab
oxbow

Oxbow makes genomic data ready for high-performance analytics.

Score
33
β˜… 154 β‘‚ 17 β€”
Rust
columnar-tech
columnar-tech
dbc

dbc is the command-line tool for installing and managing ADBC drivers

Score
0
β˜… 124 β‘‚ 13 +3/day
Go
SpaceCell
SpaceCell
minarrow

Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.

Score
0
β˜… 90 β‘‚ 1 β€”
Rust
baggiponte
baggiponte
awesome-pandas-alternatives

Awesome list of alternative dataframe libraries in Python.

Score
17
β˜… 56 β‘‚ 2 β€”
tradewelltech
tradewelltech
beavers

Python stream processing for analytics

Score
83
β˜… 41 β‘‚ 2 β€”
Python
QuantStack
QuantStack
Arbalister

Dataframe viewer for Jupyter over Arrow

Score
67
β˜… 27 β‘‚ 2 β€”
TypeScript
webysther
webysther
aws-glue-docker

πŸ‹ Docker image for AWS Glue Spark/Python

Score
0
β˜… 23 β‘‚ 8 β€”
Dockerfile
osodevops
osodevops
k2i

K2I - Kafka to Iceberg streaming ingestion engine. A Rust CLI tool inspired by Moonlink architecture that consumes from Kafka, buffers with Apache Arrow for sub-second query freshness, and writes to Apache Iceberg tables.

Score
33
β˜… 20 β‘‚ 1 β€”
Rust
AndreaBozzo
AndreaBozzo
dataprof

Rust profiling library with PyO3 bindings

Score
50
β˜… 16 β‘‚ 1 β€”
Rust
Related Topics
#python#pandas#rust#data-science#data-engineering#polars#apache-parquet#arrow#machine-learning#json#parquet#pyo3

Β© 2026 GitRepoTrend Β· GitHub repositories by topic Β· Updated weekly