#Pyarrow

Showing 9 of 9 repositories tagged #pyarrow, ranked by stars

vaexio
vaexio
vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second ๐Ÿš€

Score
0
โ˜… 8.5k โ‘‚ 602 +1/day
Python
ibis-project
ibis-project
ibis

the portable Python dataframe library

Score
100
โ˜… 6.6k โ‘‚ 736 +4/day
Python
uber
uber
petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Score
0
โ˜… 1.9k โ‘‚ 283 โ€”
Python
narwhals-dev
narwhals-dev
narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

Score
100
โ˜… 1.7k โ‘‚ 206 +1/day
Python
vertti
vertti
daffy

Lightweight DataFrame validation decorators for Pandas, Polars, Modin, and PyArrow. No custom types required.

Score
80
โ˜… 58 โ‘‚ 5 โ€”
Python
Genentech
Genentech
pysummaries

Generate beautiful summary tables from pandas, polars or pyarrow dataframes

Score
60
โ˜… 34 โ‘‚ 3 โ€”
Python
CangyuanLi
CangyuanLi
checkedframe

Lightweight, engine-agnostic dataframe validation

Score
0
โ˜… 18 โ‘‚ 0 โ€”
Python
pmgraham
pmgraham
datagrunt

Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.

Score
40
โ˜… 12 โ‘‚ 3 โ€”
Python
trustedshops-public
trustedshops-public
schema2pyarrow

Converts AsyncApi and JsonSchema to PyArrow schema

Score
20
โ˜… 12 โ‘‚ 0 โ€”
Python
Related Topics
#polars#python#pandas#dataframe#duckdb#pyspark#data-science#machine-learning#cudf#modin#narwhals#validation

ยฉ 2026 GitRepoTrend ยท GitHub repositories by topic ยท Updated weekly