#Dask
Showing 45 of 45 repositories tagged #dask, ranked by stars
Parallel computing with task scheduling
cuDF - GPU DataFrame Library
N-D labeled arrays and datasets in Python
STUMPY is a powerful and scalable Python library for modern time series analysis
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Lightweight and extensible compatibility layer between dataframe libraries!
:truck: Agile Data Preparation Workflows madeย easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Scalable machine ๐ค learning for time series forecasting.
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Fast data store for Pandas time-series data
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
๐ชด Nebari - your open source data science platform
A web frontend for scheduling Jupyter notebook reports
scores: Metrics for the verification, evaluation and optimisation of forecasts, predictions or models.
Lexcube: 3D Data Cube Visualization in Jupyter Notebooks
Evaluation Tool for Anomaly Detection Algorithms on Time Series
Distributed XGBoost on Ray
Python and Pandas are known to have issues around scalability and efficiency. You will learn how to use libraries such as Modin, Dask, Ray, Vaex etc to overcome the problems faced by Pandas.
Read and write rasters in parallel using Rasterio and Dask
Summarise and explore Pandas DataFrames
ML/AI training/serving and agent sandbox operator and controller for Kubernetes
๐ช 1-click Kubeflow using ArgoCD
Python ๆฐๆฎ็งๅญฆๅ ้๏ผDaskใRayใXorbitsใmpi4py
Native Dask collection for awkward arrays, and the library to use it.
Numerical & Scientific Computing with Python Tutorial
SQL on dataframes - pandas and dask
ByteHub: making feature stores simple
dask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.
Awesome list of alternative dataframe libraries in Python.
Containerized distributed programming framework for Python
Python tools for big data
Notes on Data Engineering with Pandas, PySpark, Dask, Ray, Arrow DataFusion, Polars etc.
This repo contain the most common tools used in geospatial analysis using python!
Python and Dask: Scaling the Dataframe
Gaia is a geospatial analysis library jointly developed by Kitware and Epidemico.
A scalable, declarative, low-code framework for real-time and batch feature calculation/management (quant finance, anomaly/fraud detection, etc.), predictive ML training/inference and simulation. Built on top of Ray
stemgraphic python package for visualization of data and text
Python client for using Prefect Cloud with Saturn Cloud
Loop like a pro, make parameter studies fun.
A set of tools for pre and postprocessing prepared for the high-order Navier-Stokes solver XCompact3d
Python library for interacting with Dask clusters in Saturn
JupyterLab Notebook for Mesosphere DC/OS
DASK on AWS: fully automtaed deployment of DASK cluster on Kuberntes on AWS