#Data-curation
Showing 13 of 13 repositories tagged #data-curation, ranked by stars
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Refine high-quality datasets and visual AI models
fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.
Scalable data pre processing and curation toolkit for LLMs
Interactively explore unstructured datasets from your dataframe.
A curated, but incomplete, list of data-centric AI resources.
Curated list of open source tooling for data-centric AI on unstructured data.
🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models
PyTorch dataset debugger for computer vision — pause training, mine live loss signals to surface mislabels, class imbalance & outliers, then curate your image, video & LiDAR data without restarting
[ICLR 2025] Official implementation of paper "Improving Data Efficiency via Curating LLM-Driven Rating Systems"
A library for detecting problematic data segments in structured and unstructured data with few lines of code.
Lesson guide and textbook for "Data as a Science" course.
Data Curation Tool is a local-first dataset curation, tagging, model-management, downloader, 3D generation, media metadata, and tool-orchestration application. The current documentation set is stored in docs/wiki/