#Data-cleaning
Showing 60 of 66 repositories tagged #data-cleaning, ranked by stars
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Refine high-quality datasets and visual AI models
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
Easy Data Preparation with latest LLMs-based Operators and Pipelines.
A light-weight, flexible, and expressive statistical data testing library
Jupyter notebook and datasets from the pandas video series
Machine learning with dataframes
General Assembly's 2015 Data Science course in Washington, DC
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
simple tools for data cleaning in R
The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.
An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM
Production-Grade ML System for Automated Unit of Measure Error Detection | 88-92% Accuracy | 94% Autonomy | KNIME Workflow
A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"
Easy to use Python library of customized functions for cleaning and analyzing data.
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.
🗣️ A book and repo to get you started programming voice computing applications in Python (10 chapters and 200+ scripts).
Data Science Feature Engineering and Selection Tutorials
LLM-based text extraction from unstructured data like PDFs, Words and HTMLs. Transform and cluster the text into your desired format. Less information loss, more interpretation, and faster R&D!
Exploratory data analysis 📊using python 🐍of used car 🚘 database taken from ⓚ𝖆𝖌𝖌𝖑𝖊
Practices on data analysis including: cleaning, visualization and EDA on different datasets using Python, SQL, Power BI, etc.
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
Portfolio of data science and data analyst projects completed by me for academic, self learning, and hobby purposes.
Zero-config entity resolution & record linkage. The zero-tuning Fellegi-Sunter path beats hand-tuned Splink head-to-head and scales from a CSV to a verified 100M-row dedupe in 9.2 min. Fuzzy/exact/probabilistic + PPRL + LLM + identity graph. Python + edge-safe TypeScript (WASM), SQL-native in Postgres & DuckDB, MCP/REST + dbt/Airflow.
Python-based Jupyter notebooks, notes, and project solutions from DataCamp courses on data science, machine learning, and statistics.
C++ accelerated data quality toolkit for Python: CSV parsing, cleaning, schema validation, profiling, and pandas integration.
A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀
a Map-Matching-based Python Toolbox for Vehicle Trajectory Reconstruction
A Machine Learning System for Data Enrichment.
Analyzing the Drugs Descriptions, conditions, reviews and then recommending it using Deep Learning Models, for each Health Condition of a Patient.
A library for detecting problematic data segments in structured and unstructured data with few lines of code.
Power up your data science workflow with ChatGPT.
India based Hardware company Sales Insights - A Data Analysis Project performed on Tableau & SQL
Data Cleaning with Python
A Python library for Automated Exploratory Data Analysis, Automated Data Cleaning, and Automated Data Preprocessing For Machine Learning and Natural Language Processing Applications in Python.
Sales insights project using Powerbi and SQL
Using Machine Learning Algorithms for Regression Analysis to predict the sales pattern and Using Data Analysis and Data Visualizations to Support it.
Batch-convert pdf to text, extract data from pdf in python
Repository for the projects needed to complete the Data Analyst Nanodegree.
Engaged in research to help improve to boost text sentiment analysis using facial features from video using machine learning.
Zomato Data Exploration and Analysis with SQL (SQL SERVER)
Synthetic sales data analysis with Python. Generate realistic sales transactions, clean and validate data, compute KPIs, and visualize revenue trends by day, month, and category. Includes reproducible scripts and charts for portfolio demonstration.
Data2Neo is a library that simplifies the conversion of data in relational format to a graph knowledge database.
Data Analyst Portfolio Project 1 - SQL and PowerBI - Cleaning and analysing the AdventureWorks dataset with SQL, then visualizing it with PowerBI
Stateful CSV editing MCP server for AI assistants — sessions, undo/redo, auto-save, and 39 pandas-powered tools. Works with Claude, ChatGPT, Cursor, Windsurf, Claude Code, and any MCP-compatible client. Built on FastMCP 3
This repository contains projects I have worked on for Data Cleaning and Manipulation in Python.
Fill missing values in Pandas DataFrames using Restricted Boltzmann Machines
Data cleaning, analysis and visualization of Paris metro traffic (Python, Pandas, Matplotlib, iPyLeaflet, Kepler.gl).
A collection of Jupyter notebooks for AI and ML tasks. Explore, learn, and contribute to advance your skills in artificial intelligence and machine learning. #Hacktoberfest friendly!
A high level deep learning framework for quickly prototyping networks with added tools in data visualisation, model interpretability and performance metrics
dataPipe is a data processing and data analytics library for JavaScript. Inspired by LINQ (C#) and Pandas (Python)
Analyze Zomato restaurant data all the world and find the insights by using Python libaries and also visualize the dataset by using Power-bi
Missing Data Doctor is a diagnostic and treatment toolkit for missing values in machine learning datasets. It profiles missingness patterns, visualizes gaps, applies multiple imputation strategies, and evaluates their impact on model performance. Includes automated plots, metrics, and a full HTML report.
iNeuron BusinessIntelligence Internship: End to End Project on Budget Sales Analysis
🧹 Quantclean is a program that reformats financial dataset to US Equity TradeBar (Quantconnect format)
The aim of the project is to optimize the price of new house listing by analysing other people's pricing data in surrounding areas, relative to features such as locations, amenities, reviews, etc.
A CLI-based dataset preprocessing tool for machine learning tasks. Features include data exploration, null value handling, one-hot encoding, and feature scaling, and download the modified dataset effortlessly.
Interactive cleaning for Pandas DataFrames