#Data-preparation
Showing 13 of 13 repositories tagged #data-preparation, ranked by stars
Scalable data pre processing and curation toolkit for LLMs
Machine learning with dataframes
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
visual data prep powered by python
Open source project for data preparation for GenAI applications
Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"
Data Preparation for Satellite Machine Learning
An open source book to learn data science, data analysis and machine learning, suitable for all ages!
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).
Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)
“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.
Data preprocessing is a data mining technique that involves transforming raw data into an understandable format.