#Data
Showing 60 of 664 repositories tagged #data, ranked by stars
๐ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw
LlamaIndex is the leading document agent and OCR platform
๐ค Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.
The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:
๐ SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs
React Hooks for Data Fetching
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source data movement for ELT pipelines and AI agents โ from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
AKShare is an elegant and simple financial data interface library for Python, built for human beings! ๅผๆบ่ดข็ปๆฐๆฎๆฅๅฃๅบ
Generate massive amounts of fake data in the browser and node.js
A curated list of awesome big data frameworks, ressources and other awesomeness.
:orange_book: ไธญๅๆฐๅๅญๅ ธๆฐๆฎๅบใๅ ๆฌๆญๅ่ฏญ๏ผๆ่ฏญ๏ผ่ฏ่ฏญ๏ผๆฑๅญใ
A configuration as code language with rich validation and tooling.
PRQL is a modern language for transforming data โ a simple, powerful, pipelined SQL replacement
A web interface to create custom vector-based visualizations on top of RAWGraphs core
๐ง Build, run, and manage data pipelines for integrating and transforming data.
A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use to perform them.
Interactive Tables and Data Grids for JavaScript
Data processing for and with foundation models! ๐ ๐ ๐ฝ โก๏ธ โก๏ธ๐ธ ๐น ๐ท
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
A mindmap summarising Machine Learning concepts, from Data Analysis to Deep Learning.
Transforms PDF, Documents and Images into Enriched Structured Data
The home of the CUE language! Validate and define text-based and dynamic configuration
Easy Data Preparation with latest LLMs-based Operators and Pipelines.
2027 AI/ML internship & new graduate job list updated daily
data load tool (dlt) is an open source Python library that makes data loading easy ๐ ๏ธ
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
Edit Banana: A framework for converting statistical formats into editable.
Random fake data generator written in go
Superduper: End-to-end framework for building custom AI applications and agents.
๐ Glide Data Grid is a no compromise, outrageously fast react data grid with rich rendering, first class accessibility, and full TypeScript support.
A reactive data store & sync engine.
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
Distributed stream processing engine in Rust
Mimesis is a fast Python library for generating fake data in multiple languages.
Curated list of datasets and tools for post-training.
TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
DeepAnalyze is the first agentic LLM for autonomous data science. ๐ไฝ ็AIๆฐๆฎๅๆๅธ๏ผ่ชๅจๅๆๅคง้ๆฐๆฎ๏ผไธ้ฎ็ๆไธไธๅๆๆฅๅ๏ผ
Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable completely in-browser, using Pyodide, DuckDB, Pandas, and Plotly, Matplotlib, etc. Build dashboards, reports, and notebooks that run offline, load fast, and share like a document.
A system for agentic LLM-powered data processing and ETL
Easiest and laziest way for building multi-agent LLMs applications.
A framework for collecting and analyzing prediction market data, including the largest publicly available dataset of Polymarket and Kalshi market and trade data.
Memphis.dev is a highly scalable and effortless data streaming platform
A simple, declarative, and composable way to fetch data for React components
AnyCrawl ๐: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Extract data from a wide range of Internet sources into a pandas DataFrame.
An open source alternative to Tableau. Embeddable visual analytic
A GPU-powered real-time analytics storage and query engine.
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.
A well tested and comprehensive Golang statistics library package with no dependencies.
High-performance runtime for data analytics applications
Compare tables within or across databases
Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/
PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
๐ 7,400,000+ Unsplash images made available for research and machine learning
The fastest business intelligence tool for humans and agents.