#Bigdata
Showing 60 of 82 repositories tagged #bigdata, ranked by stars
🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
A curated list of awesome big data frameworks, ressources and other awesomeness.
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
A Cloud Native Batch System (Project under CNCF)
🔨 用 JSON 来生成结构化的 SQL 语句，基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现，项目简单（重逻辑轻页面）、适合练手~
Apache Avro is a data serialization system.
Aix-DB 基于 LangChain/LangGraph 框架，结合 MCP Skills 多智能体协作架构，实现自然语言到数据洞察的端到端转换。
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.
Google, Naver multiprocess image web crawler (Selenium)
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
TensorBase is a new big data warehousing with modern efforts.
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
Data syncing in golang for ClickHouse.
GUI-based Python code generator for data science, extension to Jupyter Lab, Jupyter Notebook and Google Colab.
An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset
可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.
WeDataSphere is a financial grade, one-stop big data platform suite.
Fast topic modeling platform
Data Lineage Tracking And Visualization Solution
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
High Performance HTTP Sidecar Load Balancer
A simple spark standalone cluster for your testing environment purposses
A serverless cluster computing system for the Go programming language
电商大数据商品实时推荐系统，Vue + TypeScript + ElementUI+ Spring + Spark
CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.
TOMs is a fully open-source, high-performance, systematic, plugin-oriented, and scenario-agnostic general-purpose development framework.
This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
An open source platform for managing and analyzing biomedical big data
✍ 记录一路走来学习的计算机专业知识 ，力求构建 AI & CS & SE 知识体系
Large Tech Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, AWS, GCP and international Consulting including extensive Travel Tips around the world
A daily digest of the articles or videos I've found interesting, that I want to share with you.
ROOT I/O in pure Python and NumPy.
Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction
An end-to-end machine learning and data mining framework on Hadoop
Possibly the fastest DataFrame-agnostic quality check library in town.
TipDM建模平台，开源的数据挖掘工具。
A cross-platform Echarts dashboard application,Powerpoint-like, designed based on Excel data, with the capability to update data remotely.supports line, spline, area, areaspline, column, bar, pie, scatter, angular gauges, arearange, areasplinerange, columnrange, bubble, box plot, error bars, funnel, waterfall. 支持柱状图、条形图、折线图、曲线图、折线填充图、曲线填充图、气泡图、扇形图。
All the project addresses participated and established by WeBank are collected.汇集了微众银行参与和建立的所有项目地址。
Interview coding questions and experiences for several companies merged into one repository
A robust web archive analytics toolkit
Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive
R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks
Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.
ThereForYou: Your mental health ally. Kai, our AI assistant, offers compassionate support. Track your mood trends, find solace in a secure community, and access crisis resources swiftly. We're here to empower your journey towards improved well-being, leveraging technology for a brighter tomorrow.
The vehicle orientation dataset is a large-scale dataset containing more than one million annotations for vehicle detection with simultaneous orientation classification using a standard object detection network.
GrapeTree is a fully interactive, tree visualization program, which supports facile manipulations of both tree layout and metadata. Click the first link to launch: https://achtman-lab.github.io/GrapeTree/MSTree_holder.html
A collection of tools and best practices to take ShardingSphere into the cloud
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
Exposure是一个帮助做曝光统计需求的库，可以很方便的对曝光事件进行埋点，在现有代码上少量侵入即可实现曝光埋点。支持RV的线性布局、网格布局、瀑布流布局、横向滑动RV，ScrollView等各种滚动布局。支持配置item的有效曝光面积。
Amas is recursive acronym for “Amas, monitor alert system”.
Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark
Cheatsheets on numerous topics ranging from DataScience | ML | DL | AI | Big Data.
Apache Kafka Guide
Countly Product Analytics SDK for Cordova, Icenium and Phonegap (Archived, Sunsetted)