#Batch-processing
Showing 37 of 37 repositories tagged #batch-processing, ranked by stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Workflow Engine for Kubernetes
Maestro: Netflix’s Workflow Orchestrator
Serverless batch computing made simple.
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.
🎨 Ready-to-use DeepSeek-OCR Web UI | Modern Interface | 7 Recognition Modes | Batch Processing | Real-time Logging | Fully Responsive
Extend python lists operations using .NET's LINQ syntax for clean and fast coding.
可视化Bilibili本地视频XML弹幕转换ASS字幕转换器
🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.
Tensorflow 2 Faster-RCNN implementation from scratch supporting to the batch processing with MobileNetV2 and VGG16 backbones
A Mass Image Processing tool for Windows
Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.
Production-ready UVR5 CLI & Docker image. Run SOTA separation models (Roformer, SCNet, MDX, Demucs, VR Architecture) on headless GPU servers without dependency hell.
This is a small, opinionated Go library and CLI for Markdown to PDF. It handles cover pages, tables of contents, watermarks, signatures, and more. You can use CSS themes and custom assets. It works with parallel batch processing. The engine behind it is Chrome. It does not rely on LaTeX.
Custom nodes for ComfyUI — video effects, batch processing, prompt tools, image manipulation & automation utilities
Distributed batch data processing framework
Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution
Automatically generate product mockups at scale. Overlay designs onto t-shirt, hoodie, and other templates with precise positioning. Perfect for POD, e-commerce, and marketing.
Automate GitHub PR creation at scale with intelligent token rotation, proxy support, and real-time notifications. Create thousands of PRs effortlessly using sequential or high-speed parallel modes (62 PRs/min). Features: multi-token management, auto-merge, state persistence, Discord/Slack webhooks, async operations, and Windows compatibility.
🚀 MCP aggregator for batching multiple tool calls into a single request. Reduces overhead, saves tokens, and simplifies complex operations in AI agent workflows.
FORMCEPT Whiteboard used by developers for developers
⚗️ An all-in-one solution for chemical property retrieval from PubChem.
Stream processing guidelines and examples using Apache Flink and Apache Spark
Terraform module to create AWS Batch resources 🇺🇦
智能数据探索服务(Intelligent Data Exploration Service)，一站式Data + AI数据解决方案！
A pipeline orchestration tool
Google Apps Script toolkit for automating Google Slides formatting, batch styling, badges, watermarks, and theme application with a custom sidebar menu.
Recursive Neural Networks for PyTorch
Save 50% off GenAI costs in two lines of code
Elasticsearch tool for easily collecting and batch inserting Python data and pandas DataFrames
Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution
Metadata-driven framework for Databricks Spark Declarative Pipelines. Config-driven, pattern based approach to batch & streaming across the medallion architecture. Deploys via Declarative Automation Bundles. Built for simplicity, extensibility, and alignment with the Databricks product roadmap.
Interact with ChatGPT and GPT-4 in alternative ways
This project aims to build a software that can download Sentinel-2 satellite images in batch for data analysis.