lilpipe

A tiny, typed, sequential pipeline engine for Python.

lilpipe is a lightweight, Pydantic-powered library for building and running sequential workflows in Python. It’s ideal for data processing, scientific workflows, and any task that benefits from a clear, linear sequence of steps. With built-in caching and simple control signals, lilpipe is small, typed, and practical.

Features

• Sequential workflows — run steps in a fixed order.
• Type-safe context — Pydantic-based PipelineContext.
• Smart caching — fingerprint_keys to skip unchanged work.
• Flow control — ctx.abortpass() and ctx.abortpipeline().
• Composable steps — nest via Step(name, children=[...]).
• Tiny surface area — minimal API and dependencies.

Installation

pip install lilpipe

> See pyproject.toml for supported Python versions.

(If you’d rather just view it, the raw notebook is at examples/example.ipynb` in the repo.)

License

Licensed under the Apache 2.0 License.

Links

• Issues: https://github.com/andrewruba/lilpipe/issues
• PyPI: https://pypi.org/project/lilpipe/