Dataflow Programming Hub

Created: 2021-01-28T02:32:48-06:00

Return to the Index

Dataflow programming is when the flow of data from one process to another is the primary concept.

For example a "module" consumes some input, transforms and outputs.

The data flow is then the relationship of data passing through models.

Concrete examples

Nile programming language
Riven dataflow framework
Node-RED
Bacon.js

Principles

Backpressure; when workers push more work forward than can be handled

Books

Making Sense of Stream Processing by Martin Kleppmann
Fundamentals of Stream Processing by Andrade, Gedik, Turaga.