Are there any pipeline managers written in a functional language? I've implemented my own at work and that ~200 lines of code were doing their job very well.

The main idea behind was to express a pipeline as a dag where nodes perform action in data. The dag is described in a yaml file.

A functional language would be a good fit, because then the yaml file would not be different from (python) code, which would allow me to come up with advance compositions without implementing them.


I might have came up with a fun project to pick up a functional language.

· · Web · 0 · 1 · 2
Sign in to participate in the conversation Mastodon Instance

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!