Follow
Are there any pipeline managers written in a functional language? I've implemented my own at work and that ~200 lines of code were doing their job very well.
A functional language would be a good fit, because then the yaml file would not be different from (python) code, which would allow me to come up with advance compositions without implementing them.
I might have came up with a fun project to pick up a functional language.
The main idea behind was to express a pipeline as a dag where nodes perform action in data. The dag is described in a yaml file.