Dgsh – Directed Graph Shell
A thread from 2017: https://news.ycombinator.com/item?id=13352659
Thanks for sharing - I was previously pondering a bit how a generic graph pipe shell syntax would look - I might try this out myself soon :)
1980, operating systems class, write a shell for UNIX. I thought I'd be clever and do more than simple pipes, so I created some syntax to enable the specification of a directed graph. It's pretty neat to see that someone has now done this industrial strength.
Interesting effort. On the other hand there is a bunch of other more popular and battle tested tools from Apache Airflow to a bioinformatics pipelines managers, such as Nextflow, Snakemake etc.
Looks pretty interesting (automatically deleting duplicate files). Bookmarking to see if I can utilize this!
Dgsh sounds like dogshit... Sorry
Python's mario is another terminal-oriented tool with concurrent task execution, but with async concurrency rather than multiprocess parallelism.
For example, to get a bunch of urls concurrently
$ mario async-map 'await asks.get ! x.text' < urls.txt
https://github.com/python-mario/mario