So, I'm working on this parallel workflow execution framework in using a implementation (datalevin) as temporary store.

Basically you define a job with some tasks, the relations between tasks and the framework took care to execute them in the right order (topological sorting and so on).

Parallelism and concurrency are achieved with clojure.core.async.

Using datalog as query language gives some help managing jobs and tasks relations: it's almost like having a graph db.

Of course we are going to release it when ready.

I can write about it a little bit more if anyone is interested.

is been a fantastic experience! I'm looking forward to attend the next year!

Functional Café

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!