Supply framework implementations to enable the building of "pipelines", constituted from conduits, via a directed acyclic graph execution model. There's a few way to implement the API interface.
It would be useful if there was a way to declare a conduit DAG (via some kind of serialized configuration, eg YAML) that is then processed in the context of the provided implementation. This is essentially maintaining it as configuration. The program can consume the configuration and build the execution graph.
One thing to consider is the reaping of threads when it is known that there has been no traffic to a given queue, though this requires some introspection to facilitate.
Supply framework implementations to enable the building of "pipelines", constituted from conduits, via a directed acyclic graph execution model. There's a few way to implement the API interface.
It would be useful if there was a way to declare a conduit DAG (via some kind of serialized configuration, eg YAML) that is then processed in the context of the provided implementation. This is essentially maintaining it as configuration. The program can consume the configuration and build the execution graph.
One thing to consider is the reaping of threads when it is known that there has been no traffic to a given queue, though this requires some introspection to facilitate.