It looks like this was reported in https://github.com/open-webui/pipelines/issues/548. There have been other requests or discussions on making pipe async but currently it still doesn't seem to be allowed so I am not sure of the reasoning. Does anyone know?
It would be nice to let the pipe be asych instead of currently now making each pipe running in a thread. I am doing RAG with long-running pipes that are mostly held up by IO so giving them dedicated threads is not the way.
Thanks!
It looks like this was reported in https://github.com/open-webui/pipelines/issues/548. There have been other requests or discussions on making pipe async but currently it still doesn't seem to be allowed so I am not sure of the reasoning. Does anyone know?
It would be nice to let the pipe be asych instead of currently now making each pipe running in a thread. I am doing RAG with long-running pipes that are mostly held up by IO so giving them dedicated threads is not the way.
Thanks!