In LangChain there's tracing functionality where we can see all the LLM invocation and use it to debug the implementation.
This functionality will be useful to have, however the API of langchain-server is opaque. I don't know where to get the source of it or any possibility to reuse it.
I would love to reuse any available tracer and UI, one idea is probably to use OpenTelemetry. I don't think it has proper UI for development need.
For implementation detail, we can use callback.
In LangChain there's tracing functionality where we can see all the LLM invocation and use it to debug the implementation.
This functionality will be useful to have, however the API of langchain-server is opaque. I don't know where to get the source of it or any possibility to reuse it.
I would love to reuse any available tracer and UI, one idea is probably to use OpenTelemetry. I don't think it has proper UI for development need.
For implementation detail, we can use callback.