Is there an existing issue for this?
Problem (why)
When we use model.ask, we pass an insight_id as a parameter. This will :
- Retrieve the existing conversation associated with that insight_id.
- Relate each new message to that same insight_id.
This way, all messages are correctly grouped within the same conversation or "room." The problem we're seeing is that if we use the OpenAI client and pass the insight_id within an extra_body, the messages are not correctly related to that insight_id. As a result, instead of continuing the existing conversation, new, separate conversations are created."
Impact (who)
This change gives all users an option to keep track of the conversations within a room using the SDK.
Existing
OpenAIEndpoints.java
Requirements (what)
Is there an existing issue for this?
Problem (why)
When we use model.ask, we pass an insight_id as a parameter. This will :
This way, all messages are correctly grouped within the same conversation or "room." The problem we're seeing is that if we use the OpenAI client and pass the insight_id within an extra_body, the messages are not correctly related to that insight_id. As a result, instead of continuing the existing conversation, new, separate conversations are created."
Impact (who)
This change gives all users an option to keep track of the conversations within a room using the SDK.
Existing
OpenAIEndpoints.java
Requirements (what)