TRACY-111: Parse providers' server-sent events and feed them to tracing adapters by Vladislav0Art · Pull Request #227 · JetBrains/tracy

Vladislav0Art · 2026-03-19T20:20:24Z

Motivation and Context

Closes https://youtrack.jetbrains.com/issue/TRACY-111

Changed API of LLMTracingAdapter:
1. getSpanName no longer accepts TracyHttpRequest instance (it never used it)
2. ❗️ isStreamingRequest is removed: Ktor/OkHttp interceptors now decide whether the current response is of a streaming type by looking at its content type (should be text/event-stream)
3. ❗️ handleStreaming is removed: it handled a fully concatenated string of all events received from the server; removed in favor of per-event handling via registerResponseStreamEvent.
4. registerResponseStreamEvent is added: one public version called by interceptors (implemented as factory method calling the same-named protected method); the other one protected, intended to be implemented by provider-specific adapters.
Changed API of EndpointApiHandler:
1. handleStreaming replaced with handleStreamingEvent, which does per-event handling (see the rationale above)
❗️ Distinguished streaming responses via response content type in OkHttp and Ktor interceptors.
❗️Introduced SseParser that accepts UTF-8 decoded stream chunks and builds SSE events from them (implementation is SSE spec-compliant) + Wrote tests for the parser.
1. This SseParser is used in conjunction with a stateful UTF8Decoder (a wrapper over standard java.nio.charset.CharsetDecoder) so that raw stream bytes are correctly converted to UTF8 strings and then passed to the SseParser; it is needed for correct handling of multi-byte UTF-8 sequences split across read boundaries.
Correctly re-implemented handling of SSE events for OpenAI's chat completions and Responses API (see examples of traces below).
Modified the signature of OpenAIApiUtils.setCommonResponseAttributes: now directly accepts response body as JsonObject (previously, accepted TracyHttpResponse)
Fixed SseParser.dispatchEvent() to reset retryValue on early return (empty dataBuffer), preventing a retry: field in a data-less event block from carrying over to the next event.
Close spans on buffered source close instead of the response body close, as the latter may never be closed by a client (e.g., an OpenAI SDK client doesn't close the response body on an erroneous response, yet the span MUST always be closed).
1. See okhttp change, and Ktor change.

Examples of traces with streaming requests:

OpenAI Responses API: here
OpenAI Chat Completions: here

Affects: #223

TODOs

~~TODO: test on a real server-sent-events stream (openai, anthropic, gemini - all event types)~~
~~TODO: should be protected/internal? (about populateUnmappedAttributes)~~
~~Test implementation on streaming tests: OpenAI, Gemini + manually investigate the traces structure.~~
~~Manually send traces to Langfuse with SSE: see how it is rendered.~~
~~ResponsesOpenAIApiEndpointHandlerTest.'test OpenAI responses API streaming' fails → fixed~~

Breaking Changes

LLMTracingAdapter.isStreamingRequest removed; streaming is now detected automatically from the text/event-stream content type.
LLMTracingAdapter.handleStreaming / EndpointApiHandler.handleStreaming removed; replaced by per-event registerResponseStreamEvent / handleStreamingEvent.
getSpanName no longer receives a TracyHttpRequest parameter.

Copilot

Pull request overview

This PR updates Tracy’s tracing pipeline to correctly support Server-Sent Events (SSE) streaming responses by parsing event-stream chunks incrementally and feeding events into provider adapters, replacing the previous “concatenate all events into one string” approach.

Changes:

Introduces an SSE parser (SseParser) + tests, and routes streaming handling through per-event callbacks (SseEvent).
Refactors tracing adapter APIs (LLMTracingAdapter, EndpointApiHandler) to support per-event streaming handling and span naming without request input.
Updates OkHttp/Ktor instrumentation to detect SSE via text/event-stream and trace events as they arrive; updates OpenAI streaming handlers accordingly.

Reviewed changes

Copilot reviewed 25 out of 25 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/clients/OpenAIClient.kt	Updates imports after interceptor package move.
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/handlers/images/ImagesCreateOpenAIApiEndpointHandler.kt	Migrates OpenAI image streaming handling to per-SSE-event processing.
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/handlers/images/ImagesCreateEditOpenAIApiEndpointHandler.kt	Migrates OpenAI image edit streaming handling to per-SSE-event processing.
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/handlers/ResponsesOpenAIApiEndpointHandler.kt	Reworks Responses API streaming to handle SSE events and parse final “completed” payload.
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/handlers/OpenAIApiUtils.kt	Changes common response attribute helper to accept `JsonObject` directly.
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/handlers/ChatCompletionsOpenAIApiEndpointHandler.kt	Reworks chat completion streaming to accumulate deltas per SSE event.
tracing/openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/OpenAILLMTracingAdapter.kt	Adapts OpenAI adapter to new span naming + per-event streaming API.
tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorProtocolAdapters.kt	Adjusts response view to carry `TracyHttpResponseBody` variants.
tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt	Detects SSE by content type and streams events into adapter via `SseParser`.
tracing/gemini/src/jvmMain/kotlin/org/jetbrains/ai/tracy/gemini/clients/GeminiClient.kt	Updates imports after interceptor package move.
tracing/gemini/src/jvmMain/kotlin/org/jetbrains/ai/tracy/gemini/adapters/handlers/GeminiImagenHandler.kt	Updates handler API to `handleStreamingEvent` (unsupported).
tracing/gemini/src/jvmMain/kotlin/org/jetbrains/ai/tracy/gemini/adapters/handlers/GeminiContentGenHandler.kt	Updates handler API to `handleStreamingEvent` (unsupported).
tracing/gemini/src/jvmMain/kotlin/org/jetbrains/ai/tracy/gemini/adapters/GeminiLLMTracingAdapter.kt	Adapts Gemini adapter to new span naming + per-event streaming API.
tracing/core/src/jvmTest/kotlin/org/jetbrains/ai/tracy/core/http/parsers/SseParserTest.kt	Adds test coverage for SSE parsing, including OpenAI examples.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt	Updates OkHttp interceptor to detect SSE responses and parse events incrementally.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/Interceptors.kt	Moves interceptor utilities into `core.interceptors` package.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/http/protocol/TracyHttpResponse.kt	Adds `EventStream` and `Empty` response body variants.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/http/parsers/SseParser.kt	Adds spec-oriented SSE parser and `SseEvent` model.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/handlers/sse/SseHandling.kt	Adds standardized SSE handling failure `Result` + exception type.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/handlers/EndpointApiHandler.kt	Replaces `handleStreaming` with per-event `handleStreamingEvent`.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt	Refactors adapter API for span naming and per-event SSE streaming registration.
tracing/anthropic/src/jvmTest/kotlin/org/jetbrains/ai/tracy/anthropic/AnthropicTracingTest.kt	Updates imports after interceptor package move.
tracing/anthropic/src/jvmMain/kotlin/org/jetbrains/ai/tracy/anthropic/clients/AnthropicAIClient.kt	Updates imports after interceptor package move.
tracing/anthropic/src/jvmMain/kotlin/org/jetbrains/ai/tracy/anthropic/adapters/AnthropicLLMTracingAdapter.kt	Adapts Anthropic adapter to new span naming + per-event streaming API (unsupported).
examples/src/main/kotlin/org/jetbrains/ai/tracy/examples/clients/OkHttpClientAutotracingExample.kt	Updates example imports after interceptor package move.

Comments suppressed due to low confidence (1)

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:301

originalBodyWithTracedSSE.close() only ends the span and never closes the wrapped originalBody / source. This can leak the underlying connection/resources and also leaves SseParser cleanup dependent on the source being closed elsewhere. Ensure the wrapper’s close() closes the underlying body/source (and the parser) before ending the span (ideally by keeping a single BufferedSource instance and closing that, or delegating to originalBody.close()).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/http/parsers/SseParser.kt

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt

georgiizorabov · 2026-03-24T11:23:08Z

.../openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/handlers/OpenAIApiUtils.kt

let's change it to

body["temperature"]?.jsonPrimitive?.doubleOrNull?.let { span.setAttribute(GEN_AI_REQUEST_TEMPERATURE, it) }

and in similar places too?

addressed in 8e44084.

NOTE: I modified the assignments present ONLY in this file, not everywhere.

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt

georgiizorabov · 2026-03-24T11:35:31Z

Also, please fix this: Agents.md

georgiizorabov · 2026-03-24T11:52:59Z

...c/src/jvmMain/kotlin/org/jetbrains/ai/tracy/anthropic/adapters/AnthropicLLMTracingAdapter.kt

+        event: SseEvent,
+        index: Long
+    ): Result<Unit> {
+        return sseHandlingFailure("Unsupported")


will this throw the warning on every streaming event?

Yes, it will. Should these unimplemented adapters be silenced instead?

I think either once per trace if possible or mb silence, yes. WDYT?
@Vladislav0Art, @slawa4s, @agbragin

I’d prefer logging it once per trace rather than silencing it

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt

Vladislav0Art · 2026-03-25T15:09:59Z

Also, please fix this: Agents.md

addressed in 57c04b5.

@georgiizorabov hi! I addressed your comments. Please, have a look.

Copilot

Pull request overview

Copilot reviewed 26 out of 26 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (2)

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:300

withTracedSSE() overrides ResponseBody.close() but never closes the underlying originalBody/source. This can leak connections if the caller closes the response early (and it also prevents SseCapturingSource.close() / parser.close() from running). Ensure close() closes the wrapped source/body (e.g., call originalBody.close() or source().close() in a finally block) before ending the span.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:385
SSE bytes are decoded to UTF-8 per read() call via readUtf8(bytesRead). If a multi-byte UTF-8 code point is split across reads, this will decode with replacement characters and corrupt the stream fed into SseParser (potentially breaking JSON parsing for non-ASCII content). Consider using an incremental UTF-8 decoder with carry-over bytes between reads, or feed raw bytes into the parser and decode there with a streaming decoder.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/http/parsers/SseParser.kt

Copilot · 2026-03-25T15:16:21Z

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

+                                sseParser.feed(
+                                    input = buffer.decodeToString(0, bytesRead)
+                                )


buffer.decodeToString(0, bytesRead) decodes each read chunk independently. If a multi-byte UTF-8 sequence is split across reads, decoding will insert replacement characters and corrupt the SSE text fed into SseParser. Consider decoding with a streaming UTF-8 decoder (keeping trailing partial bytes between iterations) before calling sseParser.feed(...).

@copilot apply changes based on this feedback

Fixed in fd2636b. Replaced buffer.decodeToString(0, bytesRead) with a stateful CharsetDecoder (Charsets.UTF_8.newDecoder()) that uses ByteBuffer.compact() to carry over undecoded partial multi-byte sequences between reads. The byteBuffer has DEFAULT_BUFFER_SIZE + 3 capacity to absorb up to 3 leftover bytes from an incomplete 4-byte UTF-8 sequence, and charBuffer is sized identically (worst-case all-ASCII input produces as many chars as bytes).

Vladislav0Art · 2026-03-25T21:36:29Z

~~TODO(@Vladislav0Art): refactor TracingPlugin in ktor module.~~

Addressed

slawa4s · 2026-03-27T09:38:37Z

...c/src/jvmMain/kotlin/org/jetbrains/ai/tracy/anthropic/adapters/AnthropicLLMTracingAdapter.kt

    }

-    override fun getSpanName(request: TracyHttpRequest) = "Anthropic-generation"
+    override fun getSpanName() = "Anthropic-generation"


Could you, please, align span naming with GenAI conventions
Span names now follow {gen_ai.operation.name} {gen_ai.request.model}:
https://opentelemetry.io/docs/specs/semconv/gen-ai/anthropic/

Addressed in 9fe5749

I didn't modify this "Anthropic-generation" name here because I have no information about the model and operation (both of which are only known at the stage of parsing the response body).

Notes:

Now, it looks like:

See the trace.

Pointed to naming problem in: TRACY-114 Audit attribute names used in Tracy to comply with GenAI Spec

slawa4s · 2026-03-27T10:16:56Z

...c/src/jvmMain/kotlin/org/jetbrains/ai/tracy/anthropic/adapters/AnthropicLLMTracingAdapter.kt

+        event: SseEvent,
+        index: Long
+    ): Result<Unit> {
+        return sseHandlingFailure("Unsupported")


I’d prefer logging it once per trace rather than silencing it

Vladislav0Art · 2026-03-30T10:38:54Z

@slawa4s's comment, addressed in 4d0582d

Copilot

Pull request overview

Copilot reviewed 28 out of 28 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (6)

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:333

asResponseView() dereferences response.body without a safe call (response.body.contentType()), but body is nullable in OkHttp. This is a compile-time error and should be changed to response.body?.contentType() with appropriate handling when the body is absent.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:298
The wrapped ResponseBody overrides close() but doesn't close the underlying originalBody (nor the SseCapturingSource / parser). This can leak the connection and also prevents SseParser.close() from flushing the final buffered event when the consumer closes the response without fully reading it. Delegate close to originalBody.close() (or the wrapped BufferedSource) and ensure span.end() happens exactly once (e.g., in a finally).
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:384
readUtf8(bytesRead) decodes each read chunk independently. If a multi-byte UTF-8 sequence is split across Source.read() boundaries, this can introduce replacement characters / corrupted text before feeding it to SseParser. Consider using a stateful CharsetDecoder (similar to the Ktor implementation) or buffering trailing bytes between reads so SSE parsing remains correct for arbitrary chunking.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt:66
sseHandlingUnsupportedWarningPrinted is mutable adapter-wide state that is reset in registerRequest. If a single LLMTracingAdapter instance is used by multiple concurrent requests (typical for a shared HTTP client), this becomes racy and can suppress/duplicate warnings across unrelated spans. Store the "warning already printed" flag on the Span (e.g., a boolean attribute) or in a per-span structure instead of a shared field.

abstract class LLMTracingAdapter(private val genAISystem: String) {
    private var sseHandlingUnsupportedWarningPrinted = false

    fun registerRequest(span: Span, request: TracyHttpRequest): Unit = runCatching {
        // new request -> new trace
        sseHandlingUnsupportedWarningPrinted = false

        // Pre-allocate in case the span reaches the limit
        span.setAttribute(DROPPED_ATTRIBUTES_COUNT_ATTRIBUTE_KEY, 0L)

        getRequestBodyAttributes(span, request)
        span.setAttribute("gen_ai.api_base", "${request.url.scheme}://${request.url.host}")

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:14

JsonPrimitive and KotlinLogging imports appear to be unused in this file (JsonPrimitive only appears in KDoc). If the build enables "warnings as errors" / linting, this can fail CI; consider removing unused imports.
tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt:254
response.body is nullable (see val originalBody = originalResponse.body ?: ... below), but here it's dereferenced without a safe call. This will not compile and can also crash at runtime if a response has no body. Use response.body?.contentType() (and treat null as non-streaming).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

…eBody`

slawa4s · 2026-04-02T11:04:09Z

...n/org/jetbrains/ai/tracy/openai/adapters/handlers/ChatCompletionsOpenAIApiEndpointHandler.kt

+        span: Span,
+        event: SseEvent,
+        index: Long,
+    ): Result<Unit> = runCatching {


Is there any point in outer catching?

In case of any exceptions that I don't catch explicitly. For instance, .jsonArray throws if the JsonElement is not an array; Below, I don't treat this error explicitly.

Safety-wise, it's reasonable to have it.

slawa4s · 2026-04-02T11:05:28Z

...n/org/jetbrains/ai/tracy/openai/adapters/handlers/ChatCompletionsOpenAIApiEndpointHandler.kt

+    ): Result<Unit> = runCatching {
+        val data = runCatching {
+            Json.parseToJsonElement(event.data).jsonObject
+        }.getOrNull() ?: return@runCatching sseHandlingFailure("Cannot parse event data as JSON")


Please use direct return instead of return@runCatching. Also, sseHandlingFailure("Cannot parse event data as JSON") swallows the original exception. Use getOrElse { } (it is Throwable ) to preserve the
JsonDecodingException details.

addressed in c4c3d9a

slawa4s · 2026-04-02T11:27:54Z

...rc/jvmMain/kotlin/org/jetbrains/ai/tracy/core/interceptors/OpenTelemetryOkHttpInterceptor.kt

+        // peek at the bytes just written to sink
+        val text = sink.peek().apply {
+            skip(sink.size - bytesRead)
+        }.readUtf8(bytesRead)


readUtf8 is stateless. If it reads (multiple) one long UTF character (like emoji) it could be splitted across bytes, and symbol would be wrong. Please, use stateful decoder, like you did in Ktor

Addressed in:

52e0bc0: create UTF8Decoder.

f0ad2e0: use the decoder in Ktor tracing plugin.

db91929: use the decoder here in OpenTelemetryOkHttpInterceptor.

.../openai/src/jvmMain/kotlin/org/jetbrains/ai/tracy/openai/adapters/OpenAILLMTracingAdapter.kt

slawa4s · 2026-04-02T11:41:14Z

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt

 * @param genAISystem The name of the GenAI system (e.g., "openai", "anthropic", "gemini")
 */
 abstract class LLMTracingAdapter(private val genAISystem: String) {
+    private var sseHandlingUnsupportedWarningPrinted = false


Mutable state is shared across concurrent (possible) requests. SSE event index is stored in the span itself, so concurrent SSE streams on different spans are fine, but the sseHandlingUnsupportedWarningPrinted flag is adapter-level.

addressed in 655486a

slawa4s · 2026-04-02T12:03:42Z

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

+                        byteBuffer.flip()
+                        charBuffer.clear()
+
+                        val endOfInput = originalBody.isClosedForRead


endOfInput is read from isClosedForRead inside the loop, but channel state can change between the loop condition check and this check. Mb pass false in utf8Decoder.decode and do final decode + flush?

Addressed in both Ktor and OkHttp interceptors: 5687846

slawa4s · 2026-04-02T12:34:11Z

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

+                    // NOTE: we must first peek and only then await.
+                    // otherwise there are cases when an empty body gets peeked
+                    val peeked = response.rawContent.readBuffer.peek()
+                    response.rawContent.awaitContent(Int.MAX_VALUE)


Let's document this ordering. It's non-obvious and relies on undocumented Ktor internals, so it'lt silently break if swapped.

How exactly do you mean to document? I generated a descriptive comment in f0befc2

Vladislav0Art · 2026-04-02T17:18:42Z

~~TODOs(@Vladislav0Art):~~

[+] ~~See how SseCapturingSource and OpenTelemetryOkHttpInterceptor.intercept are refactored in TRACY-87: Automatically collect test fixtures for OpenAI tests #224:~~
1. ~~A single buffered source created.~~
2. ~~Span is ended on the buffered source close.~~

…E events & create `SseCapturingSource` once NOTES: 1. `UTF8Decoder` is needed to correctly parse raw bytes into UTF-8 chunks. 2. `OkHttpResponseBody.source` MUST return the same instance on multiple invocations; before, it was creating `SseCapturingSource` anew on each call.

Vladislav0Art · 2026-04-03T16:33:52Z

~~TODO (@Vladislav0Art):~~

~~Write tests for the UTF8Decoder (there is already UTF8DecoderTest).~~

Addressed in 0c9fe5e.

…ontent`

Vladislav0Art · 2026-04-07T15:35:26Z

@georgiizorabov Gosha, please also have a look, as the PR is quite big, so that not only Slawa reviews it.

georgiizorabov · 2026-04-07T21:44:50Z

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt

+                    tracingChannel.close(e)
+                }
+            } finally {
+                span.end()


wdyt about reordering these end() and close() calls? Im not sure if it really can create some problem (like close triggers adding an attribute to a closed span) but just in case + for consistency with okhttp?

In this case, there is no effect regardless of the order. Still addressed in a010de8.

georgiizorabov

LGTM after fixing the comments

Vladislav0Art changed the title ~~TRACY-111: Parse Providers' Server-Sent Events And Feed Them To Tracing Adapters~~ TRACY-111: Parse Providers' Server-Sent Events and Feed Them to Tracing Adapters Mar 19, 2026

Vladislav0Art changed the title ~~TRACY-111: Parse Providers' Server-Sent Events and Feed Them to Tracing Adapters~~ TRACY-111: Parse providers' server-sent events and feed them to tracing adapters Mar 19, 2026

Vladislav0Art marked this pull request as ready for review March 23, 2026 15:23

Vladislav0Art requested review from Copilot and georgiizorabov and removed request for Copilot March 23, 2026 15:23

Copilot started reviewing on behalf of Vladislav0Art March 23, 2026 15:24 View session

Copilot AI reviewed Mar 23, 2026

View reviewed changes

georgiizorabov reviewed Mar 24, 2026

View reviewed changes

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt Outdated Show resolved Hide resolved

georgiizorabov reviewed Mar 24, 2026

View reviewed changes

tracing/core/src/jvmMain/kotlin/org/jetbrains/ai/tracy/core/adapters/LLMTracingAdapter.kt Outdated Show resolved Hide resolved

Vladislav0Art force-pushed the vartiukhov/refactoring/change-tracing-of-event-stream-responses branch from 2f1b8a8 to 6939d0b Compare March 25, 2026 14:38

Vladislav0Art requested review from Copilot and georgiizorabov March 25, 2026 15:10

Copilot started reviewing on behalf of Vladislav0Art March 25, 2026 15:11 View session

Copilot AI reviewed Mar 25, 2026

View reviewed changes

slawa4s requested changes Mar 27, 2026

View reviewed changes

Vladislav0Art added 7 commits March 30, 2026 12:41

feat: generate SSE parser

91d4e2e

feat: create tests for SSE parser (spec's example 3 is incorrect)

a7a0068

fix: remove example 3 from sse parser tests

ace712a

feat: add comments to implementation of SseParser

17c8897

refactor

1970d53

feat: add TODO in SseParserTest

89a7f73

feat: introduce LLMTracingAdapter.handleStreamingEvent method

a1fa4d9

Vladislav0Art added 3 commits March 30, 2026 14:18

feat(SseParser): dispatch final event if any on close

95c4664

fix: set endOfInput as originalBody.isClosedForRead

5c140ef

refactor: imports

630ab43

Vladislav0Art requested a review from Copilot March 30, 2026 12:38

Copilot started reviewing on behalf of Vladislav0Art March 30, 2026 12:39 View session

Copilot AI reviewed Mar 30, 2026

View reviewed changes

tracing/ktor/src/jvmMain/kotlin/org/jetbrains/ai/tracy/ktor/KtorHttpClient.kt Outdated Show resolved Hide resolved

refactor: move call of traceServerSentEvents into `transformRespons…

ff430c3

…eBody`

Vladislav0Art requested a review from slawa4s March 30, 2026 12:50

slawa4s requested changes Apr 2, 2026

View reviewed changes

Vladislav0Art added 7 commits April 3, 2026 16:39

feat: don't swallow exceptions in sse parsing

c4c3d9a

feat: create stateful UTF8Decoder

52e0bc0

feat(Ktor): use UTF8Decoder to parse SSE events

f0ad2e0

feat: make sseHandlingUnsupportedWarningPrinted an AtomicBoolean

655486a

feat: do the final decoding and flush remaining bytes

5687846

feat: create a test suite for UTF8Decoder (WIP)

41e1184

Vladislav0Art added 3 commits April 3, 2026 18:44

feat: add comment about sseHandlingUnsupportedWarningPrinted

fdfebda

feat(Ktor): generate comment on why peek should come before `awaitC…

f0befc2

…ontent`

feat: generate tests for UTF-8 decoder

0c9fe5e

Vladislav0Art requested a review from slawa4s April 7, 2026 15:24

Vladislav0Art mentioned this pull request Apr 7, 2026

TRACY-87: Automatically collect test fixtures for OpenAI tests #224

Open

georgiizorabov reviewed Apr 7, 2026

View reviewed changes

georgiizorabov previously approved these changes Apr 7, 2026

View reviewed changes

feat: close span at the end of finally block

a010de8

Vladislav0Art dismissed georgiizorabov’s stale review via a010de8 April 9, 2026 02:04

Vladislav0Art requested a review from georgiizorabov April 9, 2026 02:05

Conversation

Vladislav0Art commented Mar 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation and Context

TODOs

Breaking Changes

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

georgiizorabov commented Mar 24, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Vladislav0Art Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Vladislav0Art commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Copilot AI Mar 25, 2026

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 30, 2026

Choose a reason for hiding this comment

Uh oh!

Vladislav0Art commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Vladislav0Art Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Notes:

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Vladislav0Art commented Mar 30, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Vladislav0Art commented Mar 19, 2026 •

edited

Loading

Vladislav0Art Mar 25, 2026 •

edited

Loading

Vladislav0Art commented Mar 25, 2026 •

edited

Loading

Vladislav0Art commented Mar 25, 2026 •

edited

Loading

Vladislav0Art Mar 30, 2026 •

edited

Loading

Vladislav0Art commented Apr 2, 2026 •

edited

Loading

Vladislav0Art commented Apr 3, 2026 •

edited

Loading

georgiizorabov Apr 7, 2026 •

edited

Loading