Skip to content

Add pipe data loss debug logs and split test#18120

Open
Caideyipi wants to merge 5 commits into
apache:masterfrom
Caideyipi:pipe-data-loss-debug-100-timeseries
Open

Add pipe data loss debug logs and split test#18120
Caideyipi wants to merge 5 commits into
apache:masterfrom
Caideyipi:pipe-data-loss-debug-100-timeseries

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

Summary

  • Add [PipeDataLossDebug] debug traces across source query parsing, collector, sink batching/emitting, and receiver execution.
  • Include TsFile metadata counts, parser input/output row counts, non-null/null/deleted field counts, tablet shape, batch size, and receiver status summaries.
  • Add a UT covering the new evidence shape: 100 single-measurement time-series split patterns reading the same aligned TsFile concurrently.

Tests

  • mvn spotless:apply -pl iotdb-core/datanode
  • mvn spotless:check -pl iotdb-core/datanode
  • git diff --cached --check before commit
  • mvn -U -Ddevelocity.off=true -pl iotdb-core/datanode -Dtest=TsFileInsertionEventParserTest#testQueryParserKeepsPointsForHundredTimeSeriesSplitAlignedTsFile test failed before running tests because snapshot dependency resolution could not find org.apache.iotdb:iotdb-parent:pom:2.0.11-20260704.112325-1 in timecho.public.
  • mvn -Ddevelocity.off=true -pl iotdb-core/datanode -am -DskipTests compile failed before DataNode at iotdb-thrift generated sources due local javax.annotation missing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant