Fix pipe history LoadTsFile after deleting aligned measurements#18116
Conversation
271906d to
57e4d5f
Compare
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #18116 +/- ##
=========================================
Coverage 41.84% 41.84%
Complexity 318 318
=========================================
Files 5296 5296
Lines 373593 373633 +40
Branches 48234 48243 +9
=========================================
+ Hits 156313 156346 +33
- Misses 217280 217287 +7 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
57e4d5f to
959f153
Compare
|
Follow-up for the table-model CI failures: The failed I updated the guard to return only when Local validation:
I also tried to run the affected ITs locally, but the local build is still blocked before tests by the existing |
|



Summary
AlignedWritableMemChunkto TsFile.enable_auto_create_schema=falsewith unflushed aligneddelete timeseriesbefore after-batch history sync.Root cause
delete timeserieson an aligned measurement removes it from the active measurement map and marks its TVList column deleted, but the flush writer still used the full historicalschemaList. A history Pipe created before the memtable was flushed could therefore produce a TsFile whose metadata still contained the deleted measurement, without a corresponding mod file. The receiver then tried to verify/create a schema that should no longer exist, andLoadTsFilefailed or retried forever when auto-create schema was disabled.Tests
mvn spotless:check -pl iotdb-core/datanode,integration-test -P with-integration-testsgit diff --checkmvn -pl integration-test -am -P with-integration-tests -DskipUTs -Dit.test=IoTDBPipeReceiverAutoCreateDisabledIT#testAutoSplitHistoryTsFileWithUnflushedAlignedDeletionWhenReceiverAutoCreateSchemaDisabled -DfailIfNoTests=false -Dfailsafe.failIfNoSpecifiedTests=false verify(blocked before the IT by existing upstream local compile failure iniotdb-thrift: generated thrift sources import missingjavax.annotationon JDK 17)