Skip to content

Reduce pipe load success log noise#18106

Open
Caideyipi wants to merge 2 commits into
masterfrom
fix/reduce-pipe-load-log-noise
Open

Reduce pipe load success log noise#18106
Caideyipi wants to merge 2 commits into
masterfrom
fix/reduce-pipe-load-log-noise

Conversation

@Caideyipi

@Caideyipi Caideyipi commented Jul 3, 2026

Copy link
Copy Markdown
Collaborator

Description

  • Lower high-frequency successful pipe-generated load, receiver, and load-tsfile analysis logs from INFO to DEBUG.
  • Preserve INFO visibility for user-triggered load-tsfile paths where possible, and keep generic compaction/file-lifecycle logs unchanged.
  • Lazily create and close the load tsfile dispatcher executor to avoid unnecessary thread pool churn on local load paths.

Validation

  • mvn spotless:apply -pl iotdb-core/datanode,iotdb-core/node-commons
  • git diff --check

@codecov

codecov Bot commented Jul 3, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 8.88889% with 82 lines in your changes missing coverage. Please review.
✅ Project coverage is 41.85%. Comparing base (1c20df4) to head (4828508).

Files with missing lines Patch % Lines
.../plan/scheduler/load/LoadTsFileDispatcherImpl.java 9.67% 28 Missing ⚠️
...ryengine/plan/analyze/load/LoadTsFileAnalyzer.java 0.00% 25 Missing ⚠️
.../iotdb/db/storageengine/dataregion/DataRegion.java 0.00% 15 Missing ⚠️
...ngine/plan/scheduler/load/LoadTsFileScheduler.java 8.33% 11 Missing ⚠️
...iotdb/commons/pipe/receiver/IoTDBFileReceiver.java 40.00% 3 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #18106      +/-   ##
============================================
+ Coverage     41.73%   41.85%   +0.11%     
  Complexity      318      318              
============================================
  Files          5297     5297              
  Lines        373974   374015      +41     
  Branches      48270    48277       +7     
============================================
+ Hits         156075   156534     +459     
+ Misses       217899   217481     -418     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Caideyipi Caideyipi force-pushed the fix/reduce-pipe-load-log-noise branch from ea1545e to e5091cb Compare July 3, 2026 06:27
Comment on lines +131 to +134
RpcUtils.getStatus(
TSStatusCode.INTERNAL_SERVER_ERROR,
"Unexpected errors: " + t.getMessage()));
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i18n

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. Added en/zh i18n constants for the unexpected-error status message and switched both dispatch paths to use them.

…uce-pipe-load-log-noise

# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileAnalyzer.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/scheduler/load/LoadTsFileScheduler.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/DataRegion.java
@sonarqubecloud

sonarqubecloud Bot commented Jul 7, 2026

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants