Pipe: improve incremental memory estimation

[Caideyipi]

Description

This PR improves the pipe creation memory admission check from a coarse per-pipe estimate to an incremental estimate based on the tasks and sink subtasks that this DataNode will actually create.

Changes include:

• Estimate memory by local region tasks, and also check newly added single-region tasks.
• Account for sink subtask reuse so shared sink pending queues/subtasks are not charged repeatedly.
• Reuse the actual sink subtask key and parallelism logic from PipeSinkSubtaskManager.
• Match task builder parameter blending/preprocessing during admission estimation.
• Estimate batch memory from connector.batch.size-bytes/sink.batch.size-bytes, including leader-cache endpoint sharding.
• Estimate TsFile send read buffer with pipeSinkReadFileBufferSize.
• Skip admission checks for idempotent create no-ops, while checking before dropping old tasks during recreate.

Verification

• mvn spotless:apply -pl iotdb-core/datanode,iotdb-core/node-commons
• git -c core.preloadIndex=false diff --check -- iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/agent/task/PipeTaskAgent.java iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/agent/task/PipeDataNodeTaskAgent.java iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/agent/task/builder/PipeDataNodeTaskBuilder.java iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/agent/task/subtask/sink/PipeSinkSubtaskManager.java
• mvn "-Ddevelocity.off=true" "-Dcheckstyle.skip=true" "-Dspotless.check.skip=true" "-DskipTests" compile -pl iotdb-core/node-commons

Also ran datanode compile:

• mvn "-Ddevelocity.off=true" "-Dcheckstyle.skip=true" "-Dspotless.check.skip=true" "-DskipTests" compile -pl iotdb-core/datanode
• It reached javac but failed on existing generated-source/dependency issues such as missing IFill, Accumulator, and org.apache.commons.collections4.comparators, not in the modified pipe files.

[codecov]

Codecov Report

❌ Patch coverage is 45.94595% with 100 lines in your changes missing coverage. Please review.
✅ Project coverage is 41.62%. Comparing base (2e099a6) to head (b9a548c).
⚠️ Report is 1 commits behind head on master.

Files with missing lines	Patch %	Lines
...otdb/db/pipe/agent/task/PipeDataNodeTaskAgent.java	43.26%	80 Missing ⚠️
...gent/task/subtask/sink/PipeSinkSubtaskManager.java	67.85%	9 Missing ⚠️
...e/iotdb/commons/pipe/agent/task/PipeTaskAgent.java	0.00%	7 Missing ⚠️
...pe/agent/task/builder/PipeDataNodeTaskBuilder.java	55.55%	4 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #18049      +/-   ##
============================================
- Coverage     41.68%   41.62%   -0.06%     
  Complexity      318      318              
============================================
  Files          5296     5296              
  Lines        371819   371945     +126     
  Branches      48106    48137      +31     
============================================
- Hits         154975   154815     -160     
- Misses       216844   217130     +286     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[jt2594838]

i18n

[Caideyipi]

Done. I moved the memory check details into PipeMessages with both English and Chinese i18n entries, and updated the code to use those message constants.

[sonarqubecloud]

Quality Gate passed

Issues
6 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud