Skip to content

Add degraded status to show pipes#18047

Merged
jt2594838 merged 3 commits into
apache:masterfrom
Caideyipi:show-pipes-degraded-status
Jun 30, 2026
Merged

Add degraded status to show pipes#18047
jt2594838 merged 3 commits into
apache:masterfrom
Caideyipi:show-pipes-degraded-status

Conversation

@Caideyipi

@Caideyipi Caideyipi commented Jun 29, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add nullable degraded-state visibility to pipes: IsDegraded in SHOW PIPES, is_degraded in information_schema.pipes, and matching Thrift fields.
  • Propagate degraded state from DataNodes to ConfigNodes through pipe heartbeat metadata with tri-state encode/decode support, so missing data remains unknown instead of being treated as false.
  • Track degraded realtime extraction in PipeRealtimeDataRegionHybridSource by marking active TsFile epochs degraded when extraction has to use the TsFile/BOTH path after tablet data becomes unreliable, and clearing the status when the epoch is no longer active.
  • Aggregate per-region status on DataNodes and per-node status on ConfigNodes so any degraded region/node makes the pipe degraded, all known false values make it non-degraded, and no known values remain unknown.

Test Coverage

  • PipeTemporaryMetaTest covers the tri-state codec plus DataNode/ConfigNode aggregation.
  • PipeHeartbeatParserTest covers heartbeat propagation, aggregation across DataNodes, and missing degraded heartbeat values.
  • PipeTableRespTest and ShowPipeTaskTest cover SHOW PIPES output.
  • PipeRealtimeExtractTest covers hybrid source degraded reporting and cleanup.

Local Checks

  • git diff --check
  • mvn spotless:apply -pl iotdb-core/confignode
  • mvn test -pl iotdb-core/node-commons -Dtest=PipeTemporaryMetaTest '-Dcheckstyle.skip=true'

@Caideyipi Caideyipi force-pushed the show-pipes-degraded-status branch from 42e94f6 to 9ae70c9 Compare June 29, 2026 03:02
@jt2594838 jt2594838 merged commit 2fedd8a into apache:master Jun 30, 2026
47 of 51 checks passed
@jt2594838 jt2594838 deleted the show-pipes-degraded-status branch June 30, 2026 11:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants