Skip to content

feat: add Hadoop monitoring dashboard queries#271

Open
jay77721 wants to merge 1 commit intoSigNoz:mainfrom
jay77721:feat/hadoop-dashboard
Open

feat: add Hadoop monitoring dashboard queries#271
jay77721 wants to merge 1 commit intoSigNoz:mainfrom
jay77721:feat/hadoop-dashboard

Conversation

@jay77721
Copy link
Copy Markdown

Description

Adds query configurations to the Apache Hadoop monitoring dashboard for SigNoz.

Changes

  • hadoop/hadoop-otlp-v1.json: Added query definitions (Builder) for all 28 dashboard panels covering Application Metrics, HDFS Metrics, and YARN Cluster Metrics.

Panels

  • Application Metrics: Submitted, Running, Pending, Failed, Killed, Completed application counts
  • HDFS Metrics: Live/Dead DataNodes, Volume Failures, Total/Under-replicated/Corrupt/Missing/Pending blocks, Remaining capacity, Capacity per DataNode
  • YARN Metrics: Memory used, vCores, Total containers, NodeManager status, Application count by status, Container count by status, Memory usage, vCore usage

Tech Stack

  • JMX receiver with OpenTelemetry Collector
  • Builder query type with metric-based aggregation
  • Filtered by deployment_environment variable

Acceptance Criteria (from issue #6426)

  • HDFS capacity/usage panels
  • NameNode health indicators
  • DataNode status panels
  • YARN container counts
  • ResourceManager metrics
  • Application metrics by status

Related to SigNoz issue: SigNoz/signoz#6426

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant