Overview

Full name
docker.io/vqcuong96/hadoop_exporter
Registry
docker.io
Namespace
vqcuong96
Repository
hadoop_exporter
Cached tags
1
Last synced
07/06/2026, 01:50 PM

Introduction

Hadoop JMX Prometheus Exporter 镜像,抓取 NameNode/DataNode JMX 指标暴露 /metrics,用于大数据集群可观测性。

Details

vqcuong96/hadoop_exporter 将 Hadoop 2.x/3.x JMX bean 转为 Prometheus 文本格式,供 Prometheus scrape 后 Grafana 展示 HDFS/YARN 健康。典型以 sidecar 或独立 Pod 部署在可访问 JMX 端口(通常 9870/9864)的网络位置。与 jmx_exporter 通用 agent 相比配置针对 Hadoop;Kubernetes 中 DaemonSet 或 Deployment 均可,target JMX URL 经 env 配置。

快速启动

docker run -d --name hadoop-exporter \
  -p 5556:5556 \
  -e JMX_URL=http://namenode:9870/jmx \
  docker.io/vqcuong96/hadoop_exporter:latest

推荐实践

docker run -d --name hadoop-exporter \
  --restart unless-stopped \
  -p 5556:5556 \
  -e JMX_URL=http://namenode.internal:9870/jmx \
  -e EXPORTER_PORT=5556 \
  docker.io/vqcuong96/hadoop_exporter:1.0.0

核心参数说明

  • -p 5556:5556 — Prometheus scrape /metrics 端口
  • -e JMX_URL — NameNode/DataNode JMX HTTP 端点
  • -e EXPORTER_PORT — exporter 监听端口
  • --restart unless-stopped — 指标采集持续运行
  • 固定 tag — JMX 字段映射版本 pin
  • 网络 — 需可达 Hadoop JMX 端口

Kubernetes

apiVersion: apps/v1
kind: Deployment
metadata:
  name: hadoop-exporter
  namespace: monitoring
spec:
  replicas: 1
  selector:
    matchLabels:
      app: hadoop-exporter
  template:
    metadata:
      labels:
        app: hadoop-exporter
    spec:
      containers:
        - name: exporter
          image: docker.io/vqcuong96/hadoop_exporter:1.0.0
          ports:
            - containerPort: 5556
          env:
            - name: JMX_URL
              value: http://hadoop-nn.hadoop.svc:9870/jmx
---
apiVersion: v1
kind: Service
metadata:
  name: hadoop-exporter
  namespace: monitoring
spec:
  selector:
    app: hadoop-exporter
  ports:
    - port: 5556
      targetPort: 5556

ServiceMonitor 或 Prometheus annotation 抓取 5556;JMX URL 指向集群内 NameNode Service,大数据 namespace 网络策略需放行。

Latest tags (20)

View all 1 tags →
TagArchPushed AtSizeDigestSyncWishAction
docker.io/vqcuong96/hadoop_exporter
:latest
linux/amd64
2022/12/29 11:2647.3 MBsha256:83961e0ec9dc