Docker Deploy Prometheus, Node Exporter, Grafana and cAdvisor (2023)

Docker compose file#

1
git clone https://github.com/Sayyiku/DataEye.git
2
mkdir -p promgrafnode/prometheus
3
mkdir -p promgrafnode/grafana/provisioning
4
touch promgrafnode/docker-compose.yml
5
touch promgrafnode/prometheus/prometheus.yml
6

7
docker-compose up -d

Node Exporter deployment on monitored hosts#

1
docker run -d -p 9100:9100 \
2
  -v "/root/docker/node-exporter/proc:/host/proc:ro" \
3
  -v "/root/docker/node-exporter/sys:/host/sys:ro" \
4
  -v "/root/docker/node-exporter/:/rootfs:ro" \
5
  --net="host" \
6
  --name node-exporter \
7
  prom/node-exporter

prometheus.yml#

1
global:
2
  scrape_interval: 1m
3

4
scrape_configs:
5
  - job_name: "prometheus"
6
    scrape_interval: 1m
7
    static_configs:
8
    - targets: ["localhost:9090"]
9

10
  - job_name: "node"
11
    static_configs:
12
    - targets: ["node-exporter:9100"]
13

14
   - job_name: "cadvisor"
15
    scrape_interval: 5s
16
    static_configs:
17
    - targets: ["your ip:8081"]
18

19
  - job_name: "AWS-SG"
20
    scrape_interval: 5s
21
    static_configs:
22
    - targets: ["your ip:9100"]
23

24
  - job_name: "Spaceberg-20T"
25
    scrape_interval: 5s
26
    static_configs:
27
    - targets: ["your ip:9100"]

Prometheus and Node Exporter architecture#

Prometheus and Node Exporter work together. You can run Prometheus and Node Exporter on the same machine. However, in most cases you will want to run Node Exporter on multiple remote Linux hosts.

Once Node Exporter is installed, you can reference the Node Exporter instances and all the nodes you want to monitor in the Prometheus configuration file. These might be Linux VMs running in your environment.

Prometheus scrapes data from the Node Exporter HTTP endpoints exposed on the remote hosts. You can enable additional collectors, gather the metrics you need, and access these metrics through Prometheus.

The Prometheus UI allows you to view service discovery and test the targets you’ve added to the Prometheus configuration. In the Prometheus configuration file, you define the endpoints and ports that connect the Prometheus server to the configured Node Exporter instances. Likewise, you can verify these connections from the Prometheus UI.

Configuring Grafana using the Prometheus server URL#

After the containers are up and running, you need to add Prometheus as a data source in Grafana. Open Grafana and click the settings gear in the lower-left corner. Then click Prometheus and configure Grafana using the URL of your Prometheus server.

Add data source

Add the IP and port of the Prometheus server URL to scrape metrics in Prometheus format.

Visualizing Prometheus Node Exporter metrics as a Grafana dashboard#

On Grafana.com, you can download an ID or JSON template to quickly create dashboards, saving you from the heavy lifting of building them manually.