Skip to content

Latest commit

 

History

History
81 lines (54 loc) · 3.2 KB

integrate_prometheus_with_grafana.md

File metadata and controls

81 lines (54 loc) · 3.2 KB
Raw

Prometheus and Grafana

Prometheus is an open-source monitoring and alerting system which collects the data to understand and predict the behaviour of your application. Remember: Prometheus stores the collected data(metrics) in the form of time-series data.

Grafana, also an open-source software, helps in visualising the (Prometheus) data exposed into different visuals like graphs, histograms,tables etc. We use Grafana's dashboard to generate visuals and query the data. Grafana

what exactly are metrics ?

Metrics in simple terms are measurements. In tech-field this entity can be your application, hardware, power usage etc.

In MacOS open Activity monitor and for Windows open task-manager. The numbers you see in front of the list of every application are nothing but the metrics.

Note: In Prometheus and Grafana we consider only the Time Series database(TSDB) metrics.

Installation using docker

Prometheus:- docker run -p 9090:9090 prom/prometheus Grafana:-docker run -d -p 3000:3000 grafana/grafana-enterprise

Start server

Prometheus:- http://localhost:9090 Grafana:- http://localhost:3000

Note: If you have Docker Compose seperately installed, localhost or 127.0.0.1 probably won't work, instead use your machine's ip address.

Understanding metrics

Metrics are numeric measurements

Instrumenting code

In order for Prometheus to scrape metrics from a service, the service must satisfy the format and structure needed to export the metrics to prometheus. Prom drawio

Exporters

Exporters are binaries that acts as a middleware which converts the metrics exposed by any 3rd party application/software into a format that prometheus can understand and scrape through their metrics. Examples: NodeExporter, cAdvisor We can develop personalised exporters for our applications by following the guidelines and best practices documented...

Integrating metrics

blackbox metrics exporter

- job_name: 'blackbox'
    metrics_path: /metrics
    params:
      module: [http_2xx]  # Look for a HTTP 200 response.
    static_configs:
      - targets: # Target to probe with https.
        - http://*your_ip_address*:9115 # Target to probe with http on port 8080.
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: *your_ip_address*:9115  # The blackbox exporter's real hostname:port.

if config setup is succesful then all the metrics blackbox exporter has to offer will be hosted on http://localhost:9115

These are the metrics that are exported through blackbox to prometheus

Connecting Grafana with Prometheus

Configure the data-source of prometheus with the grafana service so that grafana can query the data from the local prometheus server.

Steps Create new data source under http url enter http://your_ip_address:9115 or http://localhost:9115 Save

Creating Dashboard to visualise metrics

Steps Step1: Open the port you've exposed grafana to