Flink Promethues Metricsreporter Question

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink Promethues Metricsreporter Question

Avijit Saha
Hi,

Have a general question about Flink support for Prometheus metrics. We already have a Prometheus setup in our cluster with ServiceMonitor-s monitoring ports like 8080 etc. for scraping metrics.

In a setup like this, if we deploy Flink Job managers/Task managers in the cluster, is there any need to have the PrometheusReporter configured as well? How does that coordinate with existing Prometheus ServiceMonitors if present?

Is the  PrometheusReporter based on "pull" model so that it can pull metrics from Flink and send to some Prometheus host system?

Thanks
Avijit
Reply | Threaded
Open this post in threaded view
|

Re: Flink Promethues Metricsreporter Question

Chesnay Schepler
The PrometheusReporter acts as a scraping target for a single process.
If you already have setup something in the Flink cluster that allows
Prometheus/ServiceMonitor to scrape (Flink) metrics, then it shouldn't
be necessary.
It doesn't coordinate with other services in any way; it just has access
to Flink metrics and waits for someone to scrape them.

On 05/08/2020 23:28, Avijit Saha wrote:

> Hi,
>
> Have a general question about Flink support for Prometheus metrics. We
> already have a Prometheus setup in our cluster with ServiceMonitor-s
> monitoring ports like 8080 etc. for scraping metrics.
>
> In a setup like this, if we deploy Flink Job managers/Task managers in
> the cluster, is there any need to have the PrometheusReporter
> configured as well? How does that coordinate with existing
> Prometheus ServiceMonitors if present?
>
> Is the PrometheusReporter based on "pull" model so that it can pull
> metrics from Flink and send to some Prometheus host system?
>
> Thanks
> Avijit