A query on Flink metrics in kubernetes

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

A query on Flink metrics in kubernetes

Manish G
Hi,

I have a query regarding prometheus scraping Flink metrics data with application running in kubernetes cluster.

If taskmanager is running on multiple nodes, and prometheus requests for the metrics data, then is that request directed to one of the nodes(based on some strategy, like round-robin) or is data aggregated from all the nodes?

With regards

Reply | Threaded
Open this post in threaded view
|

Re: A query on Flink metrics in kubernetes

Chesnay Schepler
 From Flink's perspective no metrics are aggregated, nor are metric
requests forwarded to some other process.

Each TaskExecutor has its own reporter, that each must be scraped to get
the full set of metrics.

On 09/07/2020 11:39, Manish G wrote:

> Hi,
>
> I have a query regarding prometheus scraping Flink metrics data with
> application running in kubernetes cluster.
>
> If taskmanager is running on multiple nodes, and prometheus requests
> for the metrics data, then is that request directed to one of the
> nodes(based on some strategy, like round-robin) or is data aggregated
> from all the nodes?
>
> With regards
>