Configure Prometheus Exporter

[Chaoran Yu]

Hello guys,

   Does anyone know if the Prometheus metrics exported via the JMX reporter or the Prometheus reporter can be configured using a YAML file similar to this one? If there is such support in Flink, how do I tell Flink the path to my YAML configuration file (e.g. maybe through a setting in flink-conf)?

Thanks,

Chaoran

[Chesnay Schepler]

This is not possible. Are you trying to limit which metrics are exposed?

On 07/08/2019 06:52, Chaoran Yu wrote:

Hello guys,

   Does anyone know if the Prometheus metrics exported via the JMX reporter or the Prometheus reporter can be configured using a YAML file similar to this one? If there is such support in Flink, how do I tell Flink the path to my YAML configuration file (e.g. maybe through a setting in flink-conf)?

Thanks,

Chaoran

[Chaoran Yu]

Thanks for the reply. Yes. That’s what I’m trying to do. I think Flink by default exports all metrics. Is there anything else I can do to achieve this goal?

On Aug 7, 2019, at 03:58, Chesnay Schepler <[hidden email]> wrote:

This is not possible. Are you trying to limit which metrics are exposed?

On 07/08/2019 06:52, Chaoran Yu wrote:

Hello guys,

   Does anyone know if the Prometheus metrics exported via the JMX reporter or the Prometheus reporter can be configured using a YAML file similar to this one? If there is such support in Flink, how do I tell Flink the path to my YAML configuration file (e.g. maybe through a setting in flink-conf)?

Thanks,

Chaoran

[Chesnay Schepler]

The only thing you can do at the moment, to limit which metrics are exposed, is to implement your own MetricsReporter. You could extend the prometheus one, and introduce any rules you want into notifyOfAddedMetric().

On 07/08/2019 14:42, Chaoran Yu wrote:

Thanks for the reply. Yes. That’s what I’m trying to do. I think Flink by default exports all metrics. Is there anything else I can do to achieve this goal?

On Aug 7, 2019, at 03:58, Chesnay Schepler <[hidden email]> wrote:

This is not possible. Are you trying to limit which metrics are exposed?

On 07/08/2019 06:52, Chaoran Yu wrote:

Hello guys,

   Does anyone know if the Prometheus metrics exported via the JMX reporter or the Prometheus reporter can be configured using a YAML file similar to this one? If there is such support in Flink, how do I tell Flink the path to my YAML configuration file (e.g. maybe through a setting in flink-conf)?

Thanks,

Chaoran

... [show rest of quote]

[Chaoran Yu]

Got it. I’ll look into this option. Thanks!

On Aug 7, 2019, at 08:46, Chesnay Schepler <[hidden email]> wrote:

The only thing you can do at the moment, to limit which metrics are exposed, is to implement your own MetricsReporter. You could extend the prometheus one, and introduce any rules you want into notifyOfAddedMetric().