Apache Flink - Disabling system metrics and collecting only specific metrics

[M Singh]

Hi:

I am working on an application and need to collect application metrics. I would like to use Flink's metrics framework for my application metrics.  From Flink's documentation (https://ci.apache.org/projects/flink/flink-docs-release-1.8/monitoring/metrics.html#system-metrics), it looks like Flink collects system metrics by default but I don't need those.

Is there any way to configure metrics to 

1. disable system metrics collection, 

2. collect only specific metrics.

If there is any documentation/configuration that I might have missed, please let me know.

Thanks

Mans

[Zhijiang(wangzhijiang999)]

Hi Mans,

AFAIK, we have no switch to disable general system metrics which are useful for monitoring status and performance tuning. Only some advanced system metrics could be confgiured to enable or not, and the default config is always disabled, so you do not need toconcern them.

Maybe you could implement a custom MetricReporter, and then only consentrate on your required application metrics in the method of  `MetricReporter#notifyOfAddedMetric` to show them in backend.

Best,

Zhijiang

------------------------------------------------------------------

From:M Singh <[hidden email]>

Send Time:2019年6月12日(星期三) 00:30

To:User <[hidden email]>

Subject:Apache Flink - Disabling system metrics and collecting only specific metrics

Hi:

I am working on an application and need to collect application metrics. I would like to use Flink's metrics framework for my application metrics.  From Flink's documentation (https://ci.apache.org/projects/flink/flink-docs-release-1.8/monitoring/metrics.html#system-metrics), it looks like Flink collects system metrics by default but I don't need those.

Is there any way to configure metrics to 

1. disable system metrics collection, 

2. collect only specific metrics.

If there is any documentation/configuration that I might have missed, please let me know.

Thanks

Mans

[M Singh]

Thanks Zhijiang for your response.  

I see that system resources reporting can be enable (default not enabled) but not system metrics.  I just wanted to confirm that I am not missing anything.

Thanks again.

On Tuesday, June 11, 2019, 10:32:51 PM EDT, zhijiang <[hidden email]> wrote:

Hi Mans,

AFAIK, we have no switch to disable general system metrics which are useful for monitoring status and performance tuning. Only some advanced system metrics could be confgiured to enable or not, and the default config is always disabled, so you do not need toconcern them.

Maybe you could implement a custom MetricReporter, and then only consentrate on your required application metrics in the method of  `MetricReporter#notifyOfAddedMetric` to show them in backend.

Best,

Zhijiang

------------------------------------------------------------------

From:M Singh <[hidden email]>

Send Time:2019年6月12日(星期三) 00:30

To:User <[hidden email]>

Subject:Apache Flink - Disabling system metrics and collecting only specific metrics

Hi:

I am working on an application and need to collect application metrics. I would like to use Flink's metrics framework for my application metrics.  From Flink's documentation (https://ci.apache.org/projects/flink/flink-docs-release-1.8/monitoring/metrics.html#system-metrics), it looks like Flink collects system metrics by default but I don't need those.

Is there any way to configure metrics to 

1. disable system metrics collection, 

2. collect only specific metrics.

If there is any documentation/configuration that I might have missed, please let me know.

Thanks

Mans