How to get Cluster metrics in FLIP-6 mode

[Tony Wei]

Hi,

I found that these metrics[1] disappeared in my JM's prometheus reporter when I used FLIP-6 to

 deploy standalone cluster. (flink 1.5.3 release)

Cluster

Scope	Metrics	Description	Type
JobManager	numRegisteredTaskManagers	The number of registered taskmanagers.	Gauge
	numRunningJobs	The number of running jobs.	Gauge
	taskSlotsAvailable	The number of available task slots.	Gauge
	taskSlotsTotal	The total number of task slots.	Gauge

I guessed maybe JM is no longer responsible to these metrics, but I still need these metrics on my

dashboard. Do anyone know how to let my metric reporter get these metrics? Or did I miss something?

Thank you.

Best Regards,

Tony Wei

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.6/monitoring/metrics.html#cluster

[Gary Yao-2]

Hi Tony,

You are right that these metrics are missing. There is already a ticket for
that [1]. At the moment you can obtain these information from the REST API
(/overview) [2].

Since FLIP-6, the JM is no longer responsible for these metrics but for
backwards compatibility we can leave them in the JM scope for now.

Best,
Gary


[1] https://issues.apache.org/jira/browse/FLINK-10135
[2] https://ci.apache.org/projects/flink/flink-docs-release-1.5/monitoring/rest_api.html#available-requests

On Tue, Sep 11, 2018 at 12:19 PM, Tony Wei <[hidden email]> wrote:

Hi,

I found that these metrics[1] disappeared in my JM's prometheus reporter when I used FLIP-6 to

 deploy standalone cluster. (flink 1.5.3 release)

Cluster

Scope	Metrics	Description	Type
JobManager	numRegisteredTaskManagers	The number of registered taskmanagers.	Gauge
	numRunningJobs	The number of running jobs.	Gauge
	taskSlotsAvailable	The number of available task slots.	Gauge
	taskSlotsTotal	The total number of task slots.	Gauge

I guessed maybe JM is no longer responsible to these metrics, but I still need these metrics on my

dashboard. Do anyone know how to let my metric reporter get these metrics? Or did I miss something?

Thank you.

Best Regards,

Tony Wei

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.6/monitoring/metrics.html#cluster

[Tony Wei]

Hi Gary,

Thanks for your information.

Best,

Tony Wei

2018-09-11 20:26 GMT+08:00 Gary Yao <[hidden email]>:

Hi Tony,

You are right that these metrics are missing. There is already a ticket for
that [1]. At the moment you can obtain these information from the REST API
(/overview) [2].

Since FLIP-6, the JM is no longer responsible for these metrics but for
backwards compatibility we can leave them in the JM scope for now.

Best,
Gary


[1] https://issues.apache.org/jira/browse/FLINK-10135
[2] https://ci.apache.org/projects/flink/flink-docs-release-1.5/monitoring/rest_api.html#available-requests

On Tue, Sep 11, 2018 at 12:19 PM, Tony Wei <[hidden email]> wrote:

Hi,

I found that these metrics[1] disappeared in my JM's prometheus reporter when I used FLIP-6 to

 deploy standalone cluster. (flink 1.5.3 release)

Cluster

Scope	Metrics	Description	Type
JobManager	numRegisteredTaskManagers	The number of registered taskmanagers.	Gauge
	numRunningJobs	The number of running jobs.	Gauge
	taskSlotsAvailable	The number of available task slots.	Gauge
	taskSlotsTotal	The total number of task slots.	Gauge

I guessed maybe JM is no longer responsible to these metrics, but I still need these metrics on my

dashboard. Do anyone know how to let my metric reporter get these metrics? Or did I miss something?

Thank you.

Best Regards,

Tony Wei

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.6/monitoring/metrics.html#cluster