Tag flink metrics to job name

Posted by bat man on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Tag-flink-metrics-to-job-name-tp41533.html

Hello there,

I am using prometheus to push metrics to prometheus and then use grafana for visualization. There are metrics like - flink_taskmanager_Status_JVM_CPU_Load, flink_taskmanager_Status_JVM_CPU_Load, flink_taskmanager_Status_JVM_CPU_Time etc which do not gives job_name. It is tied to an instance.

When running multiple jobs in the same yarn cluster it is possible that different jobs have yarn containers on the same instance, in this case it is very difficult to find out which instance has high CPU load, Memory usage etc.

Is there a way to tag job_name to these metrics so that the metrics could be visualized per job. 

Thanks,

Hemant