(DEPRECATED) Apache Flink User Mailing List archive.

Flink metrics scope for YARN single job

classic Classic list List threaded Threaded
♦
♦
 3 messages Options
Vasily Melnik
Reply | Threaded
Open this post in threaded view
♦
♦
|

Flink metrics scope for YARN single job

Vasily Melnik
Hi,
I want to run Flink apps on YARN in single job mode and keep metrics in Graphite. But as i see, the only variable i can use for JobManager scope customization is <host>:  https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#list-of-all-variables 
Is there any way to distinguish logs from different JobManager running on same host? 


Thanks in advance. 
Biao Liu
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink metrics scope for YARN single job

Biao Liu
Hi Vasily,

> Is there any way to distinguish logs from different JobManager running on same host? 

Do you mean "distinguish metrics from different JobManager running on same host"?
I guess there is no other variable you could use for now.

But I think it's reasonable to support this requirement. I would like to discuss with the devs to hear their opinions. Will give you a feedback if there is a conclusion.

Thanks,
Biao /'bɪ.aʊ/



On Wed, 14 Aug 2019 at 19:46, Vasily Melnik <[hidden email]> wrote:
Hi,
I want to run Flink apps on YARN in single job mode and keep metrics in Graphite. But as i see, the only variable i can use for JobManager scope customization is <host>:  https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#list-of-all-variables 
Is there any way to distinguish logs from different JobManager running on same host? 


Thanks in advance. 
Vasily Melnik
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink metrics scope for YARN single job

Vasily Melnik
Hi Biao!

>  Do you mean "distinguish metrics from different JobManager running on same host"?
Exactly.

>Will give you a feedback if there is a conclusion.
Thanks!



On Thu, 15 Aug 2019 at 06:40, Biao Liu <[hidden email]> wrote:
Hi Vasily,

> Is there any way to distinguish logs from different JobManager running on same host? 

Do you mean "distinguish metrics from different JobManager running on same host"?
I guess there is no other variable you could use for now.

But I think it's reasonable to support this requirement. I would like to discuss with the devs to hear their opinions. Will give you a feedback if there is a conclusion.

Thanks,
Biao /'bɪ.aʊ/



On Wed, 14 Aug 2019 at 19:46, Vasily Melnik <[hidden email]> wrote:
Hi,
I want to run Flink apps on YARN in single job mode and keep metrics in Graphite. But as i see, the only variable i can use for JobManager scope customization is <host>:  https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#list-of-all-variables 
Is there any way to distinguish logs from different JobManager running on same host? 


Thanks in advance. 
Free forum by Nabble Edit this page