Question regarding check memory and CPU used for job

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Question regarding check memory and CPU used for job

Claire Yuan
Hi all,
  I am currently running a flink session on YARN and try to access the counter to get the infomation for CPU and memory used for my job. However, flink job does not look like other mapReduce job shown on YARN thus I cannot find the counter infos for it.
  Is there any way I can find those usage data?

Claire
Reply | Threaded
Open this post in threaded view
|

Re: Question regarding check memory and CPU used for job

Aljoscha Krettek
Hi,

This might be a bit late but I think you can only get that data from the Flink web dashboard or by manually checking on the machines.

Best,
Aljoscha

On 14. Jul 2017, at 20:16, Claire Yuan <[hidden email]> wrote:

Hi all,
  I am currently running a flink session on YARN and try to access the counter to get the infomation for CPU and memory used for my job. However, flink job does not look like other mapReduce job shown on YARN thus I cannot find the counter infos for it.
  Is there any way I can find those usage data?

Claire