Flink on YARN || Monitoring REST API Not Working || Please help

[Raja.Aravapalli]

Hi,

 

I have deployed Flink cluster on Hadoop YARN and I am able to trigger jobs and run it.

 

But, I am not able to work the running flink cluster’s Montoring REST API!

 

As listed here @ https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/rest_api.html I am trying to connect using url http://hostname:8081/jobs where hostname is jobmanager host.

 

Could n’t find, how to fix this.

 

Can someone please share your thoughts.

 

 

Thanks a lot.

 

 

Regards,

Raja.

 

 

 

 

 

[Jins George]

8081 is the default port for standalone cluster.

For Yarn flink cluster,

Go to the Running applications and from the list of applications. 

 You can get the Flink UI by clicking Application master link for the yarn session.

Regards,

Jins

On Feb 1, 2018, at 8:06 AM, Raja.Aravapalli <[hidden email]> wrote:

Hi,

 

I have deployed Flink cluster on Hadoop YARN and I am able to trigger jobs and run it.

 

But, I am not able to work the running flink cluster’s Montoring REST API!

 

As listed here @ https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/rest_api.html I am trying to connect using url http://hostname:8081/jobs where hostname is jobmanager host.

 

Could n’t find, how to fix this.

 

Can someone please share your thoughts.

 

 

Thanks a lot.

 

 

Regards,

Raja.

 

 

 

 

 

[Raja.Aravapalli]

 

Thanks a lot for the response Jins.

 

Still I couldn’t figure out what is wrong. I am able access flink job manager ui from running application on YARN. But, I want to use Monitoring thru REST Api, which I could not figure out ☹

 

Some more details FYR:

 

Below is what I receive when I submit jobs to running flink on YARN cluster:

 

Cluster configuration: Standalone cluster with JobManager at xxxxx.xxxx.com/11.11.11.111:34651
Using address xxxxx.xxxx.com:34651 to connect to JobManager.
JobManager web interface address http://xxxxx.xxx.com:8081

 

 

Any thoughts, what I am missing would be highly helpful.

 

Thanks.

 

Regards,

Raja.

 

From: Jins George <[hidden email]>
Date: Wednesday, January 31, 2018 at 8:51 PM
To: Raja Aravapalli <[hidden email]>
Cc: "[hidden email]" <[hidden email]>
Subject: [EXTERNAL] Re: Flink on YARN || Monitoring REST API Not Working || Please help

 

8081 is the default port for standalone cluster.

 

For Yarn flink cluster,

Go to the Running applications and from the list of applications. 

 You can get the Flink UI by clicking Application master link for the yarn session.

 

Regards,

Jins

On Feb 1, 2018, at 8:06 AM, Raja.Aravapalli <[hidden email]> wrote:

Hi,

 

I have deployed Flink cluster on Hadoop YARN and I am able to trigger jobs and run it.

 

But, I am not able to work the running flink cluster’s Montoring REST API!

 

As listed here @ https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/rest_api.html I am trying to connect using url http://hostname:8081/jobs where hostname is jobmanager host.

 

Could n’t find, how to fix this.

 

Can someone please share your thoughts.

 

 

Thanks a lot.

 

 

Regards,

Raja.