Flink UI not responding on Yarn + Flink

[samar kumar]

Hi Users,

 I am currently trying to run flink with yarn. I have written a program which will launch flink jobs on yarn . It works perfectly fine with local yarn cluster . When I run it on a remote yarn cluster it does not work as expected. As I am reading and writing data from kafka , I do not see any data on the destination kafka topic. The yarn log goes print the transformation I want to apply. I am not able to debug the issue because there is no error in the yarn logs. Also the flink application UI seem to be blank , and does not give the usual flink job list. Please help me debug and fix the issue. 

Running Flink 1.3.2 with yarn 2.6

Thanks,

Samar

[Gary Yao-2]

Hi Samar,

Can you share the JobManager and TaskManager logs returned by:

  yarn logs -applicationId <ID>?

Is your browser rendering a blank page, or does the HTTP request not finish?

Can you show the output of one of the following commands:

  curl -v http://host:port

  curl -v http://host:port/jobs

Best,

Gary

On Wed, Mar 7, 2018 at 5:51 PM, samar kumar <[hidden email]> wrote:

Hi Users,

 I am currently trying to run flink with yarn. I have written a program which will launch flink jobs on yarn . It works perfectly fine with local yarn cluster . When I run it on a remote yarn cluster it does not work as expected. As I am reading and writing data from kafka , I do not see any data on the destination kafka topic. The yarn log goes print the transformation I want to apply. I am not able to debug the issue because there is no error in the yarn logs. Also the flink application UI seem to be blank , and does not give the usual flink job list. Please help me debug and fix the issue. 

Running Flink 1.3.2 with yarn 2.6

Thanks,

Samar