Loading... |
Reply to author |
Edit post |
Move post |
Delete this post |
Delete this post and replies |
Change post date |
Print post |
Permalink |
Raw mail |
Hi there, I am trying to run a single flink job on YARN in detached mode. as per the docs for flink 1.4.2, I am using -yd to do that. The
problem I am having is the flink bash script doesn't terminate
execution and return until I press control + c. In detached mode, I
would expect the flink CLI to return as soon as yarn job is submitted.
is there something I am missing? here is exact output I get -
... [show rest of quote] I have to press cntrl + c to kill this shell script. When I do that, the program prints messages below -
Thanks, Madhav. |
Loading... |
Reply to author |
Edit post |
Move post |
Delete this post |
Delete this post and replies |
Change post date |
Print post |
Permalink |
Raw mail |
Hi, Madhav, ./flink-1.4.2/bin/flink run -m yarn-cluster -yd -yn 2 -yqu "default" -ytm 2048 myjar.jar Modified to, ./flink-1.4.2/bin/flink run -m yarn-cluster -d -yn 2 -yqu "default" -ytm 2048 myjar.jar ![]() madhav Kelkar <[hidden email]> 于2018年8月16日周四 上午5:01写道:
... [show rest of quote] |
Loading... |
Reply to author |
Edit post |
Move post |
Delete this post |
Delete this post and replies |
Change post date |
Print post |
Permalink |
Raw mail |
Hi Marvin777, You are wrong. It uses the Flink on YARN single job mode and should use the "-yd" parameter. Hi Madhav, I seem to have found the problem, the source code of your log is here.[1] It is based on a judgment method "isUsingInteractiveMode". The source code for this method is here[2], returning true when "program" is null. And when is this field null? it's here.[3] So, from the source code point of view, I suggest you explicitly specify the class in which the Main method is located in the CLI args. Thanks, vino. Marvin777 <[hidden email]> 于2018年8月16日周四 上午11:00写道:
... [show rest of quote] |
Loading... |
Reply to author |
Edit post |
Move post |
Delete this post |
Delete this post and replies |
Change post date |
Print post |
Permalink |
Raw mail |
Hi Vino,
We should not have to specify class name using -c option to run job in detached mode. I tried that this morning but it also didn't work. flink CLI always starts in interactive mode, and somehow ignores option -yd specified in yarn-cluster mode. Can someone verify this please? If its the case, its a bug in flink CLI. I have an ugly workaround where I start flink CLI in background, and I would like to avoid doing that. Thanks, Madhav. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ |
Loading... |
Reply to author |
Edit post |
Move post |
Delete this post |
Delete this post and replies |
Change post date |
Print post |
Permalink |
Raw mail |
Hi Madhav, Can you set the log level to DEBUG in the log4j-client configuration file? Then post the log. I can try to locate it through the log. Thanks, vino. makelkar <[hidden email]> 于2018年8月17日周五 上午1:27写道: Hi Vino, ... [show rest of quote] |
Free forum by Nabble | Edit this page |