|
|
Hi Vitaliy,
in the case of a session cluster you cannot influence the queue programmatically since Flink uses the value configured via yarn.application.queue which is read from the flink-conf.yaml.
However, there is a way to influence the yarn queue programmatically if you use the per job mode. What you need to do is to create a StreamExecutionEnvironment manually by passing a Configuration instance. In this configuration instance you can set the respective configuration key to the desired yarn queue value. Please be aware that with this approach, you won't load Flink's global configuration specified in flink-conf.yaml.
Cheers, Till Do you mean in the job java code, where you call “env.execute()”? I don't think so. The yarn queue is a Flink cluster level configuration, and I don't think you can change the cluster level configurations in your job code. You job might even be created after the cluster is started, e.g., in a Flink YARN Session.[1]
On Thu, Mar 12, 2020 at 6:20 PM Vitaliy Semochkin < [hidden email]> wrote: Thank you Xintong Song,
is there any way to queue programmatically, i.e. via java code?
Regards, Vitaliy
Hi Vitaliy,
You can specify a yarn queue by either setting the configuration option 'yarn.application.queue' [1], or using the command line option '-qu' (or '--queue') [2].
On Thu, Mar 12, 2020 at 3:56 AM Vitaliy Semochkin < [hidden email]> wrote: Hi,
How can I specify a yarn queue when I start a new job programmatically?
Regards, Vitaliy
|
Locked
