Overwrite environment variables in single-job deployment on YARN

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Overwrite environment variables in single-job deployment on YARN

Mariusz Wojakowski
Hi,

I want to run Flink job on YARN and I need to overwrite JAVA_HOME on Task Managers. In multi-job mode I can do it by passing parameter when starting cluster: 

./yarn-session.sh -D yarn.taskamanager.env.JAVA_HOME=“/opt/jre1.8.0”

I want to overwrite this variable in single-job deployment, but it doesn’t work - TM’s JAVA_HOME is unchanged.
Maybe I’m missing something - could you give me some advice how to do that?


Thanks!
Mariusz
Reply | Threaded
Open this post in threaded view
|

Re: Overwrite environment variables in single-job deployment on YARN

Aljoscha Krettek
Hi,

Have you tried 

./bin/flink run -m yarn-cluster -yD yarn.taskmanager.env.JAVA_HOME=“/opt/jre1.8.0”

-yD can be used to dynamically specify settings.

Best,
Aljoscha
On 11. Aug 2017, at 13:20, Mariusz Wojakowski <[hidden email]> wrote:

Hi,

I want to run Flink job on YARN and I need to overwrite JAVA_HOME on Task Managers. In multi-job mode I can do it by passing parameter when starting cluster: 

./yarn-session.sh -D yarn.taskamanager.env.JAVA_HOME=“/opt/jre1.8.0”

I want to overwrite this variable in single-job deployment, but it doesn’t work - TM’s JAVA_HOME is unchanged.
Maybe I’m missing something - could you give me some advice how to do that?


Thanks!
Mariusz

Reply | Threaded
Open this post in threaded view
|

Re: Overwrite environment variables in single-job deployment on YARN

Mariusz Wojakowski
Thanks! It works :)

I’ve tried that but I’ve also misspelled ’taskmanager’… 

Sorry & thanks one more time!
Mariusz
On 11 Aug 2017, at 14:28, Aljoscha Krettek <[hidden email]> wrote:

Hi,

Have you tried 

./bin/flink run -m yarn-cluster -yD yarn.taskmanager.env.JAVA_HOME=“/opt/jre1.8.0”

-yD can be used to dynamically specify settings.

Best,
Aljoscha
On 11. Aug 2017, at 13:20, Mariusz Wojakowski <[hidden email]> wrote:

Hi,

I want to run Flink job on YARN and I need to overwrite JAVA_HOME on Task Managers. In multi-job mode I can do it by passing parameter when starting cluster: 

./yarn-session.sh -D yarn.taskamanager.env.JAVA_HOME=“/opt/jre1.8.0”

I want to overwrite this variable in single-job deployment, but it doesn’t work - TM’s JAVA_HOME is unchanged.
Maybe I’m missing something - could you give me some advice how to do that?


Thanks!
Mariusz