Re: set flink yarn jvm options

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: set flink yarn jvm options

vprabhu@gmail.com
The docs mention that

env.java.opts.jobmanager
env.java.opts.taskmanager

parameters are available but are ignored by the yarn client, is there a way to set the jvm opts for yarn ?

Thanks,
Prabhu

On Wed, Aug 3, 2016 at 7:03 PM, Prabhu V <[hidden email]> wrote:
Hi,

Is there a way to set jvm options on the yarn application-manager and task-manager with flink ?

Thanks,
Prabhu

Reply | Threaded
Open this post in threaded view
|

Re: set flink yarn jvm options

Jamie Grier
Use env.java.opts

This will be respected by the YARN client.



On Thu, Aug 4, 2016 at 11:10 AM, Prabhu V <[hidden email]> wrote:
The docs mention that

env.java.opts.jobmanager
env.java.opts.taskmanager

parameters are available but are ignored by the yarn client, is there a way to set the jvm opts for yarn ?

Thanks,
Prabhu

On Wed, Aug 3, 2016 at 7:03 PM, Prabhu V <[hidden email]> wrote:
Hi,

Is there a way to set jvm options on the yarn application-manager and task-manager with flink ?

Thanks,
Prabhu




--

Jamie Grier
data Artisans, Director of Applications Engineering

Reply | Threaded
Open this post in threaded view
|

Re: set flink yarn jvm options

vprabhu@gmail.com

This property i believe affects only the yarn client. I want to set jvm opts on application-manager and task-manager containers.

Thanks,
Prabhu

On Thu, Aug 4, 2016 at 3:07 PM, Jamie Grier <[hidden email]> wrote:
Use env.java.opts

This will be respected by the YARN client.



On Thu, Aug 4, 2016 at 11:10 AM, Prabhu V <[hidden email]> wrote:
The docs mention that

env.java.opts.jobmanager
env.java.opts.taskmanager

parameters are available but are ignored by the yarn client, is there a way to set the jvm opts for yarn ?

Thanks,
Prabhu

On Wed, Aug 3, 2016 at 7:03 PM, Prabhu V <[hidden email]> wrote:
Hi,

Is there a way to set jvm options on the yarn application-manager and task-manager with flink ?

Thanks,
Prabhu




--

Jamie Grier
data Artisans, Director of Applications Engineering


Reply | Threaded
Open this post in threaded view
|

Re: set flink yarn jvm options

Jamie Grier
The YARN client should pass these JVM options along to each of the launched containers.  Have you tried this?

On Thu, Aug 4, 2016 at 4:07 PM, Prabhu V <[hidden email]> wrote:

This property i believe affects only the yarn client. I want to set jvm opts on application-manager and task-manager containers.

Thanks,
Prabhu

On Thu, Aug 4, 2016 at 3:07 PM, Jamie Grier <[hidden email]> wrote:
Use env.java.opts

This will be respected by the YARN client.



On Thu, Aug 4, 2016 at 11:10 AM, Prabhu V <[hidden email]> wrote:
The docs mention that

env.java.opts.jobmanager
env.java.opts.taskmanager

parameters are available but are ignored by the yarn client, is there a way to set the jvm opts for yarn ?

Thanks,
Prabhu

On Wed, Aug 3, 2016 at 7:03 PM, Prabhu V <[hidden email]> wrote:
Hi,

Is there a way to set jvm options on the yarn application-manager and task-manager with flink ?

Thanks,
Prabhu




--

Jamie Grier
data Artisans, Director of Applications Engineering





--

Jamie Grier
data Artisans, Director of Applications Engineering

Reply | Threaded
Open this post in threaded view
|

Re: set flink yarn jvm options

vprabhu@gmail.com
Thanks much Jamie,

This works just like you mentioned. Sorry my bad, i was mistaken with this parameter.



On Thu, Aug 4, 2016 at 4:39 PM, Jamie Grier <[hidden email]> wrote:
The YARN client should pass these JVM options along to each of the launched containers.  Have you tried this?

On Thu, Aug 4, 2016 at 4:07 PM, Prabhu V <[hidden email]> wrote:

This property i believe affects only the yarn client. I want to set jvm opts on application-manager and task-manager containers.

Thanks,
Prabhu

On Thu, Aug 4, 2016 at 3:07 PM, Jamie Grier <[hidden email]> wrote:
Use env.java.opts

This will be respected by the YARN client.



On Thu, Aug 4, 2016 at 11:10 AM, Prabhu V <[hidden email]> wrote:
The docs mention that

env.java.opts.jobmanager
env.java.opts.taskmanager

parameters are available but are ignored by the yarn client, is there a way to set the jvm opts for yarn ?

Thanks,
Prabhu

On Wed, Aug 3, 2016 at 7:03 PM, Prabhu V <[hidden email]> wrote:
Hi,

Is there a way to set jvm options on the yarn application-manager and task-manager with flink ?

Thanks,
Prabhu




--

Jamie Grier
data Artisans, Director of Applications Engineering





--

Jamie Grier
data Artisans, Director of Applications Engineering