Flink conf/flink-conf.yaml

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink conf/flink-conf.yaml

Vijayendra Yadav
Hi Team,

How can I override flink default conf/flink-conf.yaml from flink run command with custom alternative path.
Also, when we override flink-conf.yaml, should it contain all variables which are present in flink default conf/flink-conf.yaml or i can just override selective variables from user define flink-conf.yaml file ?

Regards,
Vijay
Reply | Threaded
Open this post in threaded view
|

Re: Flink conf/flink-conf.yaml

Yangze Guo
Hi,

> can I override flink default conf/flink-conf.yaml from flink run command
Yes, you could override it by manually exporting the env variable
FLINK_CONF_DIR.

> can just override selective variables from user define flink-conf.yaml file
No. You could use the default conf/flink-conf.yaml and override
variables by dynamic options(-Dxxx=xxx). Or just contain all the
necessary configuration in your custom flink-conf.yaml.

Best,
Yangze Guo

On Fri, Aug 7, 2020 at 4:02 AM Vijayendra Yadav <[hidden email]> wrote:
>
> Hi Team,
>
> How can I override flink default conf/flink-conf.yaml from flink run command with custom alternative path.
> Also, when we override flink-conf.yaml, should it contain all variables which are present in flink default conf/flink-conf.yaml or i can just override selective variables from user define flink-conf.yaml file ?
>
> Regards,
> Vijay
Reply | Threaded
Open this post in threaded view
|

Re: Flink conf/flink-conf.yaml

Vijayendra Yadav
Thank You Yangze.

Sent from my iPhone

> On Aug 6, 2020, at 7:27 PM, Yangze Guo <[hidden email]> wrote:
>
> Hi,
>
>> can I override flink default conf/flink-conf.yaml from flink run command
> Yes, you could override it by manually exporting the env variable
> FLINK_CONF_DIR.
>
>> can just override selective variables from user define flink-conf.yaml file
> No. You could use the default conf/flink-conf.yaml and override
> variables by dynamic options(-Dxxx=xxx). Or just contain all the
> necessary configuration in your custom flink-conf.yaml.
>
> Best,
> Yangze Guo
>
>> On Fri, Aug 7, 2020 at 4:02 AM Vijayendra Yadav <[hidden email]> wrote:
>>
>> Hi Team,
>>
>> How can I override flink default conf/flink-conf.yaml from flink run command with custom alternative path.
>> Also, when we override flink-conf.yaml, should it contain all variables which are present in flink default conf/flink-conf.yaml or i can just override selective variables from user define flink-conf.yaml file ?
>>
>> Regards,
>> Vijay