Flink cluster security conf.: keberos.keytab add to run yarn-cluster

[Marke Builder]

Hi,

So far I have added my keytab and principal in the  flink-conf.yaml:

security.kerberos.login.keytab:

security.kerberos.login.principal:

But is there a way that I can add this to the "start script" -> run yarn-cluster .....

Thanks!  

[Shuyi Chen]

Do you mean have these two options as the command line options? If so, AFAIK, I dont think it's supported now. What do you need it? Thanks.

On Wed, Oct 31, 2018 at 11:43 AM Marke Builder <[hidden email]> wrote:

Hi,

So far I have added my keytab and principal in the  flink-conf.yaml:

security.kerberos.login.keytab:

security.kerberos.login.principal:

But is there a way that I can add this to the "start script" -> run yarn-cluster .....

Thanks!  

--

[Dawid Wysakowicz-2]

Hi Marke,

AFAIK Shuyi is right, there is no such option so far. Maybe you could do though is to extend the "flink" script to substitute those parameters in the file on each run, but I think it is a common practice to run flink jobs on yarn from a single service user.

On 31/10/2018 19:52, Shuyi Chen wrote:

Do you mean have these two options as the command line options? If so, AFAIK, I dont think it's supported now. What do you need it? Thanks.

On Wed, Oct 31, 2018 at 11:43 AM Marke Builder <[hidden email]> wrote:

Hi,

So far I have added my keytab and principal in the  flink-conf.yaml:

security.kerberos.login.keytab:

security.kerberos.login.principal:

But is there a way that I can add this to the "start script" -> run yarn-cluster .....

Thanks!  

--

[Paul Lam]

Hi,

Wouldn't `-yD` option do the trick? I use it to override the kerberos configuration for different users very often.

Best,

Paul Lam

在 2018年11月8日，17:33，Dawid Wysakowicz <[hidden email]> 写道：

Hi Marke,

AFAIK Shuyi is right, there is no such option so far. Maybe you could do though is to extend the "flink" script to substitute those parameters in the file on each run, but I think it is a common practice to run flink jobs on yarn from a single service user.

On 31/10/2018 19:52, Shuyi Chen wrote:

Do you mean have these two options as the command line options? If so, AFAIK, I dont think it's supported now. What do you need it? Thanks.

On Wed, Oct 31, 2018 at 11:43 AM Marke Builder <[hidden email]> wrote:

Hi,

So far I have added my keytab and principal in the  flink-conf.yaml:

security.kerberos.login.keytab:

security.kerberos.login.principal:

But is there a way that I can add this to the "start script" -> run yarn-cluster .....

Thanks!  

--