re： Does Flink cluster security works in Flink 1.1.4 release?

[Zhangrucong]

Hi Stephan:

          Thanks for your reply.

You mean the CLI、JM、TM、WebUI  have supported Kerberos authentication only in yarn cluster model in 1.1.x release？

 

发件人: Stephan Ewen [[hidden email]]
发送时间: 2017年1月4日 17:23
收件人: [hidden email]
主题: Re: Does Flink cluster security works in Flink 1.1.4 release?

 

Hi!

 

Flink 1.1.x supports Kerberos for Hadoop (HDFS, YARN, HBase) via Hadoop's ticket system. It should work via kinit, in the same way when submitting a secure MapReduce job.

 

Kerberos for ZooKeeper, Kafka, etc, is only part of the 1.2 release.

 

Greetings,

Stephan

 

 

On Wed, Jan 4, 2017 at 7:25 AM, Zhangrucong <[hidden email]> wrote:

Hi:

     Now I use Flink 1.1.4 release in standalone cluster model. I want to do the Kerberos authentication between Flink CLI and the Jobmanager. But in the flink-conf.yaml, there is no Flink cluster security configuration.

Does the Kerberos authentication works in Flink 1.1.4 release?

Thanks in advance!

 

 

[Stephan Ewen]

I think you can also use Kerberos in the standalone mode in 1.1.x, but is is more tricky - you need do a "kinit" on every host where you launch a Flink process.

Flink 1.2 has better Kerberos support.

On Fri, Jan 6, 2017 at 4:19 AM, Zhangrucong <[hidden email]> wrote:

Hi Stephan:

          Thanks for your reply.

You mean the CLI、JM、TM、WebUI  have supported Kerberos authentication only in yarn cluster model in 1.1.x release？

 

发件人: Stephan Ewen [[hidden email]]
发送时间: 2017年1月4日 17:23
收件人: [hidden email]
主题: Re: Does Flink cluster security works in Flink 1.1.4 release?

 

Hi!

 

Flink 1.1.x supports Kerberos for Hadoop (HDFS, YARN, HBase) via Hadoop's ticket system. It should work via kinit, in the same way when submitting a secure MapReduce job.

 

Kerberos for ZooKeeper, Kafka, etc, is only part of the 1.2 release.

 

Greetings,

Stephan

 

 

On Wed, Jan 4, 2017 at 7:25 AM, Zhangrucong <[hidden email]> wrote:

Hi:

     Now I use Flink 1.1.4 release in standalone cluster model. I want to do the Kerberos authentication between Flink CLI and the Jobmanager. But in the flink-conf.yaml, there is no Flink cluster security configuration.

Does the Kerberos authentication works in Flink 1.1.4 release?

Thanks in advance!

 

 

[Zhangrucong]

Hi Stephan:

                     Thanks for your reply. I think in standalone mode, the Kerberos authentication should not depend on Hadoop. What about your opinion?

                     By the way, when the Flink 1.2.0 come up?

 

                   Thanks in advance!

 

发件人: Stephan Ewen [[hidden email]]
发送时间: 2017年1月6日 18:04
收件人: [hidden email]
抄送: Zhangrucong; Robert Metzger
主题: Re: Does Flink cluster security works in Flink 1.1.4 release?

 

I think you can also use Kerberos in the standalone mode in 1.1.x, but is is more tricky - you need do a "kinit" on every host where you launch a Flink process.

 

Flink 1.2 has better Kerberos support.

 

On Fri, Jan 6, 2017 at 4:19 AM, Zhangrucong <[hidden email]> wrote:

Hi Stephan:

          Thanks for your reply.

You mean the CLI、JM、TM、WebUI  have supported Kerberos authentication only in yarn cluster model in 1.1.x release？

 

发件人: Stephan Ewen [[hidden email]]
发送时间: 2017年1月4日 17:23
收件人: [hidden email]
主题: Re: Does Flink cluster security works in Flink 1.1.4 release?

 

Hi!

 

Flink 1.1.x supports Kerberos for Hadoop (HDFS, YARN, HBase) via Hadoop's ticket system. It should work via kinit, in the same way when submitting a secure MapReduce job.

 

Kerberos for ZooKeeper, Kafka, etc, is only part of the 1.2 release.

 

Greetings,

Stephan

 

 

On Wed, Jan 4, 2017 at 7:25 AM, Zhangrucong <[hidden email]> wrote:

Hi:

     Now I use Flink 1.1.4 release in standalone cluster model. I want to do the Kerberos authentication between Flink CLI and the Jobmanager. But in the flink-conf.yaml, there is no Flink cluster security configuration.

Does the Kerberos authentication works in Flink 1.1.4 release?

Thanks in advance!