Flink-HBase connectivity through Kerberos keytab | Simple get/put sample implementation

[Anchit Jatana]

Hi All,

I'm trying to link my flink application with HBase for simple read/write operations. I need to implement Flink to HBase the connectivity through Kerberos using the keytab.

Can somebody share(or link me to some resource) a sample code/implementation on how to achieve Flink to HBase connectivity through Kerberos using keytab for simple read/write (get/put) operation.

Thank you!

Regards,

Anchit

[Fabian Hueske-2]

Hi Anchit,

Flink does not yet have a streaming sink connector for HBase. Some members of the community are working on this though [1].

I think we resolved a similar issue for the Kafka connector recently [2].
Maybe the related commits contain some relevant code for your problem.

Best, Fabian

[1] https://github.com/apache/flink/pull/2332
[2] https://issues.apache.org/jira/browse/FLINK-3239

2016-09-29 9:12 GMT+02:00 Anchit Jatana <[hidden email]>:

Hi All,

I'm trying to link my flink application with HBase for simple read/write operations. I need to implement Flink to HBase the connectivity through Kerberos using the keytab.

Can somebody share(or link me to some resource) a sample code/implementation on how to achieve Flink to HBase connectivity through Kerberos using keytab for simple read/write (get/put) operation.

Thank you!

Regards,

Anchit

[Anchit Jatana]

Hi Fabian,

Right, I hope the committers take into account the kerberised access as well. Thanks for the update!

Regards,

Anchit

On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske <[hidden email]> wrote:

Hi Anchit,

Flink does not yet have a streaming sink connector for HBase. Some members of the community are working on this though [1].

I think we resolved a similar issue for the Kafka connector recently [2].
Maybe the related commits contain some relevant code for your problem.

Best, Fabian

[1] https://github.com/apache/flink/pull/2332
[2] https://issues.apache.org/jira/browse/FLINK-3239

2016-09-29 9:12 GMT+02:00 Anchit Jatana <[hidden email]>:

Hi All,

I'm trying to link my flink application with HBase for simple read/write operations. I need to implement Flink to HBase the connectivity through Kerberos using the keytab.

Can somebody share(or link me to some resource) a sample code/implementation on how to achieve Flink to HBase connectivity through Kerberos using keytab for simple read/write (get/put) operation.

Thank you!

Regards,

Anchit

[Stephan Ewen]

Hi!

In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's mechanism: https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#kerberos

In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context, from which HBase can probably pick it up. This is quite new, I'll let others chime in to add some more details.

@Max / @

On Thu, Sep 29, 2016 at 7:20 PM, Anchit Jatana <[hidden email]> wrote:

Hi Fabian,

Right, I hope the committers take into account the kerberised access as well. Thanks for the update!

Regards,

Anchit

On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske <[hidden email]> wrote:

Hi Anchit,

Flink does not yet have a streaming sink connector for HBase. Some members of the community are working on this though [1].

I think we resolved a similar issue for the Kafka connector recently [2].
Maybe the related commits contain some relevant code for your problem.

Best, Fabian

[1] https://github.com/apache/flink/pull/2332
[2] https://issues.apache.org/jira/browse/FLINK-3239

2016-09-29 9:12 GMT+02:00 Anchit Jatana <[hidden email]>:

Hi All,

I'm trying to link my flink application with HBase for simple read/write operations. I need to implement Flink to HBase the connectivity through Kerberos using the keytab.

Can somebody share(or link me to some resource) a sample code/implementation on how to achieve Flink to HBase connectivity through Kerberos using keytab for simple read/write (get/put) operation.

Thank you!

Regards,

Anchit

[Stephan Ewen]

Hi!

In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's mechanism: https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#kerberos

In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context, from which HBase can probably pick it up. This is quite new (docs are not yet updated), I'll let others chime in to add some more details.

@Max / @Vijay do you have any details?

Stephan

On Thu, Sep 29, 2016 at 7:47 PM, Stephan Ewen <[hidden email]> wrote:

Hi!

In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's mechanism: https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#kerberos

In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context, from which HBase can probably pick it up. This is quite new, I'll let others chime in to add some more details.

@Max / @

On Thu, Sep 29, 2016 at 7:20 PM, Anchit Jatana <[hidden email]> wrote:

Hi Fabian,

Right, I hope the committers take into account the kerberised access as well. Thanks for the update!

Regards,

Anchit

On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske <[hidden email]> wrote:

Hi Anchit,

Flink does not yet have a streaming sink connector for HBase. Some members of the community are working on this though [1].

I think we resolved a similar issue for the Kafka connector recently [2].
Maybe the related commits contain some relevant code for your problem.

Best, Fabian

[1] https://github.com/apache/flink/pull/2332
[2] https://issues.apache.org/jira/browse/FLINK-3239

2016-09-29 9:12 GMT+02:00 Anchit Jatana <[hidden email]>:

Hi All,

I'm trying to link my flink application with HBase for simple read/write operations. I need to implement Flink to HBase the connectivity through Kerberos using the keytab.

Can somebody share(or link me to some resource) a sample code/implementation on how to achieve Flink to HBase connectivity through Kerberos using keytab for simple read/write (get/put) operation.

Thank you!

Regards,

Anchit