Data Transfer between TM should be encrypted
Locked
Data Transfer between TM should be encrypted
 
|
Hi Ufuk,
This is regarding this issue How can we achieve this, I am able to decrypt the data from Kafka coming in, but I want to make sure that the data is encrypted when flowing between TM's. One approach I can think of is to decrypt the data at the start of each operator and encrypt it at the end of each operator, but I feel this is not an efficient approach. I just want to check if there are alternatives to this and can this be achieved by doing some configurations. Regards, Vinay Patil |
Re: Data Transfer between TM should be encrypted
|
|
Hi! The way that the JIRA issue you linked will achieve this is by hooking into the network stream pipeline directly, and encrypt the raw network byte stream. We built the network stack on Netty, and will use Netty's SSL/TLS handlers for that. That should be much more efficient than manual encryption/decryption in each user function. Stephan On Mon, Aug 29, 2016 at 6:12 PM, vinay patil <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Hi Stephan, Thank you for your reply. Till when can I expect this feature to be integrated in master or release version ? We are going to get production data (financial data) in October end , so want to have this feature before that. Regards, Vinay Patil On Mon, Aug 29, 2016 at 11:15 AM, Stephan Ewen [via Apache Flink User Mailing List archive.] <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Let me loop in Vijay, I think he is the one working on this and can probably give the best estimate when it can be expected.
@vijay: For the SSL/TLS transport encryption - do you have an estimate for the timeline of that feature? On Mon, Aug 29, 2016 at 8:54 PM, vinay patil <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Hi Stephan, The dev work is almost complete except the Yarn mode deployment stuff that needs to be patched. We are expecting to send a PR in a week or two. Regards Vijay On Tuesday, August 30, 2016 12:39 AM, Stephan Ewen <[hidden email]> wrote: Let me loop in Vijay, I think he is the one working on this and can probably give the best estimate when it can be expected. @vijay: For the SSL/TLS transport encryption - do you have an estimate for the timeline of that feature? On Mon, Aug 29, 2016 at 8:54 PM, vinay patil <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Hi Vijay, That's a good news for me. Eagerly waiting for this change so that I can integrate and test it before going live. Regards, Vinay Patil On Tue, Aug 30, 2016 at 4:06 PM, Vijay Srinivasaraghavan [via Apache Flink User Mailing List archive.] <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
In reply to this post by vijikarthi
Hi Vijay, Did you raise the PR for this task, I don't mind testing it out as well. Regards, Vinay Patil On Tue, Aug 30, 2016 at 6:28 PM, Vinay Patil <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Hi Vinay, There are some delays and we expect the PR to be created next week. Regards Vijay On Wednesday, September 14, 2016 5:41 PM, vinay patil <[hidden email]> wrote: Hi Vijay, Did you raise the PR for this task, I don't mind testing it out as well. Regards, Vinay Patil On Tue, Aug 30, 2016 at 6:28 PM, Vinay Patil <[hidden email]> wrote:
View this message in context: Re: Data Transfer between TM should be encrypted Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com. |
Re: Data Transfer between TM should be encrypted
|
|
In reply to this post by Stephan Ewen
Hi Stephan, Is this pull request going to be part of 1.2 release ? Just wanted to get an idea on timelines so that I can pass on to the team. Regards, Vinay Patil On Thu, Sep 15, 2016 at 11:45 AM, Vijay Srinivasaraghavan <[hidden email]> wrote:
|
|
|
Hi, I think that pull request will be merged for 1.2. On Fri, Oct 7, 2016 at 6:26 PM, vinay patil <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Hi Robert, Thank you for that information, can you please let me know when 1.2 is planned to release ? Regards, Vinay Patil On Wed, Oct 12, 2016 at 4:17 AM, rmetzger0 [via Apache Flink User Mailing List archive.] <[hidden email]> wrote:
|
|
|
Hi, the release dates depend on the community, when features are ready and so on. There was no discussion yet when we plan to do the release, because most of the features we want to have in are not yet done yet. I think its likely that we'll have a 1.2 release by end of this year. Regards, Robert On Thu, Oct 13, 2016 at 5:07 AM, vinay patil <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
I agree with Robert. We should probably aim for the release to be end of November, so that it will come this year even in the presence of some delay. Best, Stephan On Thu, Oct 13, 2016 at 11:36 AM, Robert Metzger <[hidden email]> wrote:
|
Re: Data Transfer between TM should be encrypted
|
|
Thank you Stephan and Robert for your positive response Regards, Vinay Patil On Thu, Oct 13, 2016 at 11:22 AM, Stephan Ewen [via Apache Flink User Mailing List archive.] <[hidden email]> wrote:
|
«
Return to (DEPRECATED) Apache Flink User Mailing List archive.
|
1 view|%1 views
| Free forum by Nabble | Edit this page |