Distributed Cache support for StreamExecutionEnvironment
Hi Team,
Is there support for Distributed Cache in StreamExecutionEnvironment? I didn't find any such things in StreamExecutionEnvironment. I am using flink 1.1.1
I found distributed cache for ExecutionEnvironment but not for StreamExecutionEnvironment
If Yes, Can anybody tell me how to use same ? Else any work around is there for same ?
Re: Distributed Cache support for StreamExecutionEnvironment
Hi Swapnil,
there's no support for something like DistributedCache in the DataStream API.
However, as a workaround, you can rely on the RichFunction's open() method's to load such data directly from a distributed file system.
Regards,
Robert
On Fri, Sep 9, 2016 at 8:13 AM, Swapnil Chougule <[hidden email]> wrote:
Hi Team,
Is there support for Distributed Cache in StreamExecutionEnvironment? I didn't find any such things in StreamExecutionEnvironment. I am using flink 1.1.1
I found distributed cache for ExecutionEnvironment but not for StreamExecutionEnvironment
If Yes, Can anybody tell me how to use same ? Else any work around is there for same ?
Re: Distributed Cache support for StreamExecutionEnvironment
Thanks Robert. It worked for me. I have used RichFunction's open() method.
Regards,
Swapnil
On Fri, Sep 9, 2016 at 3:40 PM, Robert Metzger <[hidden email]> wrote:
Hi Swapnil,
there's no support for something like DistributedCache in the DataStream API.
However, as a workaround, you can rely on the RichFunction's open() method's to load such data directly from a distributed file system.
Regards,
Robert
On Fri, Sep 9, 2016 at 8:13 AM, Swapnil Chougule <[hidden email]> wrote:
Hi Team,
Is there support for Distributed Cache in StreamExecutionEnvironment? I didn't find any such things in StreamExecutionEnvironment. I am using flink 1.1.1
I found distributed cache for ExecutionEnvironment but not for StreamExecutionEnvironment
If Yes, Can anybody tell me how to use same ? Else any work around is there for same ?