回复：Re: fromParallelCollection

[rimin515]

fromCollection is not parallelization,the data is huge,so i want to use env.fromParallelCollection(data),but the data i do not know how to initialize,

----- 原始邮件 -----
发件人：Maximilian Michels <[hidden email]>
收件人："[hidden email]" <[hidden email]>, [hidden email]
主题：Re: fromParallelCollection
日期：2016年09月05日 16点58分

Please give us a bit more insight on what you're trying to do.
On Sat, Sep 3, 2016 at 5:01 AM, <[hidden email]> wrote:
> Hi，
> val env = StreamExecutionEnvironment.getExecutionEnvironment
> val tr = env.fromParallelCollection(data)
>
> the data i do not know initialize,some one can tell me..
> --------------------------------
>
>
>

[Timo Walther]

Hi,

you have to implement a class that extends "org.apache.flink.util.SplittableIterator". The runtime will ask this class for multiple "java.util.Iterator"s over your split data. How you split your data and how an iterator looks like depends on your data and implementation.

If you need more help, you should show us some examples of your data.

Timo

Am 06/09/16 um 09:46 schrieb [hidden email]:

fromCollection is not parallelization,the data is huge,so i want to use env.fromParallelCollection(data),but the data i do not know how to initialize,

----- 原始邮件 -----
发件人：Maximilian Michels [hidden email]
收件人：[hidden email] [hidden email], [hidden email]
主题：Re: fromParallelCollection
日期：2016年09月05日 16点58分

Please give us a bit more insight on what you're trying to do.
On Sat, Sep 3, 2016 at 5:01 AM, [hidden email] wrote:
> Hi，
> val env = StreamExecutionEnvironment.getExecutionEnvironment
> val tr = env.fromParallelCollection(data)
>
> the data i do not know initialize,some one can tell me..
> --------------------------------
>
>
>