Partitions vs. Subpartitions

[Chris Miller]

Hi,

what's the difference between partitions and subpartitions?

 

Thanks.

 

CM

 

[Renjie Liu]

Hi, Chris:

Where are these words from? Are they from flink source code?

On Wed, Oct 10, 2018 at 10:18 PM Chris Miller <[hidden email]> wrote:

Hi,

what's the difference between partitions and subpartitions?

 

Thanks.

 

CM

 

--

[Kurt Young]

Hi，

Partition is the output of a JobVertex which you can simply thought contains an operator. And in real world, JobVertex will run in parallel, each 

will output some data, which is conceptually called subpartition. 

On Thu, Oct 11, 2018 at 10:27 AM Renjie Liu <[hidden email]> wrote:

Hi, Chris:

Where are these words from? Are they from flink source code?

On Wed, Oct 10, 2018 at 10:18 PM Chris Miller <[hidden email]> wrote:

Hi,

what's the difference between partitions and subpartitions?

 

Thanks.

 

CM

 

--

[Fabian Hueske-2]

Hi Chris,

The terminology in the docs and code is not always consistent. It depends on the context.

Both could also mean the same if they are used in different places.

Can you point to the place(s) that refer to partition and subpartition?

Fabian

Am Do., 11. Okt. 2018 um 04:50 Uhr schrieb Kurt Young <[hidden email]>:

Hi，

Partition is the output of a JobVertex which you can simply thought contains an operator. And in real world, JobVertex will run in parallel, each 

will output some data, which is conceptually called subpartition. 

On Thu, Oct 11, 2018 at 10:27 AM Renjie Liu <[hidden email]> wrote:

Hi, Chris:

Where are these words from? Are they from flink source code?

On Wed, Oct 10, 2018 at 10:18 PM Chris Miller <[hidden email]> wrote:

Hi,

what's the difference between partitions and subpartitions?

 

Thanks.

 

CM

 

--