chained operator with different parallelism question

[makeyang]

someStream.filter(...).map(...).map(...);
there operators are supposed to chained.
but what if there are set different parallelism like below:
someStream.filter(...).setParallelism(X).map(...).setParallelism(Y).map(...).setParallelism(Z);
X != Y != Z
what will happen?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Fabian Hueske-2]

Functions with different parallelism cannot be chained.

Chaining means that Functions are fused into a single operator and that records are passed by method calls (instead of serializing them into an in-memory or network channel).

Hence, chaining does not work if you have different parallelism.

Best, Fabian

2018-05-18 13:42 GMT+02:00 makeyang <[hidden email]>:

someStream.filter(...).map(...).map(...);
there operators are supposed to chained.
but what if there are set different parallelism like below:
someStream.filter(...).setParallelism(X).map(...).setParallelism(Y).map(...).setParallelism(Z);
X != Y != Z
what will happen?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/