Will broadcast stream affect performance because of the absence of operator chaining?

Posted by 黄兆鹏 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Will-broadcast-stream-affect-performance-because-of-the-absence-of-operator-chaining-tp29190.html

Hi all, 

My flink job has dynamic schema of data, so I want to consume a schema kafka topic and try to broadcast to every operator so that each operator could know what kind of data it is handling.

For example, the two streams just like this:

OperatorA  ->  OperatorB  -> OperatorC

      ^                   ^                      ^

      |                    |                       |

               BroadcastStream

If the broadcast stream does not exist, OperatorA, OperatorB, OperatorC are chained together in one slot because they have the same parallelism so that it can gain maximum performance.

And I was wondering that if the broadcast stream exists, will it affect the performance? Or flink will still chain them together to gain maximum performance? 

Thanks!