Broadcasting sets in Flink Streaming
Posted by
Tamara Mendt on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Broadcasting-sets-in-Flink-Streaming-tp2504.html
Hello,
I have been trying to use the function withBroadcastSet on a SingleOutputStreamOperator (map) the same way I would on a MapOperator for a DataSet. From what I see, this cannot be done. I wonder if there is some way to broadcast a DataSet to the tasks that are performing transformations on a DataStream?
I am basically pre-calculating some things with Flink which I later need for the transformations on the incoming data from the stream. So I want to broadcast the resulting datasets from the pre-calculations.
Any ideas on how to best approach this?
Thanks, cheers
Tamara.