What is the best way of sharing a dataset between the nodes in Apache flink?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

What is the best way of sharing a dataset between the nodes in Apache flink?

ahmad Sa P
Hi everyone,

I am using Apache Flink to process a stream of data and I need to share an index between all the nodes that process the input data. The index is getting updated by the nodes frequently.
I would like to know, is it a good practice, from the point of efficiency, to share the Dataset through Broadcast Variables?

Thanks,
Ahmad