Use case for The Broadcast State Pattern and efficient database access

Posted by Marke Builder on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Use-case-for-The-Broadcast-State-Pattern-and-efficient-database-access-tp25729.html

Hi,

I have a question regarding the "Broadcast State Pattern".

My job consume two streams (kafka, rabbitmq), on one of the streams come a lot of data and continuously[1]. On the other  very few and rarely[2]. I'm using the Broadcast State pattern, because the stream[2] are updating data which are required for stream[1].

Q1: Is the Broadcast State Pattern the right way?

As I mentioned above, the stream[2] provide data and "say" read additional data from a database.

Q2: What is the best(the most efficient) way to request a database from the processElement(...) function?

Many Thanks!

Marke