Broadcast managed state

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Broadcast managed state

Deepya
I am using Flink to process Streams. There is a MapValued Managed state that
I am using to store custom state. I notice that the state is not shared
across the Task Managers. Is there a way to Broadcast Managed state?

Thanks,
Deepya.





--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Broadcast managed state

Dawid Wysakowicz-2
Hi Deepya,

It depends how do you want to update this state. If your use-case
follows the Broadcast State Pattern[1], that means you perform updates
to your state only based on one broadcasted stream (often called control
stream) you should check out the linked docs.

If you want to perform updates from e.g. keyedStream, this is not
possible with vanilla flink.


[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/state/broadcast_state.html#the-broadcast-state-pattern


On 12/09/18 22:39, Deepya wrote:

> I am using Flink to process Streams. There is a MapValued Managed state that
> I am using to store custom state. I notice that the state is not shared
> across the Task Managers. Is there a way to Broadcast Managed state?
>
> Thanks,
> Deepya.
>
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/


signature.asc (849 bytes) Download Attachment