Re: Flink Streaming State Management

Posted by Gyula Fóra on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Streaming-State-Management-tp1673p1676.html

Hey Hilmi,

Flink currently supports user defined state through the Checkpointed interface. Using this interface the user can define what state should the system be aware of when doing snapshots for fault tolerance. The state returned in the snapshotState method will be checkpointed (and restored upon failure).

Currently there is no explicit update function so the user need to implement his state updates as part of the operator logic (inside the map function for instance). After the 0.9.0 we will change the state interfaces to have explicit update functions, you can preview some of the functionality in the PR Matthias referenced, or here is a document for a more detailed discussion of this feature: 

https://docs.google.com/document/d/1nTn4Tpafsnt-TCT6L1vlHtGGgRevU90yRsUQEmkRMjk/edit?usp=sharing

Cheers,

Gyula

Hilmi Yildirim <[hidden email]> ezt írta (időpont: 2015. jún. 17., Sze, 9:36):

Hi,
does Flink Streaming support state management? For example, I have a
state which will be used inside the streaming operations but the state
can be updated.

For example:
stream.map( use state for operation).updateState(update state).


Best Regards,
Hilmi




--
--
Hilmi Yildirim
Software Developer R&D


http://www.neofonie.de

Besuchen Sie den Neo Tech Blog für Anwender:
http://blog.neofonie.de/

Folgen Sie uns:
https://plus.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
https://www.xing.com/companies/neofoniegmbh

Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Geschäftsführung: Thomas Kitlitschko