Storing Operator state in RocksDb during runtime - plans

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Storing Operator state in RocksDb during runtime - plans

KristoffSC
Hi,
according to [1] operator state and broadcast state (which is a "special"
type of operator state) are not stored in RocksDb during runtime when
RocksDb is choosed as state backend.

Are there any plans to change this?

I'm working around a case where I will have a quite large control stream.


[1]
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/broadcast_state.html



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Storing Operator state in RocksDb during runtime - plans

Fabian Hueske-2
Hi Kristoff,

I'm not aware of any concrete plans for such a feature.

Best,
Fabian

Am So., 5. Apr. 2020 um 22:33 Uhr schrieb KristoffSC <[hidden email]>:
Hi,
according to [1] operator state and broadcast state (which is a "special"
type of operator state) are not stored in RocksDb during runtime when
RocksDb is choosed as state backend.

Are there any plans to change this?

I'm working around a case where I will have a quite large control stream.


[1]
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/broadcast_state.html



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Storing Operator state in RocksDb during runtime - plans

Congxian Qiu
Hi KristoffSC

I'm not aware of any concrete plans for such a feature. I also CCed Yu, he may give more information about this.

Best,
Congxian


Fabian Hueske <[hidden email]> 于2020年4月7日周二 上午4:27写道:
Hi Kristoff,

I'm not aware of any concrete plans for such a feature.

Best,
Fabian

Am So., 5. Apr. 2020 um 22:33 Uhr schrieb KristoffSC <[hidden email]>:
Hi,
according to [1] operator state and broadcast state (which is a "special"
type of operator state) are not stored in RocksDb during runtime when
RocksDb is choosed as state backend.

Are there any plans to change this?

I'm working around a case where I will have a quite large control stream.


[1]
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/broadcast_state.html



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/