Fault Tolerance with RocksDBStateBackend

[Maminspapin]

Hi everyone,

I want to build a flink cluster with 3 machines.
What if I choose RocksDBStateBackend with next settings:

#==============================================================================
# Fault tolerance and checkpointing
#==============================================================================

state.backend: rocksdb
state.checkpoints.dir: file:///home/flink/checkpoints
state.backend.incremental: true
jobmanager.execution.failover-strategy: region


Is it necessary to use distributed file systems like hdfs to provide fault
tolerance (i.e. state.checkpoints.dir: hdfs:///home/flink/checkpoints)?

There is no fault tolerance with file:// schema?

Thanks,
Yuri L.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Guowei Ma]

Hi,

You need some persistent storages(like hdfs) for the checkpoint. It is Flink's fault tolerance prerequisites.[1]

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/stream/state/checkpointing.html#prerequisites

On Wed, Mar 24, 2021 at 1:21 PM Maminspapin <[hidden email]> wrote:

Hi everyone,

I want to build a flink cluster with 3 machines.
What if I choose RocksDBStateBackend with next settings:

#==============================================================================
# Fault tolerance and checkpointing
#==============================================================================

state.backend: rocksdb
state.checkpoints.dir: file:///home/flink/checkpoints
state.backend.incremental: true
jobmanager.execution.failover-strategy: region


Is it necessary to use distributed file systems like hdfs to provide fault
tolerance (i.e. state.checkpoints.dir: hdfs:///home/flink/checkpoints)?

There is no fault tolerance with file:// schema?

Thanks,
Yuri L.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Maminspapin]

Ok, thank you, Guowei Ma



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/