RocksDBStatebackend does not write checkpoints to backup path

[Paul Lam]

Hi,

I have a job (with Flink 1.6.4) which uses rocksdb incremental checkpointing, but the checkpointing always fails with `IllegalStateException`, 

because hen performing `RocksDBIncrementalSnapshotOperation`, rocksdb finds that `localBackupDirectory`, which should be created earlier

by rocksdb checkpoint, doesn’t exist. But there is no error message about failures of rocksdb checkpoint. 

What could possibly be the cause? Thanks a lot!

Best,

Paul Lam

[Tzu-Li (Gordon) Tai]

Hi,

Do you have the full error message of the failure?
A wild guess to begin with: have you made sure that there are sufficient permissions to create the directory?

Best,
Gordon

On Tue, Mar 26, 2019 at 5:46 PM Paul Lam <[hidden email]> wrote:

Hi,

I have a job (with Flink 1.6.4) which uses rocksdb incremental checkpointing, but the checkpointing always fails with `IllegalStateException`, 

because hen performing `RocksDBIncrementalSnapshotOperation`, rocksdb finds that `localBackupDirectory`, which should be created earlier

by rocksdb checkpoint, doesn’t exist. But there is no error message about failures of rocksdb checkpoint. 

What could possibly be the cause? Thanks a lot!

Best,

Paul Lam

[Paul Lam]

Hi Gordon,

Thanks for your reply. I’ve found out that it should be a bug of RocksDBStateBackend [1].

[1] https://issues.apache.org/jira/browse/FLINK-12042

Best,

Paul Lam

在 2019年3月28日，17:03，Tzu-Li (Gordon) Tai <[hidden email]> 写道：

Hi,

Do you have the full error message of the failure?
A wild guess to begin with: have you made sure that there are sufficient permissions to create the directory?

Best,
Gordon

On Tue, Mar 26, 2019 at 5:46 PM Paul Lam <[hidden email]> wrote:

Hi,

I have a job (with Flink 1.6.4) which uses rocksdb incremental checkpointing, but the checkpointing always fails with `IllegalStateException`, 

because hen performing `RocksDBIncrementalSnapshotOperation`, rocksdb finds that `localBackupDirectory`, which should be created earlier

by rocksdb checkpoint, doesn’t exist. But there is no error message about failures of rocksdb checkpoint. 

What could possibly be the cause? Thanks a lot!

Best,

Paul Lam