Bad entry in block exception with RocksDB

[Kien Truong]

Hi,

We are seeing this exception in one of our job, whenever a check point or save point is performed.

java.lang.RuntimeException: Error while adding data to RocksDB

at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:119)

at org.apache.flink.runtime.state.UserFacingListState.add(UserFacingListState.java:50)

....

Caused by: org.rocksdb.RocksDBException: bad entry in block

at org.rocksdb.RocksDB.merge(Native Method)

at org.rocksdb.RocksDB.merge(RocksDB.java:683)

at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:116)

We are using Flink 1.3.2 with incremental checkpoint. Any idea what might be causing this ?

Best regards,

Kien

[Kostas Kloudas]

Hi Kien,

Could you share some more information about your job?
What operators are you using, the format of your elements, etc?

Thanks,
Kostas

> On Nov 23, 2017, at 2:23 AM, Kien Truong <[hidden email]> wrote:
>
> Hi,
>
> We are seeing this exception in one of our job, whenever a check point or save point is performed.
>
> java.lang.RuntimeException: Error while adding data to RocksDB
> at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:119)
> at org.apache.flink.runtime.state.UserFacingListState.add(UserFacingListState.java:50)
> ....
> Caused by: org.rocksdb.RocksDBException: bad entry in block
> at org.rocksdb.RocksDB.merge(Native Method)
> at org.rocksdb.RocksDB.merge(RocksDB.java:683)
> at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:116)
>
> We are using Flink 1.3.2 with incremental checkpoint. Any idea what might be causing this ?
>
> Best regards,
> Kien