Re: Bad entry in block exception with RocksDB

Posted by Kostas Kloudas on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Bad-entry-in-block-exception-with-RocksDB-tp16877p16882.html

Hi Kien,

Could you share some more information about your job?
What operators are you using, the format of your elements, etc?

Thanks,
Kostas

> On Nov 23, 2017, at 2:23 AM, Kien Truong <[hidden email]> wrote:
>
> Hi,
>
> We are seeing this exception in one of our job, whenever a check point or save point is performed.
>
> java.lang.RuntimeException: Error while adding data to RocksDB
> at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:119)
> at org.apache.flink.runtime.state.UserFacingListState.add(UserFacingListState.java:50)
> ....
> Caused by: org.rocksdb.RocksDBException: bad entry in block
> at org.rocksdb.RocksDB.merge(Native Method)
> at org.rocksdb.RocksDB.merge(RocksDB.java:683)
> at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:116)
>
> We are using Flink 1.3.2 with incremental checkpoint. Any idea what might be causing this ?
>
> Best regards,
> Kien