are there any ways to test the performance of rocksdb state backend?

[makeyang]

I'd like to integrate newer version of rocksdb with flink. I'd like to know
if there are existing tools/ways to benchmark the performance of rocksdb
state backend to see if there are performence improve or drop？


MaKeyang
TIG.JD.COM




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[gerryzhou]

Hi makeyang,

there are some cases under _org.apache.flink.contrib.streaming.state.benchmark.*_ that you can refer to. But, I not sure whether it's possible to upgrade the RocksDB to any higher version because the regression of the merge operator, the comments in this PR https://github.com/apache/flink/pull/5937 may also give you some help.

Best, Sihua

On 05/18/2018 11:05，[hidden email] wrote：

I'd like to integrate newer version of rocksdb with flink. I'd like to know
if there are existing tools/ways to benchmark the performance of rocksdb
state backend to see if there are performence improve or drop？


MaKeyang
TIG.JD.COM




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Stefan Richter]

Hi,

Sihua is right, of course we would like to update our RocksDB version but are currently blocked on a performance regression. Here is our issue in the RocksDB tracker for this: https://github.com/facebook/rocksdb/issues/3865 .

Best,

Stefan

Am 18.05.2018 um 08:52 schrieb sihua zhou <[hidden email]>:

Hi makeyang,

there are some cases under _org.apache.flink.contrib.streaming.state.benchmark.*_ that you can refer to. But, I not sure whether it's possible to upgrade the RocksDB to any higher version because the regression of the merge operator, the comments in this PR https://github.com/apache/flink/pull/5937 may also give you some help.

Best, Sihua

On 05/18/2018 11:05，[hidden email] wrote： 

I'd like to integrate newer version of rocksdb with flink. I'd like to know
if there are existing tools/ways to benchmark the performance of rocksdb
state backend to see if there are performence improve or drop？


MaKeyang
TIG.JD.COM




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/