Is there some metric info about RocksdbBackend?

[gerryzhou]

Hi,

     Is there some metric info about RocksdbBackend in flink, like sst compact times, memtable dump times, block cache size and so on. Currently when using Rocksdb as backend it behavior is black for us  and it consumption a lot of memory, i want to figure out it behavior via metric.

 

[Vinay Patil]

Hi Gerry,

I had set the following parameters for DBOptions:

setStatsDempPeriodSec( 600) // 10 mins

setDBLogDir("/var/tmp/")

 I saw the files getting generated in /var/tmp. But I did not get the statistics here. You will get all the options that are used for RocksDB.

May be you can try to set createStatistics() as well.

By the way I was able to get rid of memory consumption issue. Did you try using FLASH_SSD_OPTION ?

On Fri, Jun 30, 2017 at 2:49 PM, gerryzhou [via Apache Flink User Mailing List archive.] <[hidden email]> wrote:

Hi,

     Is there some metric info about RocksdbBackend in flink, like sst compact times, memtable dump times, block cache size and so on. Currently when using Rocksdb as backend it behavior is black for us  and it consumption a lot of memory, i want to figure out it behavior via metric.

 

---

If you reply to this email, your message will be added to the discussion below:

http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Is-there-some-metric-info-about-RocksdbBackend-tp14081.html

To start a new topic under Apache Flink User Mailing List archive., email [hidden email]
To unsubscribe from Apache Flink User Mailing List archive., click here.
NAML

[gerryzhou]

Hi Vinay,
     Thanks for your response, i will try for your advice。