RocksDB "shared" directory on HDFS getting bigger

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

RocksDB "shared" directory on HDFS getting bigger

Dongwon Kim-2
Hi,

I'm using RocksDB state backend w/ incremental checkpoint.
hdfs://<flink-checkpoint-dir>/<job_id>/shared directory is getting bigger as time goes on.

Does it mean that I forget to clean up state somewhere?

- Dongwon