Rocksdb implementation

Posted by on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Rocksdb-implementation-tp35199.html

Hi,

I have implemented the flink job with MapStates. The functionality is like, 

1. I have two datastreams which I connect with connect operator and then call coprocessfunction with every pair of objects.
2. For element of first datastream, processElement1 method is called and for an element of second datastream, processElement2 method is called.
   
3. I have two MapStates in CoProcessFunction for both streams separately.
4. When processElement1 is called, it checks in MapState2 if corresponding element with given id is present, if present, I match, and delete. If not present, I add the object in MapState1.
5. When processElement2 is called, it checks in MapState1 if corresponding element with given id is present, if present, I match and delete. I fnot present I add object in MapState2.
6. Now, I want all the state data to be stored in Rocksdb.
7. After few days, I want to run a batch streaming job on Rocksdb to check if there are any objects which have not match found to create a report of those.

I need a help how can I store this state data in Rocksdb and how to do setups, configurations and codes for those which I am not understanding. Also, is it possible to run batch streaming job on Rocksdb data?

Help will be highly appreciated.

Thanks,

Jaswin