Avro Serialization and RocksDB Internal State
Posted by
Biplob Biswas on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Avro-Serialization-and-RocksDB-Internal-State-tp14912.html
Hi,
This is somewhat related to my previous query here:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Evolving-serializers-and-impact-on-flink-managed-states-td14777.htmlI was exploring Avro Serialization and in that regard I enabled the force use of avro using,
env.getConfig().enableForceAvro();
Now, my assumption is all internal data transfers will be done using the Avro serde, what I also assume is that on my RocksDB state backend my objects would also be stored after serializing with avro.
Is this assumption correct? If not is there a way to register my objects (sometimes not exactly a POJO as recognized by Flink) with the avro serializers?
I want to de-/serialize my objects using avro and store it on my RocksDB state backend, but I am not really aware how can I verify the serializer which is used to perform that.
Thanks and Regards,
Biplob