Flatbuffers and Flink

[Basanth Gowda]

Hi,

This is 1 of 3 questions I had for Flink. Didn't want to club all of them together, as this might be useful for some one else in the future.

Do we have Flatbuffers support in Flink ? If there is no support, is there a way to implement it ?

Trying to see if we could use the byte[] that has come from upstream, without converting it into POJO / other format.

thank you

[Fabian Hueske-2]

Hi,

in principle you can use any data type with Flink including byte[]. However, all of your functions need the logic to interpret the bytes and you have to implement custom key extractors (if you need to keyBy or partition your stream).

Best, Fabian

2017-08-01 2:09 GMT+02:00 Basanth Gowda <[hidden email]>:

Hi,

This is 1 of 3 questions I had for Flink. Didn't want to club all of them together, as this might be useful for some one else in the future.

Do we have Flatbuffers support in Flink ? If there is no support, is there a way to implement it ?

Trying to see if we could use the byte[] that has come from upstream, without converting it into POJO / other format.

thank you