GRPC source in Flink

[Basanth Gowda]

Hi,

Is there a way to get data from GRPC source in flink.  If we can how we guarantee that events are not lost once submitted to Flink.

thank you

[Chen Qin]

Hi Basanth,

Given the fact that Flink put failure recovery garantee on checkpointing and source rewinding. 

I can imagine a lossless rpc source would be tricky. In essence, any rpc source needs to provide rewind api which can buffer at least to last success checkpoint. 

In production use cases, put your data received from rpc server to a distributed queue and consume from queue might be better idea.

Thanks,

Chen

On Mon, Jul 31, 2017 at 5:13 PM, Basanth Gowda <[hidden email]> wrote:

Hi,

Is there a way to get data from GRPC source in flink.  If we can how we guarantee that events are not lost once submitted to Flink.

thank you