KakfaConsumer

Posted by Vishal Santoshi on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/KakfaConsumer-tp25913.html

A simple query

Does Flink' KafkaConnector flush the current offsets to kafka on a SP ?  Note that the I do koow that Flink consumes data from Kafka topics and periodically checkpoints using Flink's distributed checkpointing mechanism. In case of failure, Flink will restore the records from checkpoint directory and will start reading data from Kafka offset after that. In this case however I want to restart a radically different pipe but from an offset that is part of the SP and the hope is that I could just depend on the kafka offsets of the consumer group. 

Thanks