Flink-Kafka connector - partition offsets for a given timestamp?

Posted by Yang, Connie on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Kafka-connector-partition-offsets-for-a-given-timestamp-tp17187.html

Hi,

 

Does Flink-Kafka connector allow job graph to consume topoics/partitions from a specific timestamp?

 

https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java#L469 seems to suggest that a job graph can only start from an earliest, latest or a set of offsets.

 

KafkaConsumer API, https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java#L1598, gives us a way to find partition offsets based on a timestamp.

 

Thanks

Connie