How to get Kafka record's timestamp using Flink's KeyedDeserializationSchema?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

How to get Kafka record's timestamp using Flink's KeyedDeserializationSchema?

Flink Developer
Hi, I have a flink app which uses the FlinkKafkaConsumer.

I am interested in retrieving the Kafka timestamp for a given record/offset using the *KeyedDeserializationSchema* which provides topic, partition, offset and message.

How can the timestamp be obtained through this interface?

Thank you
Reply | Threaded
Open this post in threaded view
|

Re: How to get Kafka record's timestamp using Flink's KeyedDeserializationSchema?

Andrey Zagrebin
Hi,

I think this is still on-going effort. You can monitor the corresponding issues [1] and [2].

Best,
Andrey

[2] https://issues.apache.org/jira/browse/FLINK-8354

On 16 Nov 2018, at 09:41, Flink Developer <[hidden email]> wrote:

Kafka timestamp

Reply | Threaded
Open this post in threaded view
|

Re: How to get Kafka record's timestamp using Flink's KeyedDeserializationSchema?

Flink Developer
Thanks. Is there an alternative way to obtain the Kafka record timestamps using FlinkKafkaConsumer?

‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Friday, November 16, 2018 9:59 AM, Andrey Zagrebin <[hidden email]> wrote:

Hi,

I think this is still on-going effort. You can monitor the corresponding issues [1] and [2].

Best,
Andrey


On 16 Nov 2018, at 09:41, Flink Developer <[hidden email]> wrote:

Kafka timestamp