Can I see the kafka header information in the Flink connector?

[Ron Crocker]

Looking at the Kafka 0.8 connector API, my deserializer definitely gets the message but none of the header information, and in particular, message metadata. 

Is there a straightforward way to do this (other than upgrading our Kafka cluster ;)). The connector code itself is a bit involved.

Ron

—

Ron Crocker

Principal Engineer & Architect

( ( •)) New Relic

[hidden email]

M: [phone]

[rmetzger0]

Hi Ron,

there is a KeyedDeserializationSchema for the Kafka connector, that exposes the source partition, offset and topic.

Is that what you are looking for?

On Thu, Dec 22, 2016 at 5:33 PM, Ron Crocker <[hidden email]> wrote:

Looking at the Kafka 0.8 connector API, my deserializer definitely gets the message but none of the header information, and in particular, message metadata. 

Is there a straightforward way to do this (other than upgrading our Kafka cluster ;)). The connector code itself is a bit involved.

Ron

—

Ron Crocker

Principal Engineer & Architect

( ( •)) New Relic

[hidden email]

M: <a href="tel:+1%20630-363-8835" value="[phone]" target="_blank">[phone]