How to read AVRO data from Kafka using Flink

[Alam, Zeeshan]

Hi All,

 

I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38698721/how-to-read-avro-data-from-kafka-using-flink  . Is there any mistake we can try to look into?

 

Thanks & Regards

Zeeshan Alam

 

 

[Alam, Zeeshan]

Hi All,

 

I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink . Is there any mistake we can try to look into or there a better way to read AVR data from Kafka using Flink?

 

Thanks & Regards

Zeeshan Alam

 

 

[Shannon Carey]

I can tell you that we are reading Avro data from Kafka on Flink without problems. It seems like you have a mistake somewhere in your system. If I were you I would try your serialization & deserialization code in a simple program within the same JVM, then gradually add the other components in order to narrow down where the problem is coming from.

Shannon

From: "Alam, Zeeshan" <[hidden email]>
Date: Tuesday, August 2, 2016 at 5:28 AM
To: "[hidden email]" <[hidden email]>
Subject: How to read AVRO data from Kafka using Flink

Hi All,

 

I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink . Is there any mistake we can try to look into or there a better way to read AVR data from Kafka using Flink?

 

Thanks & Regards

Zeeshan Alam

 

 

[Alam, Zeeshan]

Hi Shannon,

 

There was an issue with the data written in the Kafka topic, some were in JSON format and some in AVRO. I ran my code for a different Kafka topic where there was homogeneous data and my code worked fine. Thanks for your time.

 

Thanks & Regards,

Zeeshan Alam

 

From: Shannon Carey [mailto:[hidden email]]
Sent: Tuesday, August 02, 2016 8:49 PM
To: Alam, Zeeshan; [hidden email]
Subject: Re: How to read AVRO data from Kafka using Flink

 

I can tell you that we are reading Avro data from Kafka on Flink without problems. It seems like you have a mistake somewhere in your system. If I were you I would try your serialization & deserialization code in a simple program within the same JVM, then gradually add the other components in order to narrow down where the problem is coming from.

 

Shannon

 

From: "Alam, Zeeshan" <[hidden email]>
Date: Tuesday, August 2, 2016 at 5:28 AM
To: "[hidden email]" <[hidden email]>
Subject: How to read AVRO data from Kafka using Flink

 

Hi All,

 

I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink . Is there any mistake we can try to look into or there a better way to read AVR data from Kafka using Flink?

 

Thanks & Regards

Zeeshan Alam