Facing issues on kafka while running a job that was built with 1.11.2-scala-2.11 version onto flink version 1.11.2-scala-2.12

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Facing issues on kafka while running a job that was built with 1.11.2-scala-2.11 version onto flink version 1.11.2-scala-2.12

narasimha
Hi, 

Facing issues on kafka while running a job that was built with 1.11.2-scala-2.11 version onto flink version 1.11.2-scala-2.12. 
kafka-connector with 1.11.2-scala-2.11 is getting packaged with the job. 

Kafka cluster was all good when writing to topics, but when someone reads intermittently the cluster becomes unstable with unresponsive brokers. 
Do these differences in scala binary versions cause any issues to Kafka?

Flink version 1.11.2-scala-2-12
Kafka version - 2.1.0

--
A.Narasimha Swamy
Reply | Threaded
Open this post in threaded view
|

Re: Facing issues on kafka while running a job that was built with 1.11.2-scala-2.11 version onto flink version 1.11.2-scala-2.12

Yun Gao
Hi Narasimha,

     Since the Kafka-connect itself is purely implemented with Java, thus I guess that with high probabililty it is not the issue of scala version. I think may first have a check of the kafka cluster's status ?

Best,
 Yun

------------------------------------------------------------------
Sender:narasimha<[hidden email]>
Date:2020/12/30 13:43:28
Recipient:user<[hidden email]>
Theme:Facing issues on kafka while running a job that was built with 1.11.2-scala-2.11 version onto flink version 1.11.2-scala-2.12

Hi, 

Facing issues on kafka while running a job that was built with 1.11.2-scala-2.11 version onto flink version 1.11.2-scala-2.12. 
kafka-connector with 1.11.2-scala-2.11 is getting packaged with the job. 

Kafka cluster was all good when writing to topics, but when someone reads intermittently the cluster becomes unstable with unresponsive brokers. 
Do these differences in scala binary versions cause any issues to Kafka?

Flink version 1.11.2-scala-2-12
Kafka version - 2.1.0

--
A.Narasimha Swamy