Kafka 11 connector on Flink 1.3

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Kafka 11 connector on Flink 1.3

Syed Moizuddin
Hi,

I was just wondering if I could use the Kafka 11 connector on 1.3.
If there are dependencies, then what would be the timeframe for 1.4 release

Thanks
Moiz
Reply | Threaded
Open this post in threaded view
|

Re: Kafka 11 connector on Flink 1.3

Piotr Nowojski
Hi,

Kafka 0.11 connector depends on some API changes for Flink 1.4, so without rebasing the code and solving some small issues it is not possible to use it for 1.3.x.

We are about to finalizing the timeframe for 1.4 release, it would be great if you could come back with this question after the weekend.

If you do not need exactly-once Kafka producer that will come with Kafka 0.11 connector, you should be able to use 0.10 connector to read (exactly-once) and write (at-least-once) to Kafka 0.11.

Piotrek

> On 12 Oct 2017, at 10:44, Syed Moizuddin <[hidden email]> wrote:
>
> Hi,
>
> I was just wondering if I could use the Kafka 11 connector on 1.3.
> If there are dependencies, then what would be the timeframe for 1.4 release
>
> Thanks
> Moiz

Reply | Threaded
Open this post in threaded view
|

Re: Kafka 11 connector on Flink 1.3

Syed Moizuddin
Thanks. I want to use the exactly once Kafka producer for my use case. Hence the question.

I will wait for the update on the timelines.

Thanks again.
Moiz

On Oct 12, 2017 5:26 PM, "Piotr Nowojski" <[hidden email]> wrote:
Hi,

Kafka 0.11 connector depends on some API changes for Flink 1.4, so without rebasing the code and solving some small issues it is not possible to use it for 1.3.x.

We are about to finalizing the timeframe for 1.4 release, it would be great if you could come back with this question after the weekend.

If you do not need exactly-once Kafka producer that will come with Kafka 0.11 connector, you should be able to use 0.10 connector to read (exactly-once) and write (at-least-once) to Kafka 0.11.

Piotrek

> On 12 Oct 2017, at 10:44, Syed Moizuddin <[hidden email]> wrote:
>
> Hi,
>
> I was just wondering if I could use the Kafka 11 connector on 1.3.
> If there are dependencies, then what would be the timeframe for 1.4 release
>
> Thanks
> Moiz