flink with kafka 0.7

[Martin Neumann]

Hej,

I want to connect Flink streaming to a Kafka 0.7 cluster.

Will this work with the latest release or does the Kafka implementation rely on kafka 0.8?

cheers Martin

[Stephan Ewen]

We tested it only with Kafka 0.8.1 upwards.

I know nobody that used it with Kafka < 0.8 before. You can give it a try, let us know if it works...

BTW: I think Kafka 0.7 has so many open problems, if you can, may be worth upgrading...

On Mon, Sep 14, 2015 at 11:00 PM, Martin Neumann <[hidden email]> wrote:

Hej,

I want to connect Flink streaming to a Kafka 0.7 cluster.

Will this work with the latest release or does the Kafka implementation rely on kafka 0.8?

cheers Martin

[rmetzger0]

I don't think its working.

According to the Kafka documentation (https://kafka.apache.org/documentation.html#upgrade):

0.8, the release in which added replication, was our first backwards-incompatible release: major changes were made to the API, ZooKeeper data structures, and protocol, and configuration. The upgrade from 0.7 to 0.8.x requires a special tool for migration. This migration can be done without downtime.

Since they changed the protocols I doubt that our client API can read from the old brokers.

On Tue, Sep 15, 2015 at 8:26 AM, Stephan Ewen <[hidden email]> wrote:

We tested it only with Kafka 0.8.1 upwards.

I know nobody that used it with Kafka < 0.8 before. You can give it a try, let us know if it works...

BTW: I think Kafka 0.7 has so many open problems, if you can, may be worth upgrading...

On Mon, Sep 14, 2015 at 11:00 PM, Martin Neumann <[hidden email]> wrote:

Hej,

I want to connect Flink streaming to a Kafka 0.7 cluster.

Will this work with the latest release or does the Kafka implementation rely on kafka 0.8?

cheers Martin