Re: Flink Kafka runtime error

Posted by Stephan Ewen on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Kafka-runtime-error-tp2063p2138.html

Hi Wendong!

The streaming connectors are not in Flink's "system classpath", because they depend on many libraries (zookeeper, asm, protocol buffers), and we want to keep the default dependencies slim. This reduces version conflicts for people where the user code depends on these libraries.

As a consequence, you need to do one of the two things when using a connector:

  - The recommended solution is to build a fat jar of you user code and the connector (with its dependencies). The maven quickstart archetypes take care of that.

  - The other solution (if you do not want to build a fat jar) is to manually add the connector code to the Flink lib directory (as you did).

Greetings,

Stephan

On Wed, Jul 15, 2015 at 9:01 PM, Wendong <[hidden email]> wrote:

Just found a workaround. I downloaded kafka_2.10-0.8.2.1.jar and
flink-connector-kafka-0.9.0.jar, then put them into $FLINK_HOME/lib/. Now
the runtime error is gone. But this is just a workaound. I believe there is
a better solution.

Wendong



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-runtime-error-tp2063p2064.html

Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.