Conflicting Cassandra versions while using flink-connector-cassandra

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Conflicting Cassandra versions while using flink-connector-cassandra

GustavoVM
I'm having trouble using CassandraSink while also using datastax's cassandra-driver. While digging trough  the flink-connector-cassandra.jar I realized that it bundles cassandra-driver-core 3.0.0 while internally we use version 3.1.4 to read data from Cassandra.

I couldn't find the reason why the connector comes bundled with the driver classes and I don't know what would be the best course of action to make both driver versions coexist.

Best regards,
Gustavo Momenté
Reply | Threaded
Open this post in threaded view
|

Re: Conflicting Cassandra versions while using flink-connector-cassandra

Congxian Qiu
Hi Gustavo Momenté
If you want the both driver versions coexist, maybe you could try maven shade plugin[1]


Best, Congxian
On Mar 13, 2019, 02:22 +0800, Gustavo Momenté <[hidden email]>, wrote:
I'm having trouble using CassandraSink while also using datastax's cassandra-driver. While digging trough  the flink-connector-cassandra.jar I realized that it bundles cassandra-driver-core 3.0.0 while internally we use version 3.1.4 to read data from Cassandra.

I couldn't find the reason why the connector comes bundled with the driver classes and I don't know what would be the best course of action to make both driver versions coexist.

Best regards,
Gustavo Momenté
Reply | Threaded
Open this post in threaded view
|

Re: Conflicting Cassandra versions while using flink-connector-cassandra

GustavoVM
Can I shade `flink-connector-cassandra` version? And if so do you know why it isn't shaded by default?

Em ter, 12 de mar de 2019 às 23:00, Congxian Qiu <[hidden email]> escreveu:
Hi Gustavo Momenté
If you want the both driver versions coexist, maybe you could try maven shade plugin[1]


Best, Congxian
On Mar 13, 2019, 02:22 +0800, Gustavo Momenté <[hidden email]>, wrote:
I'm having trouble using CassandraSink while also using datastax's cassandra-driver. While digging trough  the flink-connector-cassandra.jar I realized that it bundles cassandra-driver-core 3.0.0 while internally we use version 3.1.4 to read data from Cassandra.

I couldn't find the reason why the connector comes bundled with the driver classes and I don't know what would be the best course of action to make both driver versions coexist.

Best regards,
Gustavo Momenté
Reply | Threaded
Open this post in threaded view
|

Re: Conflicting Cassandra versions while using flink-connector-cassandra

GustavoVM
Just created a PR trying to address this issue: https://github.com/apache/flink/pull/7980 what do you think?

Em ter, 12 de mar de 2019 às 23:23, Gustavo Momenté <[hidden email]> escreveu:
Can I shade `flink-connector-cassandra` version? And if so do you know why it isn't shaded by default?

Em ter, 12 de mar de 2019 às 23:00, Congxian Qiu <[hidden email]> escreveu:
Hi Gustavo Momenté
If you want the both driver versions coexist, maybe you could try maven shade plugin[1]


Best, Congxian
On Mar 13, 2019, 02:22 +0800, Gustavo Momenté <[hidden email]>, wrote:
I'm having trouble using CassandraSink while also using datastax's cassandra-driver. While digging trough  the flink-connector-cassandra.jar I realized that it bundles cassandra-driver-core 3.0.0 while internally we use version 3.1.4 to read data from Cassandra.

I couldn't find the reason why the connector comes bundled with the driver classes and I don't know what would be the best course of action to make both driver versions coexist.

Best regards,
Gustavo Momenté