Sink - Cassandra

[syepes]

Hello,

I have just started testing out Flink and would like to migrate one of my Spark Streaming jobs (Kafka->Spark->C*) to Flink.

- Is there anyone using with Flink with Cassandra?
- Does there exist a working Cassandra Sink, the only thing I have found is: https://github.com/rzvoncek/flink/tree/2b281120f4206c4fd66bec22090e0b6d62ebb8ad/flink-staging/flink-cassandra

Regards,
Sebastian

[Aljoscha Krettek]

Hi Sebastian,
I’m afraid the people working on Flink don’t have much experience with Cassandra. Maybe you could look into the Elasticsearch sink and adapt it to write to Cassandra instead. That could be a valuable addition to Flink.

Cheers,
Aljoscha

> On 22 Dec 2015, at 14:36, syepes <[hidden email]> wrote:
>
> Hello,
>
> I have just started testing out Flink and would like to migrate one of my
> Spark Streaming jobs (Kafka->Spark->C*) to Flink.
>
> - Is there anyone using with Flink with Cassandra?
> - Does there exist a working Cassandra Sink, the only thing I have found is:
> https://github.com/rzvoncek/flink/tree/2b281120f4206c4fd66bec22090e0b6d62ebb8ad/flink-staging/flink-cassandra
>
> Regards,
> Sebastian
>
>
>
>
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Sink-Cassandra-tp4107.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[Nick Dimiduk-2]

Hi Sebastian,

I've had preliminary success with a steaming job that is Kafka -> Flink -> HBase (actually, Phoenix) using the Hadoop OutputFormat adapter. A little glue was required but it seems to work okay. My guess it it would be the same for Cassandra. Maybe that can get you started?

Good luck,

-Nick

On Tuesday, January 5, 2016, Aljoscha Krettek <[hidden email]> wrote:

Hi Sebastian,
I’m afraid the people working on Flink don’t have much experience with Cassandra. Maybe you could look into the Elasticsearch sink and adapt it to write to Cassandra instead. That could be a valuable addition to Flink.

Cheers,
Aljoscha
> On 22 Dec 2015, at 14:36, syepes <<a href="javascript:;" onclick="_e(event, &#39;cvml&#39;, &#39;[e-mail]&#39;)">syepes@...> wrote:
>
> Hello,
>
> I have just started testing out Flink and would like to migrate one of my
> Spark Streaming jobs (Kafka->Spark->C*) to Flink.
>
> - Is there anyone using with Flink with Cassandra?
> - Does there exist a working Cassandra Sink, the only thing I have found is:
> https://github.com/rzvoncek/flink/tree/2b281120f4206c4fd66bec22090e0b6d62ebb8ad/flink-staging/flink-cassandra
>
> Regards,
> Sebastian
>
>
>
>
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Sink-Cassandra-tp4107.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[nragon]

Hi Nick,

I'm trying to integrate Hbase with streaming. Did you accomplish good results(writes/s) with phoenix?
Can you share your code.

Thanks,
Nuno

[Nick Dimiduk]

Yes the approach works fine for my use-case; has been in "production" for quite some time. My implementation has some untested scenarios around job restarting and failures, so of course your mileage may vary.

On Mon, May 15, 2017 at 5:58 AM, nragon <[hidden email]> wrote:

Hi Nick,

I'm trying to integrate Hbase with streaming. Did you accomplish good
results(writes/s) with phoenix?
Can you share your code.

Thanks,
Nuno



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Sink-Cassandra-tp4107p13138.html

Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[nragon]

Nick,

Can you send some of your examples using phoenix?

Thanks