Login  Register

Flink Table SQL and MongoDB connector?

classic Classic list List threaded Threaded
2 messages Options Options
Embed post
Permalink
Dan
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

Flink Table SQL and MongoDB connector?

Dan
Has anyone connected these two?

Looking through previous emails and the Flink docs, I've see two mentions of how to hook up MongoDB to Flink.

1) https://github.com/okkam-it/flink-mongodb-test
2) Debezium->Kafka->Flink
The debezium route has more setup and maintenance work but scales better and probably has an easier hook for Table SQL (since it's Kafka). 
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

Re: Flink Table SQL and MongoDB connector?

Till Rohrmann
Hi Dan,

afaik Flink does not have a dedicated MongoDB connector (except for the DataSet API which is rather old). Hence I believe that the 2nd option seems to be more promising.

Cheers,
Till

On Thu, Oct 22, 2020 at 6:45 AM Dan Hill <[hidden email]> wrote:
Has anyone connected these two?

Looking through previous emails and the Flink docs, I've see two mentions of how to hook up MongoDB to Flink.

1) https://github.com/okkam-it/flink-mongodb-test
2) Debezium->Kafka->Flink
The debezium route has more setup and maintenance work but scales better and probably has an easier hook for Table SQL (since it's Kafka).