Elasticsearch Http Connector

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Elasticsearch Http Connector

Madhukar Thota
Friends

Any one using new Elasticsearch RestClient(https://www.elastic.co/guide/en/elasticsearch/client/java-rest/current/index.html) with Flink? 


Reply | Threaded
Open this post in threaded view
|

Re: Elasticsearch Http Connector

Philipp Bussche
Hi there,
not me (which I guess is not what you wanted to hear) but I had to implement a custom ElasticSearch based on Jest to be able to sink data into ES on AWS. Works quite alright !
Philipp

https://github.com/searchbox-io/Jest/tree/master/jest
Reply | Threaded
Open this post in threaded view
|

Re: Elasticsearch Http Connector

Madhukar Thota
Thanks Philipp,

I am also started looking at Jest client. Did you use it with Flink? is possible for you to share the project so that i can reuse it?


On Tue, Oct 25, 2016 at 11:54 AM, Philipp Bussche <[hidden email]> wrote:
Hi there,
not me (which I guess is not what you wanted to hear) but I had to implement
a custom ElasticSearch based on Jest to be able to sink data into ES on AWS.
Works quite alright !
Philipp

https://github.com/searchbox-io/Jest/tree/master/jest



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Elasticsearch-Http-Connector-tp9700p9715.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Reply | Threaded
Open this post in threaded view
|

Re: Elasticsearch Http Connector

Philipp Bussche
Hi,
yes I wrote an ElasticSearch Sink for Flink that uses Jest.
Sure, I will make something available for you. Just travelling at the moment so this will be a few hours before it is there.
Thanks
Reply | Threaded
Open this post in threaded view
|

Re: Elasticsearch Http Connector

Timur Shenkao
Hi!

For ElasticSearch HTTP Conector example, one may look at Flume's ElasticSearchSink https://github.com/apache/flume/tree/trunk/flume-ng-sinks/flume-ng-elasticsearch-sink

It uses Apache Commons HTTPComponent

On Wed, Oct 26, 2016 at 9:51 AM, Philipp Bussche <[hidden email]> wrote:
Hi,
yes I wrote an ElasticSearch Sink for Flink that uses Jest.
Sure, I will make something available for you. Just travelling at the moment
so this will be a few hours before it is there.
Thanks



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Elasticsearch-Http-Connector-tp9700p9718.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.