Re: Upserts with Flink-elasticsearch

Posted by Suneel Marthi on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Upserts-with-Flink-elasticsearch-tp5767p5770.html

Would it be useful to modify the existing Elasticsearch 1x sink to be able to handle Upserts ?

On Mon, Mar 28, 2016 at 5:32 PM, Zach Cox <[hidden email]> wrote:

Hi Madhukar - with the current Elasticsearch sink in Flink 1.0.0 [1], I don't think an upsert is possible, since IndexRequestBuilder can only return an IndexRequest.

In Flink 1.1, the Elasticsearch 2.x sink [2] provides a RequestIndexer [3] that you can pass an UpdateRequest to do an upsert.

Thanks,

Zach

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/streaming/connectors/elasticsearch.html

[2] https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/connectors/elasticsearch2.html

[3] https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/streaming/connectors/elasticsearch2/RequestIndexer.html

On Mon, Mar 28, 2016 at 2:18 PM Madhukar Thota <[hidden email]> wrote:

Is it possible to do Upsert with existing flink-elasticsearch connector today?