Sink Multiple Stream Elastic search

[shashank734]

Hello,

I am using Elastic search5 Connector. Can I use same connection while
sinking multiple streams to Elastic search? Currently, I think it creates a
different transport connection for each sink. I think it's creating a lot of
connections with the cluster. Cause I am sinking 5-6 streams.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Timo Walther]

Hi,

I'm not aware that multiple Flink operators can share transport
connections. They usually perform independent communication with the
target system. If the pressure is too high for Elasticsearch, have you
thought about reducing the parallelism of the sink. Also the buffering
options could help [1].

Regards,
Timo

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/connectors/elasticsearch.html#configuring-the-internal-bulk-processor

Am 02.08.18 um 13:51 schrieb shashank734:

> Hello,
>
> I am using Elastic search5 Connector. Can I use same connection while
> sinking multiple streams to Elastic search? Currently, I think it creates a
> different transport connection for each sink. I think it's creating a lot of
> connections with the cluster. Cause I am sinking 5-6 streams.
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/