Re: Deep Copy in FLINK, Kryo Copy is used in the different operator

Posted by Aljoscha Krettek on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Deep-Copy-in-FLINK-Kryo-Copy-is-used-in-the-different-operator-tp18288p18339.html

Hi,

You can disable those copies via ExecutionConfig.enableObjectReuse(), which you can get from the StreamExecutionEnvironment via getConfig().

Best,
Aljoscha

> On 12. Feb 2018, at 04:00, chen <[hidden email]> wrote:
>
> Actually our team have our own Stream Engine, we tested our engine and flink,
> find out when we aggregate the stream data, the throughput is decreasing
> very fast.
>
> So we catch the stack and find out a deep copy in flink.
>
> In different operator, there will be
> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy between
> in different operator.
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/