Batch Flink Job S3 write performance vs Spark

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Batch Flink Job S3 write performance vs Spark

sri hari kali charan Tummala
Hi All, 

have a question did anyone compared the performance of Flink batch job writing to s3 vs spark writing to s3? 

--
Thanks & Regards
Sri Tummala

Reply | Threaded
Open this post in threaded view
|

Re: Batch Flink Job S3 write performance vs Spark

rmetzger0
Hey,

I don't think there will be a big performance difference. Both systems have many users writing data to S3, so this will be optimized for both.

On Tue, Feb 25, 2020 at 6:03 PM sri hari kali charan Tummala <[hidden email]> wrote:
Hi All, 

have a question did anyone compared the performance of Flink batch job writing to s3 vs spark writing to s3? 

--
Thanks & Regards
Sri Tummala