Re: How many events can Flink process each second

Posted by Andres Angel on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/How-many-events-can-Flink-process-each-second-tp30643p30644.html

Hello A.V.

Id depends on the the underlying resources you are planing for your jobs. I mean memory and processing will play a principal role about this answer. keep in mind you are capable to break down your job in a number of parallel tasks by environment or even by an specific taks within your pipeline. 

I have scale my jobs up to around 1M per second without any trouble but keep in mind it depends as well on how complex look your pipeline likewise. Unlike the capabilities of parallel processing likely your pipeline applies enrichment and transformation reading data from an external ecosystem that can bring additional overload over your benchmark. Briefly, you should demo your scenario and get your own conclusions , but without any doubt Flink is capable of many stream processing records.

thanks 

AU 

On Wed, Oct 23, 2019 at 10:24 AM A. V. <[hidden email]> wrote:

Hi,

My boss wants to know how many events Flink can process, analyse etc. per second? I cant find this in the documentation.