Backpressure on Window step

Posted by Nelson Steven on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Backpressure-on-Window-step-tp36631.html

Hello!

 

We are experiencing occasional backpressure on a Window function in our pipeline. The window is on a KeyedStream and is triggered by an EventTimeSessionWindows.withGap(Time.seconds(30)). The prior step does a fanout and we use the window to sort things into batches based on the Key for the keyed stream. We aren’t seeing an unreasonable amount of records (500-600/s) on a parallism of 32 (prior step has a parallelism of 4). We are as interested in learning out to debug the issue as we are in fixing the actual problem. Any ideas?

 

-Steve