Combined streams backpressure

Posted by Adam Venger on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Combined-streams-backpressure-tp37906.html

Hi.
I'm thinking about a solution to a problem I have. I need to create keyed session windows from multiple streams of data. Combining streams is done by watermarks. The problem is, one of the streams can be slower. This opens too many windows that wait for the stream to catch up, which wastes resources, slows down checkpointing and access. I was thinking about some way to detect this and stop reading from the faster streams which should create backpressure. Is it something that is possible now? If not, would there be any interest in adding this feature by me? If it would be a more complex problem, I would like to make a master thesis form it.

Adam