Buffer congestion in a downstream operator hangs SourceContext.collect in an (in?)finite loop

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Buffer congestion in a downstream operator hangs SourceContext.collect in an (in?)finite loop

Oleh Lukyrych
Hello,

I have a scenario, where FlinkKafkaProducer instance isn't able to write to a certain partition (the broker for the partition is down, or whatever), it's buffer eventually becomes full, and the whole topology freezes, because the root source (nonparallel) get's blocked on it, however it could still serve other branches/partitions.


What can be wrong, could you suggest anything?

Respectfully,
Oleh.