Re: Kafka Consumer consuming rate suddenly dropped
Posted by
Jake on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Kafka-Consumer-consuming-rate-suddenly-dropped-tp36753p36754.html
Need some flink kafka consumer log and kafka server log!
Hi, community
I have a flink application consuming from a kafka topic with 60 partitions.
The parallelism of the source is set to 60, same with the topic partition number.
The cluster.evenly-spread-out-slots config is set to true in flink cluster.
However, several hours later, the consuming rate of some subtasks of the source suddenly dropped and caused delay.
There is no back pressure in the application as shown in the flink UI.
The consuming rate is like follows:
Is anyone also encountering the same problem?
Is there any way to further pinpoint the issue?
Thanks in advance!
Mu