Streaming API has a long delay at the beginning of the process.

Posted by Yuta Morisawa on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/heap-dump-shows-StoppableSourceStreamTask-retained-by-java-lang-finalizer-tp15535p15537.html

Hi,

I am worrying about the delay of the Streaming API.
My application is that it gets data from kafka-connectors and process
them, then push data to kafka-producers.
The problem is that the app suffers a long delay when the first data
come in the cluster.
It takes about 1000ms to process data (I measure the time with
kafka-timestamp). On the other hand, it works well after 2-3 seconds
first data come in (the delay is about 200ms).

The application is so delay sensitive that I want to solve this problem.
Now, I think this is a matter of JVM but I have no idea to investigate it.
Is there any way to avoid this delay?



Thank you for your attention
Yuta