Re: Flink Kafka consumer with low latency requirement

Posted by Fabian Hueske-2 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Kafka-consumer-with-low-latency-requirement-tp28368p28397.html

Hi,

What kind of function do you use to implement the operator that has the blocking call?

Did you have a look at the AsyncIO operator? It was designed for exactly such use cases.

It issues multiple asynchronous requests to an external service and waits for the response.

Best, Fabian

Am Mo., 24. Juni 2019 um 17:01 Uhr schrieb xwang355 <[hidden email]>:

Fabian,

Does the above stack trace looks like a deadlock?

        at
org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.getNextBufferOrEvent(SingleInputGate.java:539)
        - locked <0x00000007baf84040> (a java.util.ArrayDeque)
        at
org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.getNextBufferOrEvent(SingleInputGate.java:508)



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/