Re: About KafkaConsumerBase

Posted by Tzu-Li (Gordon) Tai on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/About-KafkaConsumerBase-tp14601p14620.html

Hi,

it maintain itself a individual instance of 
FlinkKafkaConsumerBase, and it contains a individual pendingOffsetsToCommit 
, am right ? 

That is correct! The FlinkKafkaConsumerBase is code executed for each parallel subtask instance, and therefore have their own pendingOffsetsToCommit which would not be manipulated / accessed concurrently.

The only places where that map is accessed is in the snapshotState and notifyCheckpointComplete method, which I think is guaranteed to not be concurrently called.

Cheers,

Gordon

On 2 August 2017 at 1:02:57 PM, aitozi ([hidden email]) wrote:

Hi,Piotr Nowojski

i think you are right, but i think it is executed in parallel, but in
each parallel , it maintain itself a individual instance of
FlinkKafkaConsumerBase, and it contains a individual pendingOffsetsToCommit
, am right ?

thanks, aitozi



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/About-KafkaConsumerBase-tp14601p14619.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.