User Interface not showing the actual count received and produced

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

User Interface not showing the actual count received and produced

PoolakkalMukkath, Shakir

Hi Flink team, 

 

I am developing a flow which uses  

·         FlinkKafkaConsumer010 to consume message from Kafka  and

·         FlinkKinesisProducer to produce the results to Kinesis.

 

In the user interface, I always see Bytes and Record received from Kafka is zero even though it is receiving events and processing.  And same with Kinesis Sink, Bytes and record sent is always zero even though it is posting events to Kinesis. 

 

Any reason why my UI is not showing the actual count ? Thanks  

 

 

Thanks,

Shakir

 

Reply | Threaded
Open this post in threaded view
|

Re: User Interface not showing the actual count received and produced

Chesnay Schepler
Flink currently does not measure incoming records for sources and outgoing records for sink, see https://issues.apache.org/jira/browse/FLINK-7286.

On 15/05/2019 19:43, PoolakkalMukkath, Shakir wrote:

Hi Flink team, 

 

I am developing a flow which uses  

·         FlinkKafkaConsumer010 to consume message from Kafka  and

·         FlinkKinesisProducer to produce the results to Kinesis.

 

In the user interface, I always see Bytes and Record received from Kafka is zero even though it is receiving events and processing.  And same with Kinesis Sink, Bytes and record sent is always zero even though it is posting events to Kinesis. 

 

Any reason why my UI is not showing the actual count ? Thanks  

 

 

Thanks,

Shakir