Flink1.10 Cluster's Received is zero in the web when consume from Kafka0.11

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink1.10 Cluster's Received is zero in the web when consume from Kafka0.11

Jim Chen
Hi, all
  When I use flink-connector-kafka-0.11 consume Kafka0.11, the Cluster web's Received Record is always 0. However, the log is not empty. Any one can help me?

image.png
Reply | Threaded
Open this post in threaded view
|

Re: Flink1.10 Cluster's Received is zero in the web when consume from Kafka0.11

Chesnay Schepler
This is a known limitation, see https://issues.apache.org/jira/browse/FLINK-7286 .

As a crude workaround you may either break the chain after the source / before the sink, or query the numRecordsOut metric for the source / numRecordsIn metric for the sink via the WebUI metrics tab or REST API.

On 25/03/2020 10:49, Jim Chen wrote:
Hi, all
  When I use flink-connector-kafka-0.11 consume Kafka0.11, the Cluster web's Received Record is always 0. However, the log is not empty. Any one can help me?

image.png


Reply | Threaded
Open this post in threaded view
|

Re: Flink1.10 Cluster's Received is zero in the web when consume from Kafka0.11

Jim Chen
Thanks for the tip! 

May be call env.disableOperatorChaining() can show the received on the dashborad

Chesnay Schepler <[hidden email]> 于2020年3月25日周三 下午5:56写道:
This is a known limitation, see https://issues.apache.org/jira/browse/FLINK-7286 .

As a crude workaround you may either break the chain after the source / before the sink, or query the numRecordsOut metric for the source / numRecordsIn metric for the sink via the WebUI metrics tab or REST API.

On 25/03/2020 10:49, Jim Chen wrote:
Hi, all
  When I use flink-connector-kafka-0.11 consume Kafka0.11, the Cluster web's Received Record is always 0. However, the log is not empty. Any one can help me?

image.png