Hello folks,
My question is about Kafka client metrics exported by Flink. According to the Flink
documentation: "
The producers export Kafka’s internal metrics through Flink’s metric system for all supported versions. The consumers export all metrics starting from Kafka version 0.9. The Kafka documentation lists all exported metrics in its documentation", which points to Kafka documentation for all exported metrics. In the referenced Kafka doc, there are three types of metrics that are exported, partition level, topic level and client level. For example, for consumer fetch metrics, three categories are:
kafka.consumer:type=consumer-fetch-manager-metrics,client-id="{client-id}"
kafka.consumer:type=consumer-fetch-manager-metrics,client-id="{client-id}",topic="{topic}"
kafka.consumer:type=consumer-fetch-manager-metrics,partition="{partition}",topic="{topic}",client-id="{client-id}"
But somehow I only see client-level metrics, not topic- or partition-level ones. Does anyone know why that is the case? Does Flink filter exported Kafka metrics?