Counter and guage metric are not populated consistently.

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Counter and guage metric are not populated consistently.

Ganesh Manal

Hi,

 

The custom counter/guage metric are generated only in special case.

 

Like if I execute wordcount example with hdfs file as input, I am able to see the counters.

But in case, wordcount is executed without hdfs file as input, i.e. using default Datasets, metric counters are not generated.

 

I am using flink 1.4.0.

Is there a specific configuration required for this ?

 

Thanks,

Ganesh Manal

 

Reply | Threaded
Open this post in threaded view
|

Re: Counter and guage metric are not populated consistently.

Chesnay Schepler
If a job finishes very quickly it commonly happens that metrics are not exposed; the WebUI periodically polls metrics, but the polling only works while the job is running. Reporters that expose metrics periodically show the same behavior.

On 27.04.2018 09:49, Ganesh Manal wrote:

Hi,

 

The custom counter/guage metric are generated only in special case.

 

Like if I execute wordcount example with hdfs file as input, I am able to see the counters.

But in case, wordcount is executed without hdfs file as input, i.e. using default Datasets, metric counters are not generated.

 

I am using flink 1.4.0.

Is there a specific configuration required for this ?

 

Thanks,

Ganesh Manal