Latency and Throughput

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Latency and Throughput

Paolo Cristofanelli
Hi, 
it is my first question that I am asking in this mailing list, so I hope you would forgive me if I miss something. 
I have started using flink recently, and now I would like to compute some statistics, like throughput and latency, for my programs. 
I was reading this URL from the documentation ( https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html ), but I do not understand how to use meters and how to measure latency from this classes. 

Thank for you time,
Best Regards
Paolo
Reply | Threaded
Open this post in threaded view
|

Re: Latency and Throughput

Chesnay Schepler
Hello,

You don't have to measure anything yourself, since Flink exposes
throughput/latency metrics as described in the System metrics/latency
tracking sections of the metrics documentation.

You only have to setup a reporter that fetches these metrics (see the
reporter section) and calculate sum/averages across the job.

Regards,
Chesnay

On 16.06.2017 14:42, Paolo Cristofanelli wrote:

> Hi,
> it is my first question that I am asking in this mailing list, so I
> hope you would forgive me if I miss something.
> I have started using flink recently, and now I would like to compute
> some statistics, like throughput and latency, for my programs.
> I was reading this URL from the documentation (
> https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html 
> ), but I do not understand how to use meters and how to measure
> latency from this classes.
> I have also asked on stack overflow. (
> https://stackoverflow.com/questions/44587645/throughput-and-latency-on-apache-flink 
> )
>
> Thank for you time,
> Best Regards
> Paolo