Global latency metrics

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Global latency metrics

shimin yang
Hi All,

Is there a method to get the global latency directly? Since I only find the latency for each operator in the Flink Rest API.

Best,

Shimin
Reply | Threaded
Open this post in threaded view
|

Re: Global latency metrics

Chesnay Schepler
No, you can only get the latency for each operator.

For starters, how would a global latency even account for multiple
sources/sink?

On 17.07.2018 10:22, shimin yang wrote:
> Hi All,
>
> Is there a method to get the global latency directly? Since I only
> find the latency for each operator in the Flink Rest API.
>
> Best,
>
> Shimin


Reply | Threaded
Open this post in threaded view
|

Re: Global latency metrics

vino yang
Hi shimin,

For some scenario, your requirement is necessary. And sometimes, we want to know the total throughput, latency and the event processing rate end-to-end. But currently, Flink can not support the global metrics. 

To Chesnay,

I think it's a good feature the community can consider.

Thanks, vino.


2018-07-17 17:58 GMT+08:00 Chesnay Schepler <[hidden email]>:
No, you can only get the latency for each operator.

For starters, how would a global latency even account for multiple sources/sink?


On 17.07.2018 10:22, shimin yang wrote:
Hi All,

Is there a method to get the global latency directly? Since I only find the latency for each operator in the Flink Rest API.

Best,

Shimin