See lag end-to-end

[Rex Fenley]

Hello,

Is there some proxy to seeing the relative time it takes for records to make it through an entire job plan? Maybe checkpoint alignment time would be a proxy for this? Is there metrics for that or something else that would provide signal here?

Thanks!

--

[Yun Gao]

Hi Rex,

   I think Latency Marker is what you need [1].

Best,

 Yun

[1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/metrics.html#latency-tracking

------------------------------------------------------------------
Sender:Rex Fenley<[hidden email]>
Date:2020/12/21 04:57:59
Recipient:user<[hidden email]>
Cc:Brad Davis<[hidden email]>
Theme:See lag end-to-end

Hello,

Is there some proxy to seeing the relative time it takes for records to make it through an entire job plan? Maybe checkpoint alignment time would be a proxy for this? Is there metrics for that or something else that would provide signal here?

Thanks!

--