Maximum query and refresh rate for metrics from REST API

[Piper Piper]

Hello,

What is the recommended way to get metrics (such as CPU, Memory and user defined meters and gauges) at the highest frequency rate (i.e. with the highest/fastest refresh rate) such as every 500 milliseconds or less?

Is there any rate limiting by default on querying the REST API for metrics? I am querying the REST API every second but not seeing any change in the CPU load for every second, so I was wondering if there is any maximum frequency at which I can query it.

Thanks,

Piper

[Chesnay Schepler]

By default metrics are only updated every 10 seconds; this can be
controlled via
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/config.html#metrics-fetcher-update-interval.

On 9/17/2020 12:22 AM, Piper Piper wrote:

> Hello,
>
> What is the recommended way to get metrics (such as CPU, Memory and
> user defined meters and gauges) at the highest frequency rate (i.e.
> with the highest/fastest refresh rate) such as every 500 milliseconds
> or less?
>
> Is there any rate limiting by default on querying the REST API for
> metrics? I am querying the REST API every second but not seeing any
> change in the CPU load for every second, so I was wondering if there
> is any maximum frequency at which I can query it.
>
> Thanks,
>
> Piper

[Piper Piper]

Thank you, Chesnay!

On Thu, Sep 17, 2020, 3:59 AM Chesnay Schepler <[hidden email]> wrote:

By default metrics are only updated every 10 seconds; this can be
controlled via
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/config.html#metrics-fetcher-update-interval.

On 9/17/2020 12:22 AM, Piper Piper wrote:
> Hello,
>
> What is the recommended way to get metrics (such as CPU, Memory and
> user defined meters and gauges) at the highest frequency rate (i.e.
> with the highest/fastest refresh rate) such as every 500 milliseconds
> or less?
>
> Is there any rate limiting by default on querying the REST API for
> metrics? I am querying the REST API every second but not seeing any
> change in the CPU load for every second, so I was wondering if there
> is any maximum frequency at which I can query it.
>
> Thanks,
>
> Piper