Flink Metrics

[Govindarajan Srinivasaraghavan]

Hi,

I am currently using flink 1.2 snapshot and instrumenting my pipeline with flink metrics. One small suggestion I have is currently the Meter interface only supports getRate() which is always the one minute rate. 

It would great if all the rates (1 min, 5 min & 15 min) are exposed to get a better picture in terms of performance.

Also is there any reason why timers are not part of flink metrics core?

Regards,

Govind

[Till Rohrmann]

Hi Govind,

I think the DropwizardMeterWrapper implementation is just a reference implementation where it was decided to report the minute rate. You can define your own meter class which allows to configure the rate interval accordingly.

Concerning Timers, I think nobody requested this metric so far. If you want, then you can open a JIRA issue and contribute it. The community would really appreciate that.

Cheers,
Till

​

On Mon, Oct 17, 2016 at 5:26 AM, Govindarajan Srinivasaraghavan <[hidden email]> wrote:

Hi,

I am currently using flink 1.2 snapshot and instrumenting my pipeline with flink metrics. One small suggestion I have is currently the Meter interface only supports getRate() which is always the one minute rate. 

It would great if all the rates (1 min, 5 min & 15 min) are exposed to get a better picture in terms of performance.

Also is there any reason why timers are not part of flink metrics core?

Regards,

Govind

[Chesnay Schepler]

Hello,

we could also offer a small utility method that creates 3 flink meters, each reporting one rate of a DW meter.

Timers weren't added yet since, as Till said, no one requested them yet and we haven't found a proper internal use-case for them

Regards,
Chesnay

On 17.10.2016 09:52, Till Rohrmann wrote:

Hi Govind,

I think the DropwizardMeterWrapper implementation is just a reference implementation where it was decided to report the minute rate. You can define your own meter class which allows to configure the rate interval accordingly.

Concerning Timers, I think nobody requested this metric so far. If you want, then you can open a JIRA issue and contribute it. The community would really appreciate that.

Cheers,
Till

​

On Mon, Oct 17, 2016 at 5:26 AM, Govindarajan Srinivasaraghavan <[hidden email]> wrote:

Hi,

I am currently using flink 1.2 snapshot and instrumenting my pipeline with flink metrics. One small suggestion I have is currently the Meter interface only supports getRate() which is always the one minute rate. 

It would great if all the rates (1 min, 5 min & 15 min) are exposed to get a better picture in terms of performance.

Also is there any reason why timers are not part of flink metrics core?

Regards,

Govind

[amir bahmanyari]

Hi colleagues,

Is there a link that described Flink Matrices & provides example on how to utilize it pls?

I really appreciate it...

Cheers

---

From: Till Rohrmann <[hidden email]>
To: [hidden email]
Cc: [hidden email]
Sent: Monday, October 17, 2016 12:52 AM
Subject: Re: Flink Metrics

Hi Govind,

I think the DropwizardMeterWrapper implementation is just a reference
implementation where it was decided to report the minute rate. You can
define your own meter class which allows to configure the rate interval
accordingly.

Concerning Timers, I think nobody requested this metric so far. If you
want, then you can open a JIRA issue and contribute it. The community would
really appreciate that.

Cheers,
Till
​

On Mon, Oct 17, 2016 at 5:26 AM, Govindarajan Srinivasaraghavan <
[hidden email]> wrote:

> Hi,
>
> I am currently using flink 1.2 snapshot and instrumenting my pipeline with
> flink metrics. One small suggestion I have is currently the Meter interface
> only supports getRate() which is always the one minute rate.
>
> It would great if all the rates (1 min, 5 min & 15 min) are exposed to get
> a better picture in terms of performance.
>
> Also is there any reason why timers are not part of flink metrics core?
>
> Regards,
> Govind
>

[Aljoscha Krettek]

https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html

Or this: https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/metrics.html if you prefer Flink 1.1

On Mon, 17 Oct 2016 at 19:16 amir bahmanyari <[hidden email]> wrote:

Hi colleagues,

Is there a link that described Flink Matrices & provides example on how to utilize it pls?

I really appreciate it...

Cheers

---

From: Till Rohrmann <[hidden email]>
To: [hidden email]
Cc: [hidden email]
Sent: Monday, October 17, 2016 12:52 AM
Subject: Re: Flink Metrics

Hi Govind,

I think the DropwizardMeterWrapper implementation is just a reference
implementation where it was decided to report the minute rate. You can
define your own meter class which allows to configure the rate interval
accordingly.

Concerning Timers, I think nobody requested this metric so far. If you
want, then you can open a JIRA issue and contribute it. The community would
really appreciate that.

Cheers,
Till
​

On Mon, Oct 17, 2016 at 5:26 AM, Govindarajan Srinivasaraghavan <
[hidden email]> wrote:

> Hi,
>
> I am currently using flink 1.2 snapshot and instrumenting my pipeline with
> flink metrics. One small suggestion I have is currently the Meter interface
> only supports getRate() which is always the one minute rate.
>
> It would great if all the rates (1 min, 5 min & 15 min) are exposed to get
> a better picture in terms of performance.
>
> Also is there any reason why timers are not part of flink metrics core?
>
> Regards,
> Govind
>