Custom Metrics Reporting in Flink

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Custom Metrics Reporting in Flink

Rahul Raj
Hi,

Is there any good example for custom metrics reporting in Flink? I tried to follow the documentation but failed to achieve the result. Basically my task is to identify the corrupt records based on a missing field and report the same via statsd reporter.


Rahul Raj
Reply | Threaded
Open this post in threaded view
|

Re: Custom Metrics Reporting in Flink

Chesnay Schepler
This doesn't sound like a proper use-case for the metric system, but for
side-outputs with a dedicated sink.

My reasoning is that it sounds like you want to push data, whereas the
metrics work by drawing a snapshot of all metrics
and writing them out, i.e. one value per metric.

On 03.10.2017 13:51, Rahul Raj wrote:
> Hi,
>
> Is there any good example for custom metrics reporting in Flink? I
> tried to follow the documentation but failed to achieve the result.
> Basically my task is to identify the corrupt records based on a
> missing field and report the same via statsd reporter.
>
>
> Rahul Raj