Re: Proper way to establish bucket counts

Posted by Fabian Hueske-2 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Proper-way-to-establish-bucket-counts-tp14613p14627.html

Hi Robert,

Flink collects many metrics by default, including the number of records / events that go into each operator (see [1], System Metrics, IO, "numRecordsIn").

So, you would only need to access that metric.

Best, Fabian

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/metrics.html

2017-08-01 18:56 GMT+02:00 Robert Rapplean <[hidden email]>:

I want a count of events that are put into a bucketing sink, but can't find a ready-made way of doing that. Is there an easier way than to implement a counter for each bucket via the metrics? If metrics counters is the easy way, what do I do to make sure that I don't have a memory leak from expired counters?

Thanks,

Robert