Re: User metrics outside tasks

Posted by Arvid Heise-4 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/User-metrics-outside-tasks-tp42107p42188.html

Hi Bob and Alexey,

I double-checked and there is currently no way to achieve what you want.

The good news is that the OOM part should be addressed through FLINK-20833 [1], maybe it's even suitable for other issues.

A "workaround" (I don't think it's a workaround) for your issues would actually be to check the logs and automatically parse certain patterns. That should be a common setup for all big data applications. Here you are free to emit whatever you want. The parsed entries should go into your metric systems if applicable.

[1] https://issues.apache.org/jira/browse/FLINK-20833

On Thu, Mar 11, 2021 at 6:05 PM Bob Tiernay <[hidden email]> wrote:

I too think this would be a useful capability for the job manager to be able
to send metrics easily. Sometimes additional compute responsibilities are
placed in the job manager and having a convenient way to add telemetry data
into a metrics stream would be very useful.



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/