Metrics for the overall pipeline

[Manish G]

Adding metrics to individual RichMapFunction implementation classes would give metrics information about that particular class.

As a pipeline consists of multiple such classes, how can we have metrics for the overall data pipeline?Are there any best practices for it?

With regards

[Chesnay Schepler]

You could create an abstract class that extends AbstractRichFunction,
and all your remaining functions extend that class and implement the
respective (Map/etc.)Function interface.

On 06/08/2020 13:20, Manish G wrote:
> Adding metrics to individual RichMapFunction implementation classes
> would give metrics information about that particular class.
>
> As a pipeline consists of multiple such classes, how can we have
> metrics for the overall data pipeline?Are there any best practices for it?
>
> With regards