RichAggregationFunction

[Steven Nelson]

I am trying to add some custom metrics to my window (because the window is causing a lot of backpressure). However I can't seem to use a RichAggregationFunction instead of an AggregationFunction. I am trying to see how long things get held in our EventTimeSessionWindows.withGap window. Is there another option for doing this?

-Steve

[Arvid Heise-3]

Hi Steven,

could you please provide more information. Which Flink version are you using? Why isn't RichAggregationFunction working for you?

In general, you always have the option to use a custom window assigner and delegate most of the calls to some provided implementation. Then you modify the behavior as you'd see it fit.

On Tue, Jun 23, 2020 at 11:40 PM Steven Nelson <[hidden email]> wrote:

I am trying to add some custom metrics to my window (because the window is causing a lot of backpressure). However I can't seem to use a RichAggregationFunction instead of an AggregationFunction. I am trying to see how long things get held in our EventTimeSessionWindows.withGap window. Is there another option for doing this?

-Steve

--

[Seth Wiesman]

Hi Steven, 

AggregationFunctions (along with Reduce and other “pre aggregation” functions) are not allowed to be Rich.

In general if you need to go outside the predefined bounds of what the window operator provides I’d encourage you to take a look at a KeyedProcessFunction.

Seth 

On Wed, Jun 24, 2020 at 3:07 PM Arvid Heise <[hidden email]> wrote:

Hi Steven,

could you please provide more information. Which Flink version are you using? Why isn't RichAggregationFunction working for you?

In general, you always have the option to use a custom window assigner and delegate most of the calls to some provided implementation. Then you modify the behavior as you'd see it fit.

On Tue, Jun 23, 2020 at 11:40 PM Steven Nelson <[hidden email]> wrote:

I am trying to add some custom metrics to my window (because the window is causing a lot of backpressure). However I can't seem to use a RichAggregationFunction instead of an AggregationFunction. I am trying to see how long things get held in our EventTimeSessionWindows.withGap window. Is there another option for doing this?

-Steve

--

Arvid Heise | Senior Java Developer

Follow us @VervericaData

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Toni) Cheng