Sliding window based on event arrival

[Miyuru Dayarathna]

Hi,

I need to create a sliding window of 4 events in Flink streaming application. The window should slide by one event per every new arriving event. Furthermore, per each new arriving event I need to calculate the aggregate sum of a particular field in the 4 events I have in the window. I have referred [1] which describes how this can be implemented based on time. But my use case if little different, hence I am wondering how the window can be slided when a new event gets added to the window.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/operators/windows.html#sliding-windows

Thanks,

Miyuru

[Xingcan Cui]

Hi Miyuru,

what you need should be something like a `SlidingCountWindow`. Flink Datastream API has already provided a `countWindow()` method for that and a related example can be found here.

Hope that helps,

Xingcan

On 12 Mar 2018, at 1:33 PM, Miyuru Dayarathna <[hidden email]> wrote:

Hi,

I need to create a sliding window of 4 events in Flink streaming application. The window should slide by one event per every new arriving event. Furthermore, per each new arriving event I need to calculate the aggregate sum of a particular field in the 4 events I have in the window. I have referred [1] which describes how this can be implemented based on time. But my use case if little different, hence I am wondering how the window can be slided when a new event gets added to the window.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/operators/windows.html#sliding-windows

Thanks,

Miyuru

[Miyuru Dayarathna]

Hi Xingcan,

Thanks for the clarification. I was able to implement the scenario with the example you provided.

Thanks,

Miyuru

On Monday, 12 March 2018, 12:53, Xingcan Cui <[hidden email]> wrote:

Hi Miyuru,

what you need should be something like a `SlidingCountWindow`. Flink Datastream API has already provided a `countWindow()` method for that and a related example can be found here.

Hope that helps,

Xingcan

On 12 Mar 2018, at 1:33 PM, Miyuru Dayarathna <[hidden email]> wrote:

Hi,

I need to create a sliding window of 4 events in Flink streaming application. The window should slide by one event per every new arriving event. Furthermore, per each new arriving event I need to calculate the aggregate sum of a particular field in the 4 events I have in the window. I have referred [1] which describes how this can be implemented based on time. But my use case if little different, hence I am wondering how the window can be slided when a new event gets added to the window.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/operators/windows.html#sliding-windows

Thanks,

Miyuru