relating tumbling windows to each other

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

relating tumbling windows to each other

Marco Villalobos-2
GIVEN two windows (ProcessWindowFunction), window A, and window B,
AND window A is a tumbling processing time window of 15 minutes
AND 200000 records entered window A, and performs its business logic.

How can I assure that Window B will process exactly all the records
that left window A within the same window?
Reply | Threaded
Open this post in threaded view
|

Re: relating tumbling windows to each other

Marco Villalobos-2
I need to elaborate on my use case.  I would like the SQL api to do
aggregation for me in an SQL TUMBLING window.
But I want the next window to perform business logic on all the
records just aggregated in a DataStream ProcessWindowFunction.
This would be a mix of SQL and DataStream API.

On Tue, Dec 8, 2020 at 1:29 PM Marco Villalobos
<[hidden email]> wrote:
>
> GIVEN two windows (ProcessWindowFunction), window A, and window B,
> AND window A is a tumbling processing time window of 15 minutes
> AND 200000 records entered window A, and performs its business logic.
>
> How can I assure that Window B will process exactly all the records
> that left window A within the same window?