how to unit test streaming window jobs?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

how to unit test streaming window jobs?

Luis Mariano Guerra
hi,

 is there a way to test window jobs?

I would like to build the job, give some inputs, "fast forward" to the next window, collect the results and assert them.
Reply | Threaded
Open this post in threaded view
|

Re: how to unit test streaming window jobs?

rmetzger0
Hi Luis,

using Event Time windows, you should be able to generate some test data and get predictable results.
Flink is internally using similar tests to ensure correctness of the windowing implementation (for example the EventTimeWindowCheckpointingITCase).

Regards,
Robert

On Mon, Sep 12, 2016 at 6:27 PM, Luis Mariano Guerra <[hidden email]> wrote:
hi,

 is there a way to test window jobs?

I would like to build the job, give some inputs, "fast forward" to the next window, collect the results and assert them.