|
Hi Kevin,
>> One approach I could see is using StreamingFileSinks, and validating the output files for a bounded stream.
This is a good approach from my point of view. Actually, the end to end tests in Flink also takes this kind of approach. This doesn't only apply for Python jobs, but also for Java / Scala / SQL jobs.
Regards, Dian Hi Dian Fu,
I meant testing in application development. When I'm developing a Pyflink Pipeline, are there any recommended approaches to testing the Flink application? For instance, how should we test applications end-to-end? Individual operators? I'm interested in the Datastream API.
One approach I could see is using StreamingFileSinks, and validating the output files for a bounded stream.
Hi,
Do you mean how to run Python unit test? If so, you could refer to [1] for more details.
Regards, Dian
|