Move already process file from one folder to another folder in flink

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Move already process file from one folder to another folder in flink

Samir Vasani
I am a new bee to flink.

There is a use case where i want to read a csv file using flink pipeline .

Flink pipeline will be written in Java.

This flink job will read file data row by row and will put each single row on Kafka topic. I have a query here

With above requirement after readin all rows from csv i want to move the file to another foler say history.
So that flink job will read data only from the new file and not from already processed file. So how can i achieve this?