Flink Load multiple file

[Soheil Pourbafrani]

Hi,

I want to load multiple file and apply the processing logic on them. After some searches using the following code I can load all the files in the directory named "input" into Flink:

TextInputFormat tif = new TextInputFormat(new Path("input"));
DataSet<String> raw = env.readFile(tif, "input//");

If I understood correctly the second / in following of the directory path will force Flink to load all files in the directory. But I don't know when creating the TextInputFormat object, why we should pass the path! what is it's fuctionality?

I also want to know is there a way to pass the path of multiple file exactly without any regular expression? for example:

DataSet<String> raw = env.readFile(tif, "input/data1, input/data2");

And pls inform me if a better way for loading multiple files exists. 

Thanks