DataStream API in Batch Execution mode

Posted by Marco Villalobos-2 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/DataStream-API-in-Batch-Execution-mode-tp44264.html

How do I use a hierarchical directory structure as a file source in S3 when using the DataStream API in Batch Execution mode?

I have been trying to find out if the API supports that, because currently our data is organized by years, halves, quarters, months, and but before I launch the job, I flatten the file structure just to process the right set of files.