Posted by Ruben Laguna on Oct 30, 2020; 12:21pm URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Can-I-get-the-filename-as-a-column-tp39096.html
I've asked this already on [stackoverflow][1]
Is there anything equivalent to Spark's `f.input_file_name()` ? I
don't see anything that could be used in [system functions][2]
I have a dataset where they embedded some information in the filenames
(200k files) and I need to extract that as a new column.
In Spark I could `
.withColumn("id",f.split(f.reverse(f.split(f.input_file_name(),'/'))[0],'\.')[0])`
but I don't see how can I do the same with Flink. Is it possible?
I don't see [any JIRA issue about it either][3]. Is it something that
has already been discussed?