Add header to a file produced using the writeAsFormattedText method

[Papadopoulos, Konstantinos]

Hi all,

 

I am trying to produce a file from a dataset using the writeAsFormattedText method (e.g., data.writeAsFormattedText(filename, writeMode, formatter)).

Is there any easy way to add a header to the file produced?

 

Thanks in advance,

Konstantinos

[Fabian Hueske-2]

Hi Konstantinos,

Writing headers to files is currently not supported by the underlying TextOutputFormat.

You can implement a custom OutputFormat by extending TextOutputFormat to add this functionality.

Best, Fabian

Am Fr., 1. Feb. 2019 um 16:04 Uhr schrieb Papadopoulos, Konstantinos <[hidden email]>:

Hi all,

 

I am trying to produce a file from a dataset using the writeAsFormattedText method (e.g., data.writeAsFormattedText(filename, writeMode, formatter)).

Is there any easy way to add a header to the file produced?

 

Thanks in advance,

Konstantinos

[Papadopoulos, Konstantinos]

Hi Fabian,

 

Do you know if there is any plan Flink core framework to support such functionality?

 

Best,

Konstantinos

 

From: Fabian Hueske <[hidden email]>
Sent: Δευτέρα, 4 Φεβρουαρίου 2019 3:49 μμ
To: Papadopoulos, Konstantinos <[hidden email]>
Cc: [hidden email]
Subject: Re: Add header to a file produced using the writeAsFormattedText method

 

Hi Konstantinos,

 

Writing headers to files is currently not supported by the underlying TextOutputFormat.

You can implement a custom OutputFormat by extending TextOutputFormat to add this functionality.

 

Best, Fabian

 

Am Fr., 1. Feb. 2019 um 16:04 Uhr schrieb Papadopoulos, Konstantinos <[hidden email]>:

Hi all,

 

I am trying to produce a file from a dataset using the writeAsFormattedText method (e.g., data.writeAsFormattedText(filename, writeMode, formatter)).

Is there any easy way to add a header to the file produced?

 

Thanks in advance,

Konstantinos

[Fabian Hueske-2]

Hi,

I'm not aware of any plans for this.

It might be an interesting feature for the relational APIs but I don't think it would be added to the DataSet or DataStream API.

Best, Fabian

Am Mo., 4. Feb. 2019 um 15:23 Uhr schrieb Papadopoulos, Konstantinos <[hidden email]>:

Hi Fabian,

 

Do you know if there is any plan Flink core framework to support such functionality?

 

Best,

Konstantinos

 

From: Fabian Hueske <[hidden email]>
Sent: Δευτέρα, 4 Φεβρουαρίου 2019 3:49 μμ
To: Papadopoulos, Konstantinos <[hidden email]>
Cc: [hidden email]
Subject: Re: Add header to a file produced using the writeAsFormattedText method

 

Hi Konstantinos,

 

Writing headers to files is currently not supported by the underlying TextOutputFormat.

You can implement a custom OutputFormat by extending TextOutputFormat to add this functionality.

 

Best, Fabian

 

Am Fr., 1. Feb. 2019 um 16:04 Uhr schrieb Papadopoulos, Konstantinos <[hidden email]>:

Hi all,

 

I am trying to produce a file from a dataset using the writeAsFormattedText method (e.g., data.writeAsFormattedText(filename, writeMode, formatter)).

Is there any easy way to add a header to the file produced?

 

Thanks in advance,

Konstantinos