Shall we add an option to ignore the header when flink sql consume filesystem csv source?

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Shall we add an option to ignore the header when flink sql consume filesystem csv source?

Yik San Chan
Hi community,

According to https://stackoverflow.com/questions/65359382/apache-flink-sql-reference-guide-for-table-properties#comment115663505_65404207, there is no way to ignore csv header when flink sql consumes filesystem csv source.

I think this is a reasonable behavior that users want. Shall we support that?

Best,
Yik San
Reply | Threaded
Open this post in threaded view
|

Re: Shall we add an option to ignore the header when flink sql consume filesystem csv source?

JIN FENG
Hi, Yik San
This is a reasonable behavior, and the related jira is  https://issues.apache.org/jira/browse/FLINK-22178 .

On Mon, Apr 19, 2021 at 5:26 PM Yik San Chan <[hidden email]> wrote:
Hi community,

According to https://stackoverflow.com/questions/65359382/apache-flink-sql-reference-guide-for-table-properties#comment115663505_65404207, there is no way to ignore csv header when flink sql consumes filesystem csv source.

I think this is a reasonable behavior that users want. Shall we support that?

Best,
Yik San
Reply | Threaded
Open this post in threaded view
|

Re: Shall we add an option to ignore the header when flink sql consume filesystem csv source?

Yik San Chan
Hi Jinfeng,

Thanks for pointing out! Is there any plan to implement this soon?

Best,
Yik San

On Mon, Apr 19, 2021 at 5:43 PM JIN FENG <[hidden email]> wrote:
Hi, Yik San
This is a reasonable behavior, and the related jira is  https://issues.apache.org/jira/browse/FLINK-22178 .

On Mon, Apr 19, 2021 at 5:26 PM Yik San Chan <[hidden email]> wrote:
Hi community,

According to https://stackoverflow.com/questions/65359382/apache-flink-sql-reference-guide-for-table-properties#comment115663505_65404207, there is no way to ignore csv header when flink sql consumes filesystem csv source.

I think this is a reasonable behavior that users want. Shall we support that?

Best,
Yik San
Reply | Threaded
Open this post in threaded view
|

Re: Shall we add an option to ignore the header when flink sql consume filesystem csv source?

JIN FENG
Hi, Yik San 

Yes,  I'll implement this soon. 

On Mon, Apr 19, 2021 at 5:56 PM Yik San Chan <[hidden email]> wrote:
Hi Jinfeng,

Thanks for pointing out! Is there any plan to implement this soon?

Best,
Yik San

On Mon, Apr 19, 2021 at 5:43 PM JIN FENG <[hidden email]> wrote:
Hi, Yik San
This is a reasonable behavior, and the related jira is  https://issues.apache.org/jira/browse/FLINK-22178 .

On Mon, Apr 19, 2021 at 5:26 PM Yik San Chan <[hidden email]> wrote:
Hi community,

According to https://stackoverflow.com/questions/65359382/apache-flink-sql-reference-guide-for-table-properties#comment115663505_65404207, there is no way to ignore csv header when flink sql consumes filesystem csv source.

I think this is a reasonable behavior that users want. Shall we support that?

Best,
Yik San
Reply | Threaded
Open this post in threaded view
|

Re: Shall we add an option to ignore the header when flink sql consume filesystem csv source?

Yik San Chan
Hi Jin,

Look forward to the implementation!

Best,
Yik San

On Mon, Apr 19, 2021 at 5:58 PM JIN FENG <[hidden email]> wrote:
Hi, Yik San 

Yes,  I'll implement this soon. 

On Mon, Apr 19, 2021 at 5:56 PM Yik San Chan <[hidden email]> wrote:
Hi Jinfeng,

Thanks for pointing out! Is there any plan to implement this soon?

Best,
Yik San

On Mon, Apr 19, 2021 at 5:43 PM JIN FENG <[hidden email]> wrote:
Hi, Yik San
This is a reasonable behavior, and the related jira is  https://issues.apache.org/jira/browse/FLINK-22178 .

On Mon, Apr 19, 2021 at 5:26 PM Yik San Chan <[hidden email]> wrote:
Hi community,

According to https://stackoverflow.com/questions/65359382/apache-flink-sql-reference-guide-for-table-properties#comment115663505_65404207, there is no way to ignore csv header when flink sql consumes filesystem csv source.

I think this is a reasonable behavior that users want. Shall we support that?

Best,
Yik San