Re: [DISCUSS] FLIP-115: Filesystem connector in Table

Posted by Piotr Nowojski-3 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/DISCUSS-FLIP-115-Filesystem-connector-in-Table-tp33625p33627.html

Hi,

Which actual sinks/sources are you planning to use in this feature? Is it about exposing StreamingFileSink in the Table API? Or do you want to implement new Sinks/Sources?

Piotrek

> On 13 Mar 2020, at 10:04, jinhai wang <[hidden email]> wrote:
>
> Thanks for FLIP-115. It is really useful feature for platform developers who manage hundreds of Flink to Hive jobs in production.
> I think we need add 'connector.sink.username' for UserGroupInformation when data is written to HDFS
>
>
> 在 2020/3/13 下午3:33,“Jingsong Li”<[hidden email]> 写入:
>
>    Hi everyone,
>
>    I'd like to start a discussion about FLIP-115 Filesystem connector in Table
>    [1].
>    This FLIP will bring:
>    - Introduce Filesystem table factory in table, support
>    csv/parquet/orc/json/avro formats.
>    - Introduce streaming filesystem/hive sink in table
>
>    CC to user mail list, if you have any unmet needs, please feel free to
>    reply~
>
>    Look forward to hearing from you.
>
>    [1]
>    https://cwiki.apache.org/confluence/display/FLINK/FLIP-115%3A+Filesystem+connector+in+Table
>
>    Best,
>    Jingsong Lee
>
>
>