How to implement a FTP connector Flink Table/sql support?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

How to implement a FTP connector Flink Table/sql support?

1095193290@qq.com
Hi
 I have investigate the relevant document and code about Flink connector. Flink support local filesystem and several pluggable file system which not include FTP. Could you give me some suggestions how to make Flink read data from FTP. One way I have learned is  implementing  FTP conncector accoring to user-defined Sources & Sinks. Have any other ways to read data from FTP? Appreciating any suggestions. 


Reply | Threaded
Open this post in threaded view
|

Re: How to implement a FTP connector Flink Table/sql support?

rmetzger0
Flink supports Hadoop's FileSystem abstraction, which has an implementation for FTP: https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/ftp/FTPFileSystem.html

On Tue, Feb 2, 2021 at 3:43 AM [hidden email] <[hidden email]> wrote:
Hi
 I have investigate the relevant document and code about Flink connector. Flink support local filesystem and several pluggable file system which not include FTP. Could you give me some suggestions how to make Flink read data from FTP. One way I have learned is  implementing  FTP conncector accoring to user-defined Sources & Sinks. Have any other ways to read data from FTP? Appreciating any suggestions.