Adding flink udf support to linkedin's portable udf framework transport

[Arup Malakar]

Hi Flink Users,

Came across the project transport from linkedin: https://github.com/linkedin/transport I think the project has great potential which allows for sharing udf implementation across various compute engines (hive/spark/presto). Any thoughts on adding support for flink udfs to transport or is anyone already working on it?

--

[Dawid Wysakowicz-2]

Hi Arup,

Thanks for bringing our attention to that project. So far I am not aware of anyone working on adding flink's udfs support to that project, but that would be definitely worth investigating. Just as a thought, it might make sense though to wait a little bit with that effort as the type system for Flink's Table & SQL API will probably be updated in the near future as part of the effort of restructuring Table API & SQL for future contributions[1].

Best,

Dawid

[1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-32-Restructure-flink-table-for-future-contributions-td26543.html

On 24/01/2019 19:59, Arup Malakar wrote:

Hi Flink Users,

Came across the project transport from linkedin: https://github.com/linkedin/transport I think the project has great potential which allows for sharing udf implementation across various compute engines (hive/spark/presto). Any thoughts on adding support for flink udfs to transport or is anyone already working on it?

--