Adding flink udf support to linkedin's portable udf framework transport

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Adding flink udf support to linkedin's portable udf framework transport

Arup Malakar
Hi Flink Users,

Came across the project transport from linkedin: https://github.com/linkedin/transport I think the project has great potential which allows for sharing udf implementation across various compute engines (hive/spark/presto). Any thoughts on adding support for flink udfs to transport or is anyone already working on it?

--
Arup Malakar
Reply | Threaded
Open this post in threaded view
|

Re: Adding flink udf support to linkedin's portable udf framework transport

Dawid Wysakowicz-2

Hi Arup,

Thanks for bringing our attention to that project. So far I am not aware of anyone working on adding flink's udfs support to that project, but that would be definitely worth investigating. Just as a thought, it might make sense though to wait a little bit with that effort as the type system for Flink's Table & SQL API will probably be updated in the near future as part of the effort of restructuring Table API & SQL for future contributions[1].

Best,

Dawid

[1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-32-Restructure-flink-table-for-future-contributions-td26543.html

On 24/01/2019 19:59, Arup Malakar wrote:
Hi Flink Users,

Came across the project transport from linkedin: https://github.com/linkedin/transport I think the project has great potential which allows for sharing udf implementation across various compute engines (hive/spark/presto). Any thoughts on adding support for flink udfs to transport or is anyone already working on it?

--
Arup Malakar

signature.asc (849 bytes) Download Attachment