Using custom evictor and trigger on Table API

[Dongwon Kim-2]

Hi all,

I’m looking into Table API for my new project.
It looks like a sweet spot between DataStream API/SQL.

However, it doesn’t seem like the expressivity of Table API equals to that of DataStream API.

My previous Flink projects were building simple pipelines using DataStream API with custom evictor (FF Berlin 17) and custom trigger (FF Berlin 18).
I believe these pipelines can be expressed with Table API/UDF/UDAF except the custom windowing components.

Do I have no way but to change the table into DataStream to use the custom components at the moment?

Best,
- Dongwon

[Rong Rong]

Hi Dongwon,

There was a previous thread regarding this[1], unfortunately this is not supported yet.

However there are some latest development proposal[2,3] to enhance the TableAPI which might be able to support your use case.

--

Rong

[1] http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Table-API-custom-window-td22199.html

[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Table-API-Enhancement-Outline-td25070.html

[3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Enhancing-the-functionality-and-productivity-of-Table-API-td24963i20.html

On Wed, Feb 6, 2019 at 4:14 AM eastcirclek <[hidden email]> wrote:

Hi all,

I’m looking into Table API for my new project.
It looks like a sweet spot between DataStream API/SQL.

However, it doesn’t seem like the expressivity of Table API equals to that of DataStream API.

My previous Flink projects were building simple pipelines using DataStream API with custom evictor (FF Berlin 17) and custom trigger (FF Berlin 18).
I believe these pipelines can be expressed with Table API/UDF/UDAF except the custom windowing components.

Do I have no way but to change the table into DataStream to use the custom components at the moment?

Best,
- Dongwon