Expire records in FLINK dynamic tables?

[burgesschen]

Hi everyone,
I'm trying out the SQL API in flink 1.6
I first convert a data stream to a table (let's call it tableA) using
tableEnv.registerDataStream, then perform queries on tableA and finally
convert the result to a retract stream.

My question is: Is there a way to clean up/ remove records/expire records in
tableA, by some criteria, most importantly, by TTL? Currently the table is
ever increasing.

Best,

Chen



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Fabian Hueske-2]

Hi Chen,

Yes, this is possible.

Have a look at the configuration of idle state retention time [1].

Best, Fabian

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/table/streaming.html#idle-state-retention-time

2018-09-17 20:10 GMT+02:00 burgesschen <[hidden email]>:

Hi everyone,
I'm trying out the SQL API in flink 1.6
I first convert a data stream to a table (let's call it tableA) using
tableEnv.registerDataStream, then perform queries on tableA and finally
convert the result to a retract stream.

My question is: Is there a way to clean up/ remove records/expire records in
tableA, by some criteria, most importantly, by TTL? Currently the table is
ever increasing.

Best,

Chen



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/