TableConfig TTL and Watermark TTL

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

TableConfig TTL and Watermark TTL

lec ssmi
Hi:
  If I  join two streams in SQL, the time range is used as a condition, similar to the time interval join in DataStream.  So, will this join state expire as the watermark moves, or will it expire with the TTL time configured by TableConfig? Or both?

 Best
Lec Ssmi
Reply | Threaded
Open this post in threaded view
|

Re: TableConfig TTL and Watermark TTL

Benchao Li
The state will be cleaned with watermark movement.

lec ssmi <[hidden email]> 于2020年5月12日周二 下午5:55写道:
Hi:
  If I  join two streams in SQL, the time range is used as a condition, similar to the time interval join in DataStream.  So, will this join state expire as the watermark moves, or will it expire with the TTL time configured by TableConfig? Or both?

 Best
Lec Ssmi


--
Benchao Li
School of Electronics Engineering and Computer Science, Peking University
Tel:+86-15650713730
Email: [hidden email]; [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: TableConfig TTL and Watermark TTL

lec ssmi
Then if I don't write time constraints, 
will it expire with the TTL time configured by TableConfig?
Benchao Li <[hidden email]> 于 2020年5月12日周二 20:27写道:
The state will be cleaned with watermark movement.

lec ssmi <[hidden email]> 于2020年5月12日周二 下午5:55写道:
Hi:
  If I  join two streams in SQL, the time range is used as a condition, similar to the time interval join in DataStream.  So, will this join state expire as the watermark moves, or will it expire with the TTL time configured by TableConfig? Or both?

 Best
Lec Ssmi


--
Benchao Li
School of Electronics Engineering and Computer Science, Peking University
Tel:+86-15650713730
Email: [hidden email]; [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: TableConfig TTL and Watermark TTL

Benchao Li
Yes, you are right.

If you add time constraints, it will be translated [Proc/Row]TimeBoundedStreamJoin,
If not, it will be translated into StreamingJoinOperator.
They are totally different two operators.

lec ssmi <[hidden email]> 于2020年5月12日周二 下午8:43写道:
Then if I don't write time constraints, 
will it expire with the TTL time configured by TableConfig?
Benchao Li <[hidden email]> 于 2020年5月12日周二 20:27写道:
The state will be cleaned with watermark movement.

lec ssmi <[hidden email]> 于2020年5月12日周二 下午5:55写道:
Hi:
  If I  join two streams in SQL, the time range is used as a condition, similar to the time interval join in DataStream.  So, will this join state expire as the watermark moves, or will it expire with the TTL time configured by TableConfig? Or both?

 Best
Lec Ssmi


--
Benchao Li
School of Electronics Engineering and Computer Science, Peking University
Tel:+86-15650713730
Email: [hidden email]; [hidden email]


--
Benchao Li
School of Electronics Engineering and Computer Science, Peking University
Tel:+86-15650713730
Email: [hidden email]; [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: TableConfig TTL and Watermark TTL

lec ssmi
Thank you for the clarification. 

Benchao Li <[hidden email]> 于 2020年5月12日周二 20:48写道:
Yes, you are right.

If you add time constraints, it will be translated [Proc/Row]TimeBoundedStreamJoin,
If not, it will be translated into StreamingJoinOperator.
They are totally different two operators.

lec ssmi <[hidden email]> 于2020年5月12日周二 下午8:43写道:
Then if I don't write time constraints, 
will it expire with the TTL time configured by TableConfig?
Benchao Li <[hidden email]> 于 2020年5月12日周二 20:27写道:
The state will be cleaned with watermark movement.

lec ssmi <[hidden email]> 于2020年5月12日周二 下午5:55写道:
Hi:
  If I  join two streams in SQL, the time range is used as a condition, similar to the time interval join in DataStream.  So, will this join state expire as the watermark moves, or will it expire with the TTL time configured by TableConfig? Or both?

 Best
Lec Ssmi


--
Benchao Li
School of Electronics Engineering and Computer Science, Peking University
Tel:+86-15650713730
Email: [hidden email]; [hidden email]


--
Benchao Li
School of Electronics Engineering and Computer Science, Peking University
Tel:+86-15650713730
Email: [hidden email]; [hidden email]