How to tell what mode a Table operator is in

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

How to tell what mode a Table operator is in

Rex Fenley
Hi,

When I'm looking at the Flink plan in the UI and at an operator, is there a way to tell if an operator is in Retract mode vs Upsert mode? Ideally we want as many of our operators in Upsert mode as possible since our data sources are all uniquely keyed.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

Reply | Threaded
Open this post in threaded view
|

Re: How to tell what mode a Table operator is in

Rex Fenley
Our sinks are uniquely keyed as well. A couple of our joins are not until an aggregate is performed however.

On Thu, Dec 3, 2020 at 12:46 PM Rex Fenley <[hidden email]> wrote:
Hi,

When I'm looking at the Flink plan in the UI and at an operator, is there a way to tell if an operator is in Retract mode vs Upsert mode? Ideally we want as many of our operators in Upsert mode as possible since our data sources are all uniquely keyed.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US



--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US

Reply | Threaded
Open this post in threaded view
|

Re: How to tell what mode a Table operator is in

Danny Chan-2
If a stateful operator has also a stateful operator in its input sub-pipeline, then it may receive retract messages. Operator like group agg, stream-stream join or rank are stateful.

We can not show if the operator are receiving retract messages in the UI. But your request is reasonable.

Rex Fenley <[hidden email]>于2020年12月4日 周五上午4:48写道:
Our sinks are uniquely keyed as well. A couple of our joins are not until an aggregate is performed however.

On Thu, Dec 3, 2020 at 12:46 PM Rex Fenley <[hidden email]> wrote:
Hi,

When I'm looking at the Flink plan in the UI and at an operator, is there a way to tell if an operator is in Retract mode vs Upsert mode? Ideally we want as many of our operators in Upsert mode as possible since our data sources are all uniquely keyed.

Thanks!

--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US



--

Rex Fenley  |  Software Engineer - Mobile and Backend


Remind.com |  BLOG  |  FOLLOW US  |  LIKE US