Infer if a Table will create an AppendStream / RetractStream

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Infer if a Table will create an AppendStream / RetractStream

Yuval Itzchakov
Hi,

Is there any way to infer if a Table is going to generate an AppendStream or a RetractStream under the hood in order to figure out if I need to call `toAppendStream` vs `toRetractStream` for the DataStream conversion? Note this information is important to me further down the DAG so I want to preserve these semantics.

--
Best Regards,
Yuval Itzchakov.
Reply | Threaded
Open this post in threaded view
|

Re: Infer if a Table will create an AppendStream / RetractStream

Timo Walther
Hi Yuval,

currently there is no API for getting those insights. I guess you need
to use internal API for getting this information. Which planner and
version are you using?

Regards,
Timo


On 18.05.20 14:16, Yuval Itzchakov wrote:

> Hi,
>
> Is there any way to infer if a Table is going to generate an
> AppendStream or a RetractStream under the hood in order to figure out if
> I need to call `toAppendStream` vs `toRetractStream` for the DataStream
> conversion? Note this information is important to me further down the
> DAG so I want to preserve these semantics.
>
> --
> Best Regards,
> Yuval Itzchakov.

Reply | Threaded
Open this post in threaded view
|

Re: Infer if a Table will create an AppendStream / RetractStream

Yuval Itzchakov
Hi Timo,
Right now I'm using Flink Planner with 1.9.0 but planning an upgrade to 1.10.1 / 1.11 with Blink.

On Mon, 18 May 2020, 16:43 Timo Walther, <[hidden email]> wrote:
Hi Yuval,

currently there is no API for getting those insights. I guess you need
to use internal API for getting this information. Which planner and
version are you using?

Regards,
Timo


On 18.05.20 14:16, Yuval Itzchakov wrote:
> Hi,
>
> Is there any way to infer if a Table is going to generate an
> AppendStream or a RetractStream under the hood in order to figure out if
> I need to call `toAppendStream` vs `toRetractStream` for the DataStream
> conversion? Note this information is important to me further down the
> DAG so I want to preserve these semantics.
>
> --
> Best Regards,
> Yuval Itzchakov.