stream to table, gable to stream overhead

[Eric HOFFMANN-2]

Hi,

Is there any overhead to go from stream to table for sql query execution and go back to stream for sink?

or is it better to do full streaming tabke/sql api (with table source and table sink)?

Thx

eric

This message contains confidential information and is intended only for the individual(s) addressed in the message. If you are not the named addressee, you should not disseminate, distribute, or copy this e-mail. If you are not the intended recipient, you are notified that disclosing, distributing, or copying this e-mail is strictly prohibited.

[Piotr Nowojski-5]

Hi Eric,

We have never measured it. Probably the most important overhead (probably the only significant thing) is the type conversion. Especially if object reuse is disabled this means serialization step.

The best thing for you would be to just try it out in your particular use case.

Best, 

Piotrek

pt., 11 gru 2020 o 12:27 Eric HOFFMANN <[hidden email]> napisał(a):

Hi,

Is there any overhead to go from stream to table for sql query execution and go back to stream for sink?

or is it better to do full streaming tabke/sql api (with table source and table sink)?

Thx

eric

This message contains confidential information and is intended only for the individual(s) addressed in the message. If you are not the named addressee, you should not disseminate, distribute, or copy this e-mail. If you are not the intended recipient, you are notified that disclosing, distributing, or copying this e-mail is strictly prohibited.