Use batch and stream environment in a single pipeline

[Andres Angel]

Hello everyone, 

I need to create a table from a stream environment and thinking in  a pure SQL approach I was wondering if I can create few of the enrichment tables in batch environment and only the streaming payload as streaming table environment.

I tried to create a batch table environment with a streaming environment but it broke up, then I  dont know if within the same flow can I have two different environments one as batch and other as streaming???

thanks so much

AU

[Fabian Hueske-2]

Hi,

Right now it is not possible to mix batch and streaming environments in a job.

You would need to implement the batch logic via the streaming API which is not always straightforward.

However, the Flink community is spending a lot of effort on unifying batch and stream processing. So this will be much easier in a future version of Flink.

Best, Fabian

Am Mo., 22. Juli 2019 um 17:04 Uhr schrieb Andres Angel <[hidden email]>:

Hello everyone, 

I need to create a table from a stream environment and thinking in  a pure SQL approach I was wondering if I can create few of the enrichment tables in batch environment and only the streaming payload as streaming table environment.

I tried to create a batch table environment with a streaming environment but it broke up, then I  dont know if within the same flow can I have two different environments one as batch and other as streaming???

thanks so much

AU