Batch Side Outputs

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Batch Side Outputs

Flavio Pompermaier
Hi to all,
will side outputs [FLINK-4460] be eventually available also for batch API?

Best,
Flavio
Reply | Threaded
Open this post in threaded view
|

Re: Batch Side Outputs

Aljoscha Krettek
Hi Flavio,

As far as I am aware no one is currently working on adding side outputs for the DataSet API. The workaround is to output one common type from a function have several parallel filters after that for filtering out the elements of the correct type for the respective stream.

Best,
Aljoscha

On 6. Jun 2017, at 11:15, Flavio Pompermaier <[hidden email]> wrote:

Hi to all,
will side outputs [FLINK-4460] be eventually available also for batch API?

Best,
Flavio

Reply | Threaded
Open this post in threaded view
|

Re: Batch Side Outputs

Fabian Hueske-2
There are no plans to add side output to the DataSet API.
The reason is that the optimizer would need to be adapted as well which would be a major change.

Cheers, Fabian

2017-06-06 14:47 GMT+02:00 Aljoscha Krettek <[hidden email]>:
Hi Flavio,

As far as I am aware no one is currently working on adding side outputs for the DataSet API. The workaround is to output one common type from a function have several parallel filters after that for filtering out the elements of the correct type for the respective stream.

Best,
Aljoscha

On 6. Jun 2017, at 11:15, Flavio Pompermaier <[hidden email]> wrote:

Hi to all,
will side outputs [FLINK-4460] be eventually available also for batch API?

Best,
Flavio