Hi, when I have a set of objects goes through a RichFilterFunction, by default, will the filter handle all objects in 1 single thread or will divide the work to multiple threads?
Thank you.
Re: Does RichFilterFunction work on multiple thread?
Hi,
To expand a bit on that, each function is only invoked by one Thread concurrently but the function might be serialised and sent to several executors (TaskManagers) for parallel execution. For more information, check out [1] and [2].
On 26. May 2017, at 17:21, Kostas Kloudas <[hidden email]> wrote:
Your objects will be processed by a single thread.
Kostas
On May 26, 2017, at 4:50 PM, luutuan <[hidden email]> wrote:
Hi, when I have a set of objects goes through a RichFilterFunction, by default, will the filter handle all objects in 1 single thread or will divide the work to multiple threads? Thank you.