Login  Register

Does RichFilterFunction work on multiple thread?

classic Classic list List threaded Threaded
3 messages Options Options
Embed post
Permalink
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

Does RichFilterFunction work on multiple thread?

luutuan
1 post
Hi, when I have a set of objects goes through a RichFilterFunction, by default, will the filter handle all objects in 1 single thread or will divide the work to multiple threads?
Thank you.
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

Re: Does RichFilterFunction work on multiple thread?

Kostas Kloudas
286 posts
Your objects will be processed by a single thread.

Kostas

> On May 26, 2017, at 4:50 PM, luutuan <[hidden email]> wrote:
>
> Hi, when I have a set of objects goes through a RichFilterFunction, by
> default, will the filter handle all objects in 1 single thread or will
> divide the work to multiple threads?
> Thank you.
>
>
>
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Does-RichFilterFunction-work-on-multiple-thread-tp13346.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

Re: Does RichFilterFunction work on multiple thread?

Aljoscha Krettek
1299 posts
Hi,

To expand a bit on that, each function is only invoked by one Thread concurrently but the function might be serialised and sent to several executors (TaskManagers) for parallel execution. For more information, check out [1] and [2].

Best,
Aljoscha


On 26. May 2017, at 17:21, Kostas Kloudas <[hidden email]> wrote:

Your objects will be processed by a single thread.

Kostas

On May 26, 2017, at 4:50 PM, luutuan <[hidden email]> wrote:

Hi, when I have a set of objects goes through a RichFilterFunction, by
default, will the filter handle all objects in 1 single thread or will
divide the work to multiple threads?
Thank you.



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Does-RichFilterFunction-work-on-multiple-thread-tp13346.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.