Is the eval method invoked in a thread safe manner in Fink UDF

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Is the eval method invoked in a thread safe manner in Fink UDF

Anil
This post was updated on .
CONTENTS DELETED
The author has deleted this message.
Reply | Threaded
Open this post in threaded view
|

Re: Is the eval method invoked in a thread safe manner in Fink UDF

Hequn Cheng
Hi Anil,

It is thread-safe. 
Each udf instance will only run in one task. And for each udf, it processes data synchronously, i.e, the next record will not be processed until the current record is processed.

Best, Hequn

On Sat, Jan 12, 2019 at 3:12 AM Anil <[hidden email]> wrote:
Is the eval method invoked in a thread safe manner in Fink UDF.



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Is the eval method invoked in a thread safe manner in Fink UDF

Anil
CONTENTS DELETED
The author has deleted this message.
Reply | Threaded
Open this post in threaded view
|

Re: Is the eval method invoked in a thread safe manner in Fink UDF

Rong Rong
According to the codegen result, I think each field is invoked sequentially. 

However, if you maintain internal state within your UDF, it is your responsibility to maintain the internal state consistency. 
Are you invoking external RPC in your "GetName" UDF method and that has to be async?

--
Rong

On Sat, Jan 12, 2019 at 11:42 PM Anil <[hidden email]> wrote:
Thanks Hequn!. Is it also thread safe when the same UDF is called multiple
times in the same record.
Is the UDF called sequentially for each fields a single record,  I have a
query like  -
     select GetName(data.id, 'city'), GetName(data.id, 'zone') from ......




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Is the eval method invoked in a thread safe manner in Fink UDF

Anil
CONTENTS DELETED
The author has deleted this message.