Re: Is the eval method invoked in a thread safe manner in Fink UDF
Hi Anil,
It is thread-safe.
Each udf instance will only run in one task. And for each udf, it processes data synchronously, i.e, the next record will not be processed until the current record is processed.
Best, Hequn
On Sat, Jan 12, 2019 at 3:12 AM Anil <[hidden email]> wrote:
Is the eval method invoked in a thread safe manner in Fink UDF.
Re: Is the eval method invoked in a thread safe manner in Fink UDF
According to the codegen result, I think each field is invoked sequentially.
However, if you maintain internal state within your UDF, it is your responsibility to maintain the internal state consistency.
Are you invoking external RPC in your "GetName" UDF method and that has to be async?
--
Rong
On Sat, Jan 12, 2019 at 11:42 PM Anil <[hidden email]> wrote:
Thanks Hequn!. Is it also thread safe when the same UDF is called multiple
times in the same record.
Is the UDF called sequentially for each fields a single record, I have a
query like -
select GetName(data.id, 'city'), GetName(data.id, 'zone') from ......