Annotation in UDF dropped

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Annotation in UDF dropped

Viktor Rosenfeld
Hi,

I have a UDF that uses an annotation to the loop variable inside a for loop. I noticed that this annotation gets dropped at some point when the UDF is shipped to the TaskManager. I was told that this happens in the Optimizer but I would like to know where this happens exactly and if there is an easy way to influence this behavior. The annotation is needed by another tool that interoperates with Flink.

Any pointer to the source code would be appreciated.

Best,
Viktor

signature.asc (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Annotation in UDF dropped

Fabian Hueske-2
Hi Viktor,

Flink does not modify user code.
It distributes the job JAR file to the cluster and serializes the function objects using Java serialization to ship them to the worker nodes where they are deserialized.

What type of annotation gets dropped?
Can you show us a small example of the code?

Thank you,
Fabian

2018-04-16 17:32 GMT+02:00 Rosenfeld, Viktor <[hidden email]>:
Hi,

I have a UDF that uses an annotation to the loop variable inside a for loop. I noticed that this annotation gets dropped at some point when the UDF is shipped to the TaskManager. I was told that this happens in the Optimizer but I would like to know where this happens exactly and if there is an easy way to influence this behavior. The annotation is needed by another tool that interoperates with Flink.

Any pointer to the source code would be appreciated.

Best,
Viktor