how to add a new runtime operator

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

how to add a new runtime operator

Vincent Cai
Hi All,
Flink is an amazing streaming platfrom,meanwhile it is also complicated. Do we have some "step by step" guideline for adding new runtime operators for Flink? I got one page via google but it should be out of date. Thanks. 

https://ci.apache.org/projects/flink/flink-docs-release-1.1/internals/add_operator.html 



Regards
Vincent  Cai
 
Reply | Threaded
Open this post in threaded view
|

Re: how to add a new runtime operator

Timo Walther
Hi Vincent,

we don't have a step by step guide for adding new operators. Most of the
important operations are exposed via DataStream API. Esp.
ProcessFunction [1] fits for most complex use cases with access to the
primitives such as time and state.

What kind of operator is missing for your use case?

I think code is still the best tutorial in this case. You could take a
look at DataStream#map [2] for example.

Regards,
Timo

[1]
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/process_function.html

[2]
https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStream.java#L621


On 12.08.20 07:51, Vincent Cai wrote:

> Hi All,
> Flink is an amazing streaming platfrom,meanwhile it is also
> complicated. Do we have some "step by step" guideline for adding new
> runtime operators for Flink? I got one page via google but it should be
> out of date. Thanks.
>
> https://ci.apache.org/projects/flink/flink-docs-release-1.1/internals/add_operator.html 
>
>
>
>
> Regards
> Vincent  Cai