Re: Using Stateful Functions within a Flink pipeline

Posted by Igal Shilman on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Using-Stateful-Functions-within-a-Flink-pipeline-tp34582p34710.html

Hi Max,

Sorry for not being clearer earlier, by splitting the pipeline I mean: having a pre-processing job that does whatever transformations necessary with the DataStream and outputs to Kafka / Kinesis,

and then having a separate StateFun deployment that consumes from that transformed Kafka / Kinesis [1] topic. 

[1] - https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.0/io-module/apache-kafka.html

Good luck,

Igal.

On Sun, Apr 26, 2020 at 6:43 PM m@xi <[hidden email]> wrote:

Dear Igal,

Can you elaborate more on your proposed solution of splitting the pipeline?

If possible, providing some skeleton pseudocode would be awesome!

Thanks in advance.

Best,
Max



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/