Re: Single stream, two sinks

Posted by miki haiat on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Single-stream-two-sinks-tp33223p33249.html

So you have rabitmq source and http sink?

If so you can use side output in order to dump your data to db.

https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/side_output.html

On Sat, Feb 29, 2020, 23:01 Gadi Katsovich <[hidden email]> wrote:

Hi,

I'm new to flink and am evaluating it to replace our existing streaming application.

The use case I'm working on is reading messages from RabbitMQ queue, applying some transformation and filtering logic and sending it via HTTP to a 3rd party.

A must have requirement of this flow is to to write the data that was sent to an SQL db, for audit and troubleshooting purposes.

I'm currently basing my HTTP solution on a PR with needed adjustments:
https://github.com/apache/flink/pull/5866/files

How can I add an insertion to a DB after a successful HTTP request?

Thank you.