Flink streaming - call external API "after" sink
Posted by
Tarandeep Singh on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-streaming-call-external-API-after-sink-tp12137.html
Hi,
I am using flink-1.2 streaming API to process clickstream and compute some results per cookie. The computed results are stored in Cassandra using flink-cassandra connector. After a result is stored in cassandra, I want to notify an external system (using their API or via Kafka) that result is available (for one cookie).
Can this be done (with/without modifying sink source code)?
What if I create a JointSink that internally uses cassandra sink and kafka sink and writes to both places? I am not worried about same record written multiple times as the computed result and the external system consumption is idempotent.
Thank you,
Tarandeep