Flink join with external source

[Jerry Peng]

Hello,

Does a flink currently support operators to use redis?  If I using the streaming api in Flink and I need to look up something in a redis database during the processing of the stream how can I do that?

[Aljoscha Krettek]

Hi Jerry,

it should be possible to just use the Redis API inside a Flink operator, for example a map or flatMap. You can use RichFunctions (https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#rich-functions) to setup the connection and close it after computation finishes. If you need exactly-once behaviour you need to handle that yourself, however, in the database.

I hope that helps but please let us know if you need more information.

Aljoscha

On Fri, 4 Sep 2015 at 17:49 Jerry Peng <[hidden email]> wrote:

Hello,

Does a flink currently support operators to use redis?  If I using the streaming api in Flink and I need to look up something in a redis database during the processing of the stream how can I do that?