Keep bootstrapped config updated with stream from Kafka

[Nihat Hosgur]

Hi all,

We bootstrap data from some DB and then like to keep it updated with updates coming through Kafka. At spark it was kind of easy by utilizing through UpdateStateByKey yet I'm kind of stuck to figure out how to do it with Flink. I've taken a look into iterate yet I don't think it's meant to do that.

Any input would be appreciated,

Nihat

--

[Fabian Hueske-2]

Hi Nihat,

you could implement the stateful function as a RichFunction and load the data in the open() method.

Best, Fabian

2017-01-19 2:53 GMT+01:00 Nihat Hosgur <[hidden email]>:

Hi all,

We bootstrap data from some DB and then like to keep it updated with updates coming through Kafka. At spark it was kind of easy by utilizing through UpdateStateByKey yet I'm kind of stuck to figure out how to do it with Flink. I've taken a look into iterate yet I don't think it's meant to do that.

Any input would be appreciated,

Nihat

--

[Nihat Hosgur]

Hi Fabian,

Thank you for the pointer.

Thank,

Nihat

On Thu, Jan 19, 2017 at 2:46 AM Fabian Hueske <[hidden email]> wrote:

Hi Nihat,

you could implement the stateful function as a RichFunction and load the data in the open() method.

Best, Fabian

2017-01-19 2:53 GMT+01:00 Nihat Hosgur <[hidden email]>:

Hi all,

We bootstrap data from some DB and then like to keep it updated with updates coming through Kafka. At spark it was kind of easy by utilizing through UpdateStateByKey yet I'm kind of stuck to figure out how to do it with Flink. I've taken a look into iterate yet I don't think it's meant to do that.

Any input would be appreciated,

Nihat

--

--