Flink SinkFunction for WebSockets

[Timothy Victor]

Hi

I'm looking to write a sink function for writing to websockets, in particular ones that speak the WAMP protocol (https://wamp-proto.org/index.html).

Before going down that path, I wanted to ask if

a) anyone has done something like that already so I dont reinvent stuff

b) any caveats or warnings before I try this.

Any advise would be appreciated.

Thanks

Tim

[Fabian Hueske-2]

Hi Tim,

One thing that might be interesting is that Flink might emit results more than once when a job recovers from a failure.

It is up to the receiver to deal with that.

Depending on the type of results this might be easy (idempotent updates) or impossible.

Best, Fabian

Am Fr., 19. Juli 2019 um 00:23 Uhr schrieb Timothy Victor <[hidden email]>:

Hi

I'm looking to write a sink function for writing to websockets, in particular ones that speak the WAMP protocol (https://wamp-proto.org/index.html).

Before going down that path, I wanted to ask if

a) anyone has done something like that already so I dont reinvent stuff

b) any caveats or warnings before I try this.

Any advise would be appreciated.

Thanks

Tim

[Oytun Tez]

Hi Tim,

I think this might be a useful sink for small interactions with outside. Are you planning to open source this? If yes, can you try to make it agnostic so that people can plug in their own WebSocket protocol – Stomp etc? :) We can publish this in the upcoming community website as an extension/plugin/library.

On Tue, Jul 23, 2019 at 7:07 AM Fabian Hueske <[hidden email]> wrote:

Hi Tim,

One thing that might be interesting is that Flink might emit results more than once when a job recovers from a failure.

It is up to the receiver to deal with that.

Depending on the type of results this might be easy (idempotent updates) or impossible.

Best, Fabian

Am Fr., 19. Juli 2019 um 00:23 Uhr schrieb Timothy Victor <[hidden email]>:

Hi

I'm looking to write a sink function for writing to websockets, in particular ones that speak the WAMP protocol (https://wamp-proto.org/index.html).

Before going down that path, I wanted to ask if

a) anyone has done something like that already so I dont reinvent stuff

b) any caveats or warnings before I try this.

Any advise would be appreciated.

Thanks

Tim