Flink Control Stream

[Dominik Wosiński]

Hey,

I wanted to use the control stream to dynamically adjust parameters of the tasks. I know that it is possible to use connect() and BroadcastState to obtain such a thing. But I would like to have the possibility to control the parameters inside the AsyncFunction. Like specific timeout for HTTP client or the request address if it changes. I know that I could technically create join control stream and event stream into one stream and process it, but I was wondering If it would be possible to do this with any other mechanism?

Thanks in advance,

Best Regards.

Dom.

[Till Rohrmann]

Hi Dominik,

I think it is not possible to use Flink's AsyncFunction together with a ConnectedStream or when you use BroadcastState. Therefore, it would be necessary that you inject the control messages into your normal stream and then filter them out in the AsyncFunction#asyncInvoke call.

Cheers,

Till

On Wed, Apr 24, 2019 at 11:05 AM Dominik Wosiński <[hidden email]> wrote:

Hey,

I wanted to use the control stream to dynamically adjust parameters of the tasks. I know that it is possible to use connect() and BroadcastState to obtain such a thing. But I would like to have the possibility to control the parameters inside the AsyncFunction. Like specific timeout for HTTP client or the request address if it changes. I know that I could technically create join control stream and event stream into one stream and process it, but I was wondering If it would be possible to do this with any other mechanism?

Thanks in advance,

Best Regards.

Dom.

[Dominik Wosiński]

Thanks for help Till,

I thought so, but I wanted to be sure.

Best Regards,

Dom.