Flink streaming automatic scaling (1.6.1)

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink streaming automatic scaling (1.6.1)

Marke Builder
Hi,

I tried to found somethink about "flink automatic scaling", is that available and how does it work? There are any documentation or other resources?

And especially how it works with YARN.  
We are using flink1.61 with yarn , the parameters are still relevant (-yn, -ys)?

Thanks for your support.
Reply | Threaded
Open this post in threaded view
|

Re: Flink streaming automatic scaling (1.6.1)

Fabian Hueske-2
Hi,

Flink 1.6 does not support automatic scaling.
However, there is a REST call to trigger the rescaling of a job. You need to call it manually though.
Have a look at the /jobs/:jobid/rescaling call in the REST docs [1].

Best, Fabian


Am Mi., 21. Nov. 2018 um 11:18 Uhr schrieb Marke Builder <[hidden email]>:
Hi,

I tried to found somethink about "flink automatic scaling", is that available and how does it work? There are any documentation or other resources?

And especially how it works with YARN.  
We are using flink1.61 with yarn , the parameters are still relevant (-yn, -ys)?

Thanks for your support.