Autoscaling flink application

[Manish G]

Hi,

I understand task parallelism in flink, but is it possible to configure dynamic horizontal scaling also.

Manish

[David Anderson-3]

There's no explicit, out-of-the-box support for autoscaling, but it can be done.

Autoscaling came up a few times at the recent Virtual Flink Forward, including a talk on Autoscaling Flink at Netflix [1] by Timothy Farkas.

[1] https://www.youtube.com/watch?v=NV0jvA5ZDNc

Regards,

David

On Mon, May 4, 2020 at 1:14 PM Manish G <[hidden email]> wrote:

Hi,

I understand task parallelism in flink, but is it possible to configure dynamic horizontal scaling also.

Manish

[Manish G]

Thanks. It would help.

On Tue, May 5, 2020 at 2:12 PM David Anderson <[hidden email]> wrote:

There's no explicit, out-of-the-box support for autoscaling, but it can be done.

Autoscaling came up a few times at the recent Virtual Flink Forward, including a talk on Autoscaling Flink at Netflix [1] by Timothy Farkas.

[1] https://www.youtube.com/watch?v=NV0jvA5ZDNc

Regards,

David

On Mon, May 4, 2020 at 1:14 PM Manish G <[hidden email]> wrote:

Hi,

I understand task parallelism in flink, but is it possible to configure dynamic horizontal scaling also.

Manish