Flink dynamic scaling 1.5

[Anil]

CONTENTS DELETED

The author has deleted this message.

[Till Rohrmann]

Hi Anil,

you can use `flink modify <JOB_ID> -p <NEW_PARALLELISM>` to scale a running job under JOB_ID to the NEW_PARALLELISM.

Cheers,

Till

On Mon, Jul 9, 2018 at 9:45 AM Anil <[hidden email]> wrote:

This is regarding dynamic rescaling in Flink 1.5

I am using Yarn for running Flink jobs. I start these jobs with a static
resource. Is there any option to scale out these job by itself in specific
conditions like if there's a memory issues.

In Flink 1.5 release notes -

Applications can be rescaled without manually triggering a savepoint. Under
the hood, Flink will still take a savepoint, stop the application, and
rescale it to the new parallelism.

This means that I will have to monitor my jobs memory and will have to
trigger rescale manually. Is these any workaround to handle this.



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Anil]

CONTENTS DELETED

The author has deleted this message.