Flink Mesos task management

[Jared Stehler]

Is there a way to direct the mesos application master to scale task manager tasks up or down, or to redeploy them? For example, when I want to roll out a new docker image for task managers?

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703

[Till Rohrmann]

Hi Jared,

the way to solve this problem at the moment is to take a savepoint of your job, restart the cluster with the updated Docker image and then resubmit the job starting from the most recent savepoint. The same applies when you want to change the parallelism of your job.

We are currently working on improving Flink's dynamic scaling capabilities such that you have a command which let's you directly scale up or down a job. Depending on the available resources this also will allocate or deallocate new tasks from Mesos/Yarn.

Cheers,

Till

On Fri, May 12, 2017 at 3:32 PM, Jared Stehler <[hidden email]> wrote:

Is there a way to direct the mesos application master to scale task manager tasks up or down, or to redeploy them? For example, when I want to roll out a new docker image for task managers?

--
Jared Stehler
Chief Architect - Intellify Learning
o: <a href="tel:[phone]%20x703" value="[phone]">617.701.6330 x703