How can I create a savepoint if I have Flink running in containers?

[javalass]

I have Flink 1.2.1 running on Docker, with Task Managers distributed across
different VMs as part of a Docker Swarm.

I understand Dynamic Scaling is not yet available in Flink. Therefore, if I
wanted to increase the number of containers running Flink's task manager
(scale up), I would need to create a savepoint, stop the running job, scale
up my Task Manager containers, then resume the job.

My question is: how do I create a savepoint? The documentation assumes you
are using the Command Line Client, but I don't think I can access it if I am
running Flink in containers. The Web UI doesn't allow you to create
savepoints either. What do I do, in this case?

Thank you very much for your help.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Timo Walther]

Hi,

I'm not a deployment expert but I think creating a savepoint should
still be doable throught the CLI client. The Flink JobManager and
TaskManager just run the containers and the CLI connects to a
JobManager. I will loop in someone more familar with deployment. We
should definitely improve the documentation here.

Regards,
Timo


Am 10/22/17 um 2:24 PM schrieb javalass:

> I have Flink 1.2.1 running on Docker, with Task Managers distributed across
> different VMs as part of a Docker Swarm.
>
> I understand Dynamic Scaling is not yet available in Flink. Therefore, if I
> wanted to increase the number of containers running Flink's task manager
> (scale up), I would need to create a savepoint, stop the running job, scale
> up my Task Manager containers, then resume the job.
>
> My question is: how do I create a savepoint? The documentation assumes you
> are using the Command Line Client, but I don't think I can access it if I am
> running Flink in containers. The Web UI doesn't allow you to create
> savepoints either. What do I do, in this case?
>
> Thank you very much for your help.
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/