Re: How to safely update jobs in-flight using Apache Flink on AWS EMR?

[Dan]

Hi!  I'm assuming this question comes up regularly with AWS EMR.  I posted it on Stack Overflow.

https://stackoverflow.com/questions/62309400/how-to-safely-update-jobs-in-flight-using-apache-flink-on-aws-emr

------------------------------------------------

I was not able to find instructions for how to update code safely. I see Flink docs on how to use savepoints. I'd expect an easy solution for updating Flink jobs in AWS EMR.

https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/deployment/aws.html

https://ci.apache.org/projects/flink/flink-docs-release-1.10/ops/upgrading.html

https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/savepoints.html

I was expecting instructions like the following (but not for Dataflow and Apache Beam):

https://cloud.google.com/dataflow/docs/guides/updating-a-pipeline

https://medium.com/google-cloud/restarting-cloud-dataflow-in-flight-9c688c49adfd