Re: deploying flink in AWS - some teething issues

Posted by Chakravarthy varaga on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/deploying-flink-in-AWS-some-teething-issues-tp12437p12440.html

Hi,

    Any updates here? I'm sure many would have faced similar issues like these, any help here is highly appreciated.

Best Regards

CVP

On Tue, Mar 28, 2017 at 5:47 PM, Chakravarthy varaga <[hidden email]> wrote:

Hi Team,

   If the flink cluster is conainerized and managed through by a container orchestrator,  

    1.  the orchestrator allocates resources for each JM. TM etc., say if the container (TM) needs to run with 2G RAM, how should this allocation be honoured by the TM when its JVM starts. I'm thinking of wrapping up a script that determines the resource allocation for the container and writes the flink-conf.yaml before the TM starts the process. Is this the way to go?

    2. The container orchestrator looks at health of the containers and is however unaware of the job health status runnning inside the container/cluster. How should this be determined?

Best Regards

CVP