Scaling Flink

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Scaling Flink

Navneeth Krishnan
Hi All,

Has anyone tried scaling out flink cluster on EMR based on CPU usage/ kafka lag/ back pressure monitoring? If so can you provide some insights on how it could be achieved and sample scripts if possible. Thanks a lot.

Thanks,
Navneeth
Reply | Threaded
Open this post in threaded view
|

Re: Scaling Flink

Navneeth Krishnan
Hi,

Any suggestions would really help. Thanks.

On Mon, Jan 15, 2018 at 12:07 AM, Navneeth Krishnan <[hidden email]> wrote:
Hi All,

Has anyone tried scaling out flink cluster on EMR based on CPU usage/ kafka lag/ back pressure monitoring? If so can you provide some insights on how it could be achieved and sample scripts if possible. Thanks a lot.

Thanks,
Navneeth

Reply | Threaded
Open this post in threaded view
|

Re: Scaling Flink

Hung
What about scaling up with #task slots left?
You can obtain this information from Flink's endpoint.

Cheers,

Sendoh



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/