custom scheduler in Flink?

[#ZHANG SHUHAO#]

Hi everyone,

 

I want to develop a custom task scheduler in Flink, specifically, I want to control the scheduling of components of an topology into specific hosts, where should I start with? Is there an example program or tutorial about this? Thanks!

 

Thanks.

Best regards.

Shuhao Zhang (Tony)

[phone]

 

[Aljoscha Krettek]

Hi,

I'm afraid there is no documentation about schedulers, especially at this low level. Maybe this new design proposal would of interest for you, though: https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures In there is a link to the mailing list discussion and the design doc in Google Docs.

Cheers,

Aljoscha

On Tue, 5 Jul 2016 at 05:12 #ZHANG SHUHAO# <[hidden email]> wrote:

Hi everyone,

 

I want to develop a custom task scheduler in Flink, specifically, I want to control the scheduling of components of an topology into specific hosts, where should I start with? Is there an example program or tutorial about this? Thanks!

 

Thanks.

Best regards.

Shuhao Zhang (Tony)

[phone]