Allocating tasks to specific TaskManagers

[황혜조]

Hi, 

I am looking for a way to allocate each created subTask to a specific TaskManager.

Is there any way to force assigning tasks to specific taskManagers?

Thank you

Best regards,

Hyejo Hwang

[Piotr Nowojski-5]

Hi Hyejo,

I don't think it's possible. May I ask why do you want to do this? 

Best, Piotrek

pon., 1 mar 2021 o 21:02 황혜조 <[hidden email]> napisał(a):

Hi, 

I am looking for a way to allocate each created subTask to a specific TaskManager.

Is there any way to force assigning tasks to specific taskManagers?

Thank you

Best regards,

Hyejo Hwang

[Piotr Nowojski-5]

re-adding user mailing list

pt., 5 mar 2021 o 01:45 황혜조 <[hidden email]> napisał(a):

Hi Piotrek,

I am evaluating flink for constraint aware processing, which needs specific tasks being assigned to specific task managers.

For that, I passed registeredTaskManagers from JobMaster. However when I checked the registeredTaskManager variable, only one or two TaskManagers are registered even I started 9 TaskManagers. I would like to know how I can register every started TaskManager.

Best regards,

Hyejo

2021년 3월 3일 (수) 오후 7:37, Piotr Nowojski <[hidden email]>님이 작성:

Hi Hyejo,

I don't think it's possible. May I ask why do you want to do this? 

Best, Piotrek

pon., 1 mar 2021 o 21:02 황혜조 <[hidden email]> napisał(a):

Hi, 

I am looking for a way to allocate each created subTask to a specific TaskManager.

Is there any way to force assigning tasks to specific taskManagers?

Thank you

Best regards,

Hyejo Hwang

[Chesnay Schepler]

Are trying to do something along the lines of "deploy this subtask to a TM that has a GPU"?

If so, then the community is currently working on supporting such use-cases; see FLIP-56 / FLIP-156.

TaskManagers only register at the JobMaster if their slots are being used by a job. You cannot implement such a feature on the JobManager side alone, but need help from the ResourceManager to find the slots appropriate for your constraints.

On 3/5/2021 8:35 AM, Piotr Nowojski wrote:

re-adding user mailing list

pt., 5 mar 2021 o 01:45 황혜조 <[hidden email]> napisał(a):

Hi Piotrek,

I am evaluating flink for constraint aware processing, which needs specific tasks being assigned to specific task managers.

For that, I passed registeredTaskManagers from JobMaster. However when I checked the registeredTaskManager variable, only one or two TaskManagers are registered even I started 9 TaskManagers. I would like to know how I can register every started TaskManager.

Best regards,

Hyejo

2021년 3월 3일 (수) 오후 7:37, Piotr Nowojski <[hidden email]>님이 작성:

Hi Hyejo,

I don't think it's possible. May I ask why do you want to do this? 

Best, Piotrek

pon., 1 mar 2021 o 21:02 황혜조 <[hidden email]> napisał(a):

Hi, 

I am looking for a way to allocate each created subTask to a specific TaskManager.

Is there any way to force assigning tasks to specific taskManagers?

Thank you

Best regards,

Hyejo Hwang