(DEPRECATED) Apache Flink User Mailing List archive.

The mapping relationship between Checkpoint subtask id and Task subtask id

classic Classic list List threaded Threaded
♦
♦
 6 messages Options
sanmutongzi
Reply | Threaded
Open this post in threaded view
♦
♦
|

The mapping relationship between Checkpoint subtask id and Task subtask id

sanmutongzi
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint.
In flink web ui I noticed  for job task subtask id it start from 0 and for checkpoint  subtask id it start from number 1,.
How can I find out which checkpoint subtask id belongs to which job task subtask id, just simply use checkpoint subtask ID -1 will be ok?
Thanks
Yun Tang
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Yun Tang
Hi

Yes, you are right. Just simply use checkpoint subtask_id -1 would find the corresponding task subtask_id.

Best
Yun Tang
From: 杨东晓 <[hidden email]>
Sent: Friday, February 14, 2020 10:11
To: user <[hidden email]>
Subject: The mapping relationship between Checkpoint subtask id and Task subtask id
 
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint.
In flink web ui I noticed  for job task subtask id it start from 0 and for checkpoint  subtask id it start from number 1,.
How can I find out which checkpoint subtask id belongs to which job task subtask id, just simply use checkpoint subtask ID -1 will be ok?
Thanks
Zhijiang(wangzhijiang999)
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Zhijiang(wangzhijiang999)
If the id is not consistent in different parts, maybe it is worth creating a jira ticket for better improving the user experience.
If anyone wants to work on it, please ping me then I can give a hand.

Best,
Zhijiang
------------------------------------------------------------------
From:Yun Tang <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 10:52
To:杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Hi

Yes, you are right. Just simply use checkpoint subtask_id -1 would find the corresponding task subtask_id.

Best
Yun Tang
From: 杨东晓 <[hidden email]>
Sent: Friday, February 14, 2020 10:11
To: user <[hidden email]>
Subject: The mapping relationship between Checkpoint subtask id and Task subtask id
 
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint.
In flink web ui I noticed  for job task subtask id it start from 0 and for checkpoint  subtask id it start from number 1,.
How can I find out which checkpoint subtask id belongs to which job task subtask id, just simply use checkpoint subtask ID -1 will be ok?
Thanks
bupt_ljy
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re:Re: The mapping relationship between Checkpoint subtask id and Task subtask id

bupt_ljy

Hi Zhijiang,


It did confuses us when we’re tring to locate the unfinished subtask in Checkpoint UI last time. I’ve created an issue[1] for this. 

@杨东晓 Do you have time to work on this?


[1]. https://issues.apache.org/jira/browse/FLINK-16051


Best Regards,

Jiayi Liao




At 2020-02-14 10:14:27, "Zhijiang" <[hidden email]> wrote:

If the id is not consistent in different parts, maybe it is worth creating a jira ticket for better improving the user experience.
If anyone wants to work on it, please ping me then I can give a hand.

Best,
Zhijiang
------------------------------------------------------------------
From:Yun Tang <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 10:52
To:杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Hi

Yes, you are right. Just simply use checkpoint subtask_id -1 would find the corresponding task subtask_id.

Best
Yun Tang
From: 杨东晓 <[hidden email]>
Sent: Friday, February 14, 2020 10:11
To: user <[hidden email]>
Subject: The mapping relationship between Checkpoint subtask id and Task subtask id
 
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint.
In flink web ui I noticed  for job task subtask id it start from 0 and for checkpoint  subtask id it start from number 1,.
How can I find out which checkpoint subtask id belongs to which job task subtask id, just simply use checkpoint subtask ID -1 will be ok?
Thanks



 
Zhijiang(wangzhijiang999)
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Zhijiang(wangzhijiang999)
Let's move the further discussion onto the jira page. 
I have not much time recently for working on this. If you want to take it, I can assign it to you and help review the PR if have time then. Or I can find other possible guys work on it future.

Best,
Zhijiang

------------------------------------------------------------------
From:Jiayi Liao <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 12:39
To:Zhijiang <[hidden email]>
Cc:Yun Tang <[hidden email]>; 杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re:Re: The mapping relationship between Checkpoint subtask id and Task subtask id


Hi Zhijiang,


It did confuses us when we’re tring to locate the unfinished subtask in Checkpoint UI last time. I’ve created an issue[1] for this. 

@杨东晓 Do you have time to work on this?


[1]. https://issues.apache.org/jira/browse/FLINK-16051


Best Regards,

Jiayi Liao




At 2020-02-14 10:14:27, "Zhijiang" <[hidden email]> wrote:

If the id is not consistent in different parts, maybe it is worth creating a jira ticket for better improving the user experience.
If anyone wants to work on it, please ping me then I can give a hand.

Best,
Zhijiang
------------------------------------------------------------------
From:Yun Tang <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 10:52
To:杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Hi

Yes, you are right. Just simply use checkpoint subtask_id -1 would find the corresponding task subtask_id.

Best
Yun Tang
From: 杨东晓 <[hidden email]>
Sent: Friday, February 14, 2020 10:11
To: user <[hidden email]>
Subject: The mapping relationship between Checkpoint subtask id and Task subtask id
 
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint.
In flink web ui I noticed  for job task subtask id it start from 0 and for checkpoint  subtask id it start from number 1,.
How can I find out which checkpoint subtask id belongs to which job task subtask id, just simply use checkpoint subtask ID -1 will be ok?
Thanks



 
Zhijiang(wangzhijiang999)
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Zhijiang(wangzhijiang999)
BTW, the FLIP-75 is going for the user experience of web UI.
@Yadong Xiehave we already considered this issue to unify the ids in different parts in FLIP-75? 

Best,
Zhijiang
------------------------------------------------------------------
From:Zhijiang <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 13:03
To:Jiayi Liao <[hidden email]>
Cc:Yun Tang <[hidden email]>; 杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re: Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Let's move the further discussion onto the jira page. 
I have not much time recently for working on this. If you want to take it, I can assign it to you and help review the PR if have time then. Or I can find other possible guys work on it future.

Best,
Zhijiang

------------------------------------------------------------------
From:Jiayi Liao <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 12:39
To:Zhijiang <[hidden email]>
Cc:Yun Tang <[hidden email]>; 杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re:Re: The mapping relationship between Checkpoint subtask id and Task subtask id


Hi Zhijiang,


It did confuses us when we’re tring to locate the unfinished subtask in Checkpoint UI last time. I’ve created an issue[1] for this. 

@杨东晓 Do you have time to work on this?


[1]. https://issues.apache.org/jira/browse/FLINK-16051


Best Regards,

Jiayi Liao




At 2020-02-14 10:14:27, "Zhijiang" <[hidden email]> wrote:

If the id is not consistent in different parts, maybe it is worth creating a jira ticket for better improving the user experience.
If anyone wants to work on it, please ping me then I can give a hand.

Best,
Zhijiang
------------------------------------------------------------------
From:Yun Tang <[hidden email]>
Send Time:2020 Feb. 14 (Fri.) 10:52
To:杨东晓 <[hidden email]>; user <[hidden email]>
Subject:Re: The mapping relationship between Checkpoint subtask id and Task subtask id

Hi

Yes, you are right. Just simply use checkpoint subtask_id -1 would find the corresponding task subtask_id.

Best
Yun Tang
From: 杨东晓 <[hidden email]>
Sent: Friday, February 14, 2020 10:11
To: user <[hidden email]>
Subject: The mapping relationship between Checkpoint subtask id and Task subtask id
 
Hi, I'm trying to figure out the different end2end duration for each subtask id in checkpoint.
In flink web ui I noticed  for job task subtask id it start from 0 and for checkpoint  subtask id it start from number 1,.
How can I find out which checkpoint subtask id belongs to which job task subtask id, just simply use checkpoint subtask ID -1 will be ok?
Thanks



 
Free forum by Nabble Edit this page