Flink 1.2.0->1.3.2 TaskManager reporting to JobManager

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink 1.2.0->1.3.2 TaskManager reporting to JobManager

Chan, Regina

Hi,

 

As I moved from Flink 1.2.0 to 1.3.2 I noticed that the TaskManager may have all tasks with FINISHED but then take about 2-3 minutes before the Job execution switches to FINISHED. What is it doing that’s taking this long? This was a parallelism = 1 case…

 

Regina Chan

Goldman Sachs Enterprise Platforms, Data Architecture

30 Hudson Street, 37th floor | Jersey City, NY 07302 (  (212) 902-5697

 

Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.2.0->1.3.2 TaskManager reporting to JobManager

Nico Kruber
Hi Regina,
can you explain a bit more on what you are trying to do and how this is
set up? I quickly tried to reproduce locally by starting a cluster and
could not see this behaviour.

Also, can you try to increase the loglevel to INFO and see whether you
see anything suspicious in the logs?


Nico

On 28/11/17 00:19, Chan, Regina wrote:

> Hi,
>
>  
>
> As I moved from Flink 1.2.0 to 1.3.2 I noticed that the TaskManager may
> have all tasks with FINISHED but then take about 2-3 minutes before the
> Job execution switches to FINISHED. What is it doing that’s taking this
> long? This was a parallelism = 1 case…
>
>  
>
> *Regina Chan*
>
> *Goldman Sachs****–*Enterprise Platforms, Data Architecture
>
> *30 Hudson Street, 37th floor | Jersey City, NY 07302*(  (212) 902-5697**
>
>  
>


signature.asc (201 bytes) Download Attachment