Flink 1.1.3 web UI is loading very slowly

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink 1.1.3 web UI is loading very slowly

Yury Ruchin
Hi,

I'm seeing an issue with the load speed of Flink Web UI when running in YARN session. Initial load takes several minutes or even more, although according to the browser console there are only a couple of MBs to download. When the loading is complete, the UI itself is quite responsive.

I don't see such an issue with YARN UI loading from the same cluster over the same network. I suspected that YARN proxy may cause the slowdown and hit the direct Flink web UI URL - the same story. CPU, load average and memory consumption on the node hosting job manager are low. I gave jobmanager from 4Gb to 10Gb heap - no effect. 

Any ideas on how to approach the problem are appreciated.

Thanks,
Yury
Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.1.3 web UI is loading very slowly

Stephan Ewen
Not sure if that is the problem, but upon first access to a resource, The web server extracts the resource from the JAR file and puts it into the temp directpry. Maybe that is slow for whatever reason?

On Thu, Dec 15, 2016 at 8:04 PM, Yury Ruchin <[hidden email]> wrote:
Hi,

I'm seeing an issue with the load speed of Flink Web UI when running in YARN session. Initial load takes several minutes or even more, although according to the browser console there are only a couple of MBs to download. When the loading is complete, the UI itself is quite responsive.

I don't see such an issue with YARN UI loading from the same cluster over the same network. I suspected that YARN proxy may cause the slowdown and hit the direct Flink web UI URL - the same story. CPU, load average and memory consumption on the node hosting job manager are low. I gave jobmanager from 4Gb to 10Gb heap - no effect. 

Any ideas on how to approach the problem are appreciated.

Thanks,
Yury

Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.1.3 web UI is loading very slowly

Yury Ruchin
Thanks for the clue, Stephan! I will check.

2016-12-16 12:44 GMT+03:00 Stephan Ewen <[hidden email]>:
Not sure if that is the problem, but upon first access to a resource, The web server extracts the resource from the JAR file and puts it into the temp directpry. Maybe that is slow for whatever reason?

On Thu, Dec 15, 2016 at 8:04 PM, Yury Ruchin <[hidden email]> wrote:
Hi,

I'm seeing an issue with the load speed of Flink Web UI when running in YARN session. Initial load takes several minutes or even more, although according to the browser console there are only a couple of MBs to download. When the loading is complete, the UI itself is quite responsive.

I don't see such an issue with YARN UI loading from the same cluster over the same network. I suspected that YARN proxy may cause the slowdown and hit the direct Flink web UI URL - the same story. CPU, load average and memory consumption on the node hosting job manager are low. I gave jobmanager from 4Gb to 10Gb heap - no effect. 

Any ideas on how to approach the problem are appreciated.

Thanks,
Yury


Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.1.3 web UI is loading very slowly

Ufuk Celebi
If it is not what Stephan said, you can check requests directly against the REST API and see if you experience the same slow down there.

https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/rest_api.html

– Ufuk

On 16 December 2016 at 10:52:18, Yury Ruchin ([hidden email]) wrote:

> Thanks for the clue, Stephan! I will check.
>  
> 2016-12-16 12:44 GMT+03:00 Stephan Ewen :
>  
> > Not sure if that is the problem, but upon first access to a resource, The
> > web server extracts the resource from the JAR file and puts it into the
> > temp directpry. Maybe that is slow for whatever reason?
> >
> > On Thu, Dec 15, 2016 at 8:04 PM, Yury Ruchin  
> > wrote:
> >
> >> Hi,
> >>
> >> I'm seeing an issue with the load speed of Flink Web UI when running in
> >> YARN session. Initial load takes several minutes or even more, although
> >> according to the browser console there are only a couple of MBs to
> >> download. When the loading is complete, the UI itself is quite responsive.
> >>
> >> I don't see such an issue with YARN UI loading from the same cluster over
> >> the same network. I suspected that YARN proxy may cause the slowdown and
> >> hit the direct Flink web UI URL - the same story. CPU, load average and
> >> memory consumption on the node hosting job manager are low. I gave
> >> jobmanager from 4Gb to 10Gb heap - no effect.
> >>
> >> Any ideas on how to approach the problem are appreciated.
> >>
> >> Thanks,
> >> Yury
> >>
> >
> >
>