Pergem exception from web-client

[Flavio Pompermaier]

Hi to all,

I'm facing an "OutOfMemoryError: PermGen space" running multiple times my job from the web client interface.

Where do I need to increase it?

The full stacktrace is:

org.apache.flink.client.program.ProgramInvocationException: The program's entry point class 'XXXX' caused an exception during initialization: PermGen space

at org.apache.flink.client.program.PackagedProgram.loadMainClass(PackagedProgram.java:531)

at org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:142)

at org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)

at org.apache.flink.client.web.PactJobJSONServlet.doGet(PactJobJSONServlet.java:77)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)

at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)

at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)

at org.eclipse.jetty.server.Server.handle(Server.java:352)

at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)

at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)

at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)

at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)

at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)

at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)

at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)

at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.OutOfMemoryError: PermGen space

at java.lang.Class.forName0(Native Method)

at java.lang.Class.forName(Class.java:270)

at org.apache.flink.client.program.PackagedProgram.loadMainClass(PackagedProgram.java:516)

... 24 more

Best,

Flavio

[Matthias J. Sax]

Hi,

you need to increase JVM parameter "-XX:MaxPermSize="
The default value should be something like "64m"

Just add the flag to variable JVM_ARGS in "bin/webclient.sh" (line 33).
-> Compare "bin/jobmanager.sh" (line 35)


-Matthias

On 06/24/2015 06:38 PM, Flavio Pompermaier wrote:

> Hi to all,
>
> I'm facing an "OutOfMemoryError: PermGen space" running multiple times
> my job from the web client interface.
> Where do I need to increase it?
>
> The full stacktrace is:
>
> org.apache.flink.client.program.ProgramInvocationException: The
> program's entry point class 'XXXX' caused an exception during
> initialization: PermGen space
> at
> org.apache.flink.client.program.PackagedProgram.loadMainClass(PackagedProgram.java:531)
> at
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:142)
> at
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)
> at
> org.apache.flink.client.web.PactJobJSONServlet.doGet(PactJobJSONServlet.java:77)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
> at org.eclipse.jetty.server.Server.handle(Server.java:352)
> at
> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
> at
> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
> at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
> at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.OutOfMemoryError: PermGen space
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:270)
> at
> org.apache.flink.client.program.PackagedProgram.loadMainClass(PackagedProgram.java:516)
> ... 24 more
>
>
>
> Best,
> Flavio

[Flavio Pompermaier]

ok thanks Matthias

On 24 Jun 2015 21:00, "Matthias J. Sax" <[hidden email]> wrote:

Hi,

you need to increase JVM parameter "-XX:MaxPermSize="
The default value should be something like "64m"

Just add the flag to variable JVM_ARGS in "bin/webclient.sh" (line 33).
-> Compare "bin/jobmanager.sh" (line 35)


-Matthias

On 06/24/2015 06:38 PM, Flavio Pompermaier wrote:
> Hi to all,
>
> I'm facing an "OutOfMemoryError: PermGen space" running multiple times
> my job from the web client interface.
> Where do I need to increase it?
>
> The full stacktrace is:
>
> org.apache.flink.client.program.ProgramInvocationException: The
> program's entry point class 'XXXX' caused an exception during
> initialization: PermGen space
> at
> org.apache.flink.client.program.PackagedProgram.loadMainClass(PackagedProgram.java:531)
> at
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:142)
> at
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)
> at
> org.apache.flink.client.web.PactJobJSONServlet.doGet(PactJobJSONServlet.java:77)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
> at org.eclipse.jetty.server.Server.handle(Server.java:352)
> at
> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
> at
> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
> at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
> at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.OutOfMemoryError: PermGen space
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:270)
> at
> org.apache.flink.client.program.PackagedProgram.loadMainClass(PackagedProgram.java:516)
> ... 24 more
>
>
>
> Best,
> Flavio