Apache Flink - How to get heap dump when a job is failing in EMR

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Apache Flink - How to get heap dump when a job is failing in EMR

M Singh
Hi:

Is there any configuration to get heap dump when job fails in an EMR ? 

Thanks
Reply | Threaded
Open this post in threaded view
|

Re: Apache Flink - How to get heap dump when a job is failing in EMR

Yang Wang
I think it depends on the root cause of your job failure. Maybe the following jvm options could help you to get the heap dump.

1. -XX:+HeapDumpOnOutOfMemoryError
2. -XX:+HeapDumpBeforeFullGC
3. -XX:+HeapDumpAfterFullGC
4. -XX:HeapDumpPath=/tmp/heap.dump.1

Use env.java.opts to set java opts for all flink JVMs, including JM and TM . 
Use env.java.opts.jobmanager for JM and env.java.opts.taskmanager for TM.


Best,
Yang

M Singh <[hidden email]> 于2019年8月22日周四 上午2:13写道:
Hi:

Is there any configuration to get heap dump when job fails in an EMR ? 

Thanks