Remote Debugging Flink
Locked
 
|
Hi, I am new to flink and trying to remote debug flink cluster. I followed the instructions mentioned in the link[1] but when I do that I could not run the SocketWindowWordCount example(any example at all). The main problem is there are no task slots or task manager initiated. Then I followed the link[2] and set the java.opts for task manager but still don't have any task slots initiated. I am currently running flink instance in the local machine. I checked the Dispatcher’s web frontend to see whether slots have initiated or not. The error I am getting at the terminal is like: Caused by: org.apache.flink.runtime. at org.apache.flink.runtime. at java.util.concurrent. Can you please suggest the correct way to do this? Best, inthira source links [1]https://cwiki.apache.org/ [2]https://stackoverflow.com/ Inthirakumaaran. Undergraduate student, Department of Computer Science and Engineering University of Moratuwa. ContactNo:0766598050 |
|
|
Hi, did you specify the `suspend=y` flag? This could stop the TaskManagers from connecting to the ResourceManager and offering their slots. This can then ultimately lead to the NoResourceAvailableException if you don't allow the TaskManagers to continue. So my suspicion would be that you don't connect to the started TaskManagers with your remote debugger. Could you check via jps whether TaskManager processes have started? It would also be helpful to know exact which commands you are executing. Cheers, Till On Fri, Jun 22, 2018 at 1:39 PM Tharmakulasingham Inthirakumaaran <[hidden email]> wrote:
|
RE: Remote Debugging Flink
|
|
In reply to this post by inthira
In conf.yaml file, replace the setting ‘env.java.opts: "-agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005" ‘ as mentioned in the link with the below
setting env.java.opts.taskmanager: "-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005" Regards, Teena From: Tharmakulasingham Inthirakumaaran <[hidden email]>
Hi,
I am new to flink and trying to remote debug flink cluster. I followed the instructions mentioned in the link[1] but when I do that I could not run the SocketWindowWordCount
example(any example at all). The main problem is there are no task slots or task manager initiated. Then I followed the link[2] and set the java.opts for task manager but still don't have any task slots initiated. I am currently running flink instance in the local machine. I checked the Dispatcher’s web frontend to see whether slots have initiated or not. The error I am getting at the terminal is like: Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not allocate all requires slots within timeout of 300000 ms.
Slots required: 2, slots allocated: 0 at org.apache.flink.runtime.executiongraph.ExecutionGraph.lambda$scheduleEager$3(ExecutionGraph.java:984) at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:870)... Can you please suggest the correct way to do this? Best, inthira source links [1]https://cwiki.apache.org/confluence/display/FLINK/Remote+Debugging+of+Flink+Clusters [2]https://stackoverflow.com/questions/50125340/remote-debugging-flink-local-cluster
-- Inthirakumaaran. Undergraduate student, Department of Computer Science and Engineering University of Moratuwa. ContactNo:0766598050 |
| Free forum by Nabble | Edit this page |