(DEPRECATED) Apache Flink User Mailing List archive.

taskmanager initialization failed

classic Classic list List threaded Threaded
♦
♦
 2 messages Options
V N, Suchithra (Nokia - IN/Bangalore)
Reply | Threaded
Open this post in threaded view
♦
♦
|

taskmanager initialization failed

V N, Suchithra (Nokia - IN/Bangalore)

Hi,

 

With flink 1.11.1 version, taskmanager initialization is failing with below error. Could you please help to debug the issue.

 

log":"[main] org.apache.flink.runtime.io.network.netty.NettyConfig NettyConfig [server address: /0.0.0.0, server port: 4121, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 4 (manual), number of client threads: 4 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]"}

log":"[main] org.apache.flink.runtime.taskexecutor.TaskManagerRunner TaskManager initialization failed."}

java.lang.NoSuchFieldError: FORCE_PARTITION_RELEASE_ON_CONSUMPTION

        at org.apache.flink.runtime.taskmanager.NettyShuffleEnvironmentConfiguration.fromConfiguration(NettyShuffleEnvironmentConfiguration.java:221) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.io.network.NettyShuffleServiceFactory.createShuffleEnvironment(NettyShuffleServiceFactory.java:61) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.io.network.NettyShuffleServiceFactory.createShuffleEnvironment(NettyShuffleServiceFactory.java:49) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerServices.createShuffleEnvironment(TaskManagerServices.java:373) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerServices.fromConfiguration(TaskManagerServices.java:270) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.startTaskManager(TaskManagerRunner.java:375) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:157) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:305) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$2(TaskManagerRunner.java:320) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at java.security.AccessController.doPrivileged(Native Method) ~[?:?]

        at javax.security.auth.Subject.doAs(Subject.java:423) ~[?:?]

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) ~[flink-shaded-hadoop-2-uber-2.6.5-7.0.jar:2.6.5-7.0]

        at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:319) [flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:297) [flink-dist_2.11-1.11.1.jar:1.11.1]

 

Thanks,

Suchithra
rmetzger0
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: taskmanager initialization failed

rmetzger0
Hi Suchithra,

this is very likely a version mixup: Can you make sure all jars in your classpath are Flink 1.11.1?

On Mon, May 17, 2021 at 2:05 PM V N, Suchithra (Nokia - IN/Bangalore) <[hidden email]> wrote:

Hi,

 

With flink 1.11.1 version, taskmanager initialization is failing with below error. Could you please help to debug the issue.

 

log":"[main] org.apache.flink.runtime.io.network.netty.NettyConfig NettyConfig [server address: /0.0.0.0, server port: 4121, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 4 (manual), number of client threads: 4 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]"}

log":"[main] org.apache.flink.runtime.taskexecutor.TaskManagerRunner TaskManager initialization failed."}

java.lang.NoSuchFieldError: FORCE_PARTITION_RELEASE_ON_CONSUMPTION

        at org.apache.flink.runtime.taskmanager.NettyShuffleEnvironmentConfiguration.fromConfiguration(NettyShuffleEnvironmentConfiguration.java:221) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.io.network.NettyShuffleServiceFactory.createShuffleEnvironment(NettyShuffleServiceFactory.java:61) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.io.network.NettyShuffleServiceFactory.createShuffleEnvironment(NettyShuffleServiceFactory.java:49) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerServices.createShuffleEnvironment(TaskManagerServices.java:373) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerServices.fromConfiguration(TaskManagerServices.java:270) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.startTaskManager(TaskManagerRunner.java:375) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:157) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:305) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$2(TaskManagerRunner.java:320) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at java.security.AccessController.doPrivileged(Native Method) ~[?:?]

        at javax.security.auth.Subject.doAs(Subject.java:423) ~[?:?]

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) ~[flink-shaded-hadoop-2-uber-2.6.5-7.0.jar:2.6.5-7.0]

        at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41) ~[flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:319) [flink-dist_2.11-1.11.1.jar:1.11.1]

        at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:297) [flink-dist_2.11-1.11.1.jar:1.11.1]

 

Thanks,

Suchithra
Free forum by Nabble Edit this page