Flink 1.8.0: Akka starting actor system with IP address instead of host name

[HarshithBolar]

Hi all,

 

We have recently upgraded from 1.7.2 to 1.8.0. In 1.7.2, when I start a task manager in Standalone mode, the actor system was being started with a host name. But after upgrading to 1.8.0, this is getting started with the IP address. As a result, the task managers on the dashboard show IP addresses instead of their hostnames. Is there some change that needs to be done while starting task managers when switching from 1.8.0 to 1.7.2?

 

This is how I’m starting the task manager - ${Flink_HOME}/bin/taskmanager.sh start

 

Including logs of both versions –

 

Flink 1.7.2:

                2019-05-17 08:36:59,421 WARN  org.apache.flink.configuration.Configuration                  - Config uses deprecated configuration key 'jobmanager.rpc.address' instead of proper key 'rest.address'

       2019-05-17 08:36:59,425 INFO  org.apache.flink.runtime.util.LeaderRetrievalUtils            - Trying to select the network interface and address to use by connecting to the leading JobManager.

       2019-05-17 08:36:59,425 INFO  org.apache.flink.runtime.util.LeaderRetrievalUtils            - TaskManager will try to connect for 10000 milliseconds before falling back to heuristics

       2019-05-17 08:36:59,428 INFO  org.apache.flink.runtime.net.ConnectionUtils                  - Retrieved new target address flink0-0.high.ue1.pre.aws.cloud.abc.com/10.86.94.11:6123.

 

       2019-05-17 08:36:59,430 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner       - TaskManager will use hostname/address 'flink1-0.high.ue1.pre.aws.cloud.abc.com' (10.86.94.11) for communication.

       2019-05-17 08:36:59,432 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils         - Trying to start actor system at flink1-0.high.ue1.pre.aws.cloud.abc.com:0

       2019-05-17 08:36:59,802 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger started

       2019-05-17 08:36:59,856 INFO  akka.remote.Remoting                                          - Starting remoting

       2019-05-17 08:36:59,964 INFO  akka.remote.Remoting                                          - Remoting started; listening on addresses :[akka.tcp://[hidden email]:20183]

       2019-05-17 08:36:59,966 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils         - Actor system started at akka.tcp://[hidden email]:20183

       2019-05-17 08:36:59,979 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner       - Trying to start actor system at flink1-0.high.ue1.pre.aws.cloud.abc.com:0

       2019-05-17 08:37:00,017 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger started

       2019-05-17 08:37:00,025 INFO  akka.remote.Remoting                                          - Starting remoting

 

Flink 1.8.0:

                2019-05-17 08:48:59,819 INFO  org.apache.flink.configuration.Configuration                  - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'

        2019-05-17 08:48:59,824 INFO  org.apache.flink.runtime.util.LeaderRetrievalUtils            - Trying to select the network interface and address to use by connecting to the leading JobManager.

        2019-05-17 08:48:59,824 INFO  org.apache.flink.runtime.util.LeaderRetrievalUtils            - TaskManager will try to connect for 10000 milliseconds before falling back to heuristics

        2019-05-17 08:48:59,827 INFO  org.apache.flink.runtime.net.ConnectionUtils                  - Retrieved new target address flink0-1.high.ue1.pre.aws.cloud.abc.com/10.16.74.117:6123.

        2019-05-17 08:48:59,830 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner       - TaskManager will use hostname/address 'flink1-1.high.ue1.pre.aws.cloud.abc.com' (10.86.94.11) for communication.

        2019-05-17 08:48:59,832 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils         - Trying to start actor system at 10.86.94.11:0

        2019-05-17 08:49:00,212 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger started

        2019-05-17 08:49:00,277 INFO  akka.remote.Remoting                                          - Starting remoting

        2019-05-17 08:49:00,422 INFO  akka.remote.Remoting                                          - Remoting started; listening on addresses :[akka.tcp://flink@10.86.94.11:12923]

        2019-05-17 08:49:00,429 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils         - Actor system started at akka.tcp://flink@10.86.94.11:12923

        2019-05-17 08:49:00,438 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner       - Trying to start actor system at 10.86.94.11:0

        2019-05-17 08:49:00,462 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger started

        2019-05-17 08:49:00,467 INFO  akka.remote.Remoting                                          - Starting remoting

 

Thanks,

Harshith