2020-02-27 06:28:23.599 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (8/20) (a9e0c0b9656b6c4dc815ca33ea053a05) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.599 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (9/20) (cca1a4ebf780eb892c9d002c4da5ccca) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.599 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (10/20) (bab111a8b1e931589b1bf0108d2d0d1d) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.599 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (11/20) (f17f2024a9b05ae992f6894d22564778) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (12/20) (2f4c94cd28112905a92f1305dad9deb5) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (13/20) (54d1b466572c1860d7a6ffeb05f98e7c) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (14/20) (a89ac774e6a72b3250b2ba2fdf69e0f6) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (15/20) (b61eefdfb7883806514fabd63270cbc6) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (16/20) (8bbc34d46164d1d22b7c072ef11ca838) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (17/20) (680de8e901201d465c2413a179f5fabb) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (18/20) (96c0ce841c2027685d1102aa65c1bd8c) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (19/20) (915a9e7d2f699160af819122ce1122b4) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.600 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (20/20) (97a0d50089a9a59087d4f8c817b70134) switched from RUNNING to CANCELING. 2020-02-27 06:28:23.605 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 11f606e24ee0fef1af0e4af5d340319c: JobManager is no longer the leader.. 2020-02-27 06:28:23.605 [flink-akka.actor.default-dispatcher-9891] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job HHW_WEATHER_PROCESSOR(5a910928a71b469a091be168b0e74722). 2020-02-27 06:28:23.610 [flink-akka.actor.default-dispatcher-9892] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool. 2020-02-27 06:28:23.611 [flink-akka.actor.default-dispatcher-9892] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool. 2020-02-27 06:28:23.611 [flink-akka.actor.default-dispatcher-9892] level=INFO o.a.f.runtime.leaderelection.ZooKeeperLeaderElectionService - Stopping ZooKeeperLeaderElectionService ZooKeeperLeaderElectionService{leaderPath='/leader/5a910928a71b469a091be168b0e74722/job_manager_lock'}. 2020-02-27 06:28:23.903 [main-SendThread(100-108-34-125.ZOOKEEPER:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Opening socket connection to server 100-108-34-125.ZOOKEEPER/100.108.34.125:2181 2020-02-27 06:28:24.390 [flink-rest-server-netty-worker-thread-3] level=ERROR o.a.f.runtime.rest.handler.cluster.ClusterOverviewHandler - Could not retrieve the redirect address. \njava.util.concurrent.CompletionException: org.apache.flink.runtime.rpc.exceptions.FencingTokenException: Fencing token not set: Ignoring message LocalFencedMessage(9fceec07320bc7477fb19e386b0f4823, LocalRpcInvocation(requestRestAddress(Time))) sent to akka.tcp://flink@JOBMANAGER:6126/user/dispatcher because the fencing token is null.at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:593) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) at org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:772) at akka.dispatch.OnComplete.internal(Future.scala:258) at akka.dispatch.OnComplete.internal(Future.scala:256) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:186) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:183) at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) at org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:83) at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44) at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252) at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:534) at akka.actor.ActorRef.tell(ActorRef.scala:130) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.sendErrorIfSender(AkkaRpcActor.java:371) at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:57) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.onReceive(AkkaRpcActor.java:142) at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.onReceive(FencedAkkaRpcActor.java:40) at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165) at akka.actor.Actor$class.aroundReceive(Actor.scala:502) at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526) at akka.actor.ActorCell.invoke(ActorCell.scala:495) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257) at akka.dispatch.Mailbox.run(Mailbox.scala:224) at akka.dispatch.Mailbox.exec(Mailbox.scala:234) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)\nCaused by: org.apache.flink.runtime.rpc.exceptions.FencingTokenException: Fencing token not set: Ignoring message LocalFencedMessage(9fceec07320bc7477fb19e386b0f4823, LocalRpcInvocation(requestRestAddress(Time))) sent to akka.tcp://flink@JOBMANAGER:6126/user/dispatcher because the fencing token is null. at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:59) ... 14 common frames omitted 2020-02-27 06:28:34.389 [flink-rest-server-netty-worker-thread-1] level=ERROR o.a.f.runtime.rest.handler.cluster.ClusterOverviewHandler - Could not retrieve the redirect address. \njava.util.concurrent.CompletionException: org.apache.flink.runtime.rpc.exceptions.FencingTokenException: Fencing token not set: Ignoring message LocalFencedMessage(9fceec07320bc7477fb19e386b0f4823, LocalRpcInvocation(requestRestAddress(Time))) sent to akka.tcp://flink@JOBMANAGER:6126/user/dispatcher because the fencing token is null. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:593) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) at org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:772) at akka.dispatch.OnComplete.internal(Future.scala:258) at akka.dispatch.OnComplete.internal(Future.scala:256) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:186) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:183) at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) at org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:83) at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44) at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252) at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:534) at akka.actor.ActorRef.tell(ActorRef.scala:130) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.sendErrorIfSender(AkkaRpcActor.java:371) at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:57) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.onReceive(AkkaRpcActor.java:142) at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.onReceive(FencedAkkaRpcActor.java:40) at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165) at akka.actor.Actor$class.aroundReceive(Actor.scala:502) at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526) at akka.actor.ActorCell.invoke(ActorCell.scala:495) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257) at akka.dispatch.Mailbox.run(Mailbox.scala:224) at akka.dispatch.Mailbox.exec(Mailbox.scala:234) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)\nCaused by: org.apache.flink.runtime.rpc.exceptions.FencingTokenException: Fencing token not set: Ignoring message LocalFencedMessage(9fceec07320bc7477fb19e386b0f4823, LocalRpcInvocation(requestRestAddress(Time))) sent to akka.tcp://flink@JOBMANAGER:6126/user/dispatcher because the fencing token is null. at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:59) ... 14 common frames omitted 2020-02-27 06:28:37.250 [main-SendThread(100-108-34-125.ZOOKEEPER:2181)] level=WARN o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 13678ms for sessionid 0x1707fa69c9d0000 2020-02-27 06:28:37.250 [main-SendThread(100-108-34-125.ZOOKEEPER:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 13678ms for sessionid 0x1707fa69c9d0000, closing socket connection and attempting reconnect 2020-02-27 06:28:38.264 [main-SendThread(100.120.251.146:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Opening socket connection to server 100.120.251.146/100.120.251.146:2181 2020-02-27 06:28:38.574 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15002) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:38.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:38.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:38.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:38.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:38.613 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15041) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:38.615 [flink-akka.actor.default-dispatcher-9900] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15043) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:489) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:114) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.DeleteBuilderImpl$5.call(DeleteBuilderImpl.java:250) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.DeleteBuilderImpl$5.call(DeleteBuilderImpl.java:244) at org.apache.flink.shaded.curator.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.DeleteBuilderImpl.pathInForeground(DeleteBuilderImpl.java:241) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.DeleteBuilderImpl.forPath(DeleteBuilderImpl.java:225) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.DeleteBuilderImpl.forPath(DeleteBuilderImpl.java:35) at org.apache.flink.runtime.zookeeper.ZooKeeperStateHandleStore.release(ZooKeeperStateHandleStore.java:396) at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.releaseJobGraph(ZooKeeperSubmittedJobGraphStore.java:302) at org.apache.flink.runtime.dispatcher.Dispatcher.cleanUpJobData(Dispatcher.java:625) at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$removeJob$22(Dispatcher.java:600) at java.util.concurrent.CompletableFuture.uniRun(CompletableFuture.java:705) at java.util.concurrent.CompletableFuture$UniRun.tryFire(CompletableFuture.java:687) at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442) at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) 2020-02-27 06:28:43.575 [Checkpoint Timer] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20002) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:489) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:282) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:278) at org.apache.flink.shaded.curator.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:275) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:261) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:34) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.shared.SharedValue.trySetValue(SharedValue.java:174) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.shared.SharedCount.trySetCount(SharedCount.java:111) at org.apache.flink.runtime.checkpoint.ZooKeeperCheckpointIDCounter.getAndIncrement(ZooKeeperCheckpointIDCounter.java:129) at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.triggerCheckpoint(CheckpointCoordinator.java:508) at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.triggerCheckpoint(CheckpointCoordinator.java:395) at org.apache.flink.runtime.checkpoint.CheckpointCoordinator$ScheduledTrigger.run(CheckpointCoordinator.java:1233) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:43.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:43.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:43.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:43.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:43.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:43.614 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (20042) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:44.399 [flink-rest-server-netty-worker-thread-3] level=ERROR o.a.f.runtime.rest.handler.cluster.ClusterOverviewHandler - Could not retrieve the redirect address. \njava.util.concurrent.CompletionException: org.apache.flink.runtime.rpc.exceptions.FencingTokenException: Fencing token not set: Ignoring message LocalFencedMessage(9fceec07320bc7477fb19e386b0f4823, LocalRpcInvocation(requestRestAddress(Time))) sent to akka.tcp://flink@JOBMANAGER:6126/user/dispatcher because the fencing token is null. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:593) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) at org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:772) at akka.dispatch.OnComplete.internal(Future.scala:258) at akka.dispatch.OnComplete.internal(Future.scala:256) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:186) at akka.dispatch.japi$CallbackBridge.apply(Future.scala:183) at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) at org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:83) at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44) at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252) at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:534) at akka.actor.ActorRef.tell(ActorRef.scala:130) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.sendErrorIfSender(AkkaRpcActor.java:371) at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:57) at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.onReceive(AkkaRpcActor.java:142) at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.onReceive(FencedAkkaRpcActor.java:40) at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165) at akka.actor.Actor$class.aroundReceive(Actor.scala:502) at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526) at akka.actor.ActorCell.invoke(ActorCell.scala:495) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257) at akka.dispatch.Mailbox.run(Mailbox.scala:224) at akka.dispatch.Mailbox.exec(Mailbox.scala:234) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)\nCaused by: org.apache.flink.runtime.rpc.exceptions.FencingTokenException: Fencing token not set: Ignoring message LocalFencedMessage(9fceec07320bc7477fb19e386b0f4823, LocalRpcInvocation(requestRestAddress(Time))) sent to akka.tcp://flink@JOBMANAGER:6126/user/dispatcher because the fencing token is null. at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:59) ... 14 common frames omitted 2020-02-27 06:28:48.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (25003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:48.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (25003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:48.577 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (25004) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:51.605 [main-SendThread(100.120.251.146:2181)] level=WARN o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 14255ms for sessionid 0x1707fa69c9d0000 2020-02-27 06:28:51.605 [main-SendThread(100.120.251.146:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 14255ms for sessionid 0x1707fa69c9d0000, closing socket connection and attempting reconnect 2020-02-27 06:28:53.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (30003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:53.575 [Curator-Framework-0] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (30003) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:835) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:53.576 [Curator-Framework-0] level=ERROR o.a.f.s.c.o.a.curator.framework.imps.CuratorFrameworkImpl - Background operation retry gave up \norg.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:728) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:857) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-02-27 06:28:53.576 [Curator-Framework-0] level=ERROR o.a.f.runtime.webmonitor.retriever.impl.RpcGatewayRetriever - Received error from LeaderRetrievalService. \norg.apache.flink.util.FlinkException: Unhandled error in ZooKeeperLeaderRetrievalService:Background operation retry gave up at org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalService.unhandledError(ZooKeeperLeaderRetrievalService.java:209) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:576) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:572) at org.apache.flink.shaded.curator.org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:93) at org.apache.flink.shaded.curator.org.apache.curator.shaded.com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) at org.apache.flink.shaded.curator.org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:85) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.logError(CuratorFrameworkImpl.java:571) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:740) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:857) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)\nCaused by: org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:728) ... 10 common frames omitted 2020-02-27 06:28:53.576 [Curator-Framework-0] level=ERROR o.a.f.runtime.webmonitor.retriever.impl.RpcGatewayRetriever - Received error from LeaderRetrievalService. \norg.apache.flink.util.FlinkException: Unhandled error in ZooKeeperLeaderRetrievalService:Background operation retry gave up at org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalService.unhandledError(ZooKeeperLeaderRetrievalService.java:209) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:576) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:572) at org.apache.flink.shaded.curator.org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:93) at org.apache.flink.shaded.curator.org.apache.curator.shaded.com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) at org.apache.flink.shaded.curator.org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:85) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.logError(CuratorFrameworkImpl.java:571) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:740) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:857) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)\nCaused by: org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:728) ... 10 common frames omitted 2020-02-27 06:28:53.577 [Curator-Framework-0] level=ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Fatal error occurred in the cluster entrypoint. \norg.apache.flink.runtime.dispatcher.DispatcherException: Received an error from the LeaderElectionService. at org.apache.flink.runtime.dispatcher.Dispatcher.handleError(Dispatcher.java:941) at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService.unhandledError(ZooKeeperLeaderElectionService.java:416) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:576) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:572) at org.apache.flink.shaded.curator.org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:93) at org.apache.flink.shaded.curator.org.apache.curator.shaded.com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) at org.apache.flink.shaded.curator.org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:85) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.logError(CuratorFrameworkImpl.java:571) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:740) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:857) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:809) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)\nCaused by: org.apache.flink.util.FlinkException: Unhandled error in ZooKeeperLeaderElectionService: Background operation retry gave up ... 18 common frames omitted\nCaused by: org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.zookeeper.org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:728) ... 10 common frames omitted 2020-02-27 06:28:53.580 [TransientBlobCache shutdown hook] level=INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache 2020-02-27 06:28:53.601 [BlobServer shutdown hook] level=INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:6124 2020-02-27 06:28:53.607 [main-SendThread(100-107-241-11.ZOOKEEPER:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Opening socket connection to server 100-107-241-11.ZOOKEEPER/100.107.241.11:2181 + mkdir -p /tmp/jobmanager,"stream":"stderr","billing_tag":"2152","project":"","realm":"olp-here-cvs-prod","namespace":"olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba","env":"PRD"} + echo 'real config file: ',"stream":"stderr","billing_tag":"2152","project":"","realm":"olp-here-cvs-prod","namespace":"olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba","env":"PRD"} + grep '^[^\\n#]' /etc/flink/flink-conf.yaml,"stream":"stderr","billing_tag":"2152","project":"","realm":"olp-here-cvs-prod","namespace":"olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba","env":"PRD"} real config file: blob.server.port: 6124 query.server.port: 6125 jobmanager.rpc.port: 6123 rest.port: 8081 akka.ask.timeout: 60s akka.lookup.timeout: 60s akka.watch.heartbeat.interval: 30s akka.watch.heartbeat.pause: 60s akka.watch.threshold: 14 jobmanager.heap.size: 14336m taskmanager.heap.size: 7168m taskmanager.numberOfTaskSlots: 1 taskmanager.exit-on-fatal-akka-error: true restart-strategy: none state.backend: rocksdb state.checkpoints.dir: s3a://S3_BUCKET/checkpoints state.savepoints.dir: s3a://S3_BUCKET/savepoints + exec /docker-entrypoint.sh jobmanager,"stream":"stderr","billing_tag":"2152","project":"","realm":"olp-here-cvs-prod","namespace":"olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba","env":"PRD"} state.backend.incremental: true state.backend.rocksdb.localdir: /tmp/taskmanager s3.endpoint: s3.amazonaws.com metrics.reporters: prometheus metrics.reporter.prometheus.class: com.here.dp.eventmanagement.client.flink.FlinkPrometheusReporter metrics.reporter.prometheus.port: 9249 metrics.reporter.prometheus.interval: 15 SECONDS env.java.opts: -Dhere.platform.data-client.endpoint-locator.discovery-service-env=custom -Dhere.platform.data-client.endpoint-locator.discovery-service-url=https://sab-int.api-lookup.data.api.platform.here.com -Dolp.pipeline.id=3845f520-aa24-4a5e-ba31-857954b15f68 -Dolp.realm=olp-here-cvs-prod -Dolp.deployment.id=bed4d2e6-d5f4-4126-a048-e342cc2f0cba -Dolp.pipeline.version.id=38be4bfc-ce7b-47df-9143-a5cb1cc3324b taskmanager.numberOfTaskSlots: 1 high-availability: zookeeper high-availability.zookeeper.quorum: ZOOKEEPER_STRING:2181 high-availability.zookeeper.path.root: /flink/olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba high-availability.cluster-id: job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-flink-1-x high-availability.storageDir: s3a://S3_BUCKET/bed4d2e6-d5f4-4126-a048-e342cc2f0cba high-availability.jobmanager.port: 6126 zookeeper.sasl.disable: true jobmanager.rpc.address: JOBMANAGER rest.address: JOBMANAGER Starting Job Manager config file: jobmanager.rpc.address: localhost jobmanager.rpc.port: 6123 jobmanager.heap.size: 1024m taskmanager.heap.size: 1024m taskmanager.numberOfTaskSlots: 1 parallelism.default: 1 rest.port: 8081 FLINK_LOG_CONF_DIR=/etc/pipeline-logback Starting standalonesession as a console application on host job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-jm-0. 2020-02-27 06:28:56.463 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -------------------------------------------------------------------------------- 2020-02-27 06:28:56.467 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint (Version: 1.7.1, Rev:89eafb4, Date:14.12.2018 @ 15:48:34 GMT) 2020-02-27 06:28:56.468 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - OS current user: flink 2020-02-27 06:28:56.468 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Current Hadoop/Kerberos user: 2020-02-27 06:28:56.468 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.212-b04 2020-02-27 06:28:56.468 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Maximum heap size: 14336 MiBytes 2020-02-27 06:28:56.469 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JAVA_HOME: /usr/lib/jvm/java-1.8.0 2020-02-27 06:28:56.469 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - No Hadoop Dependency available 2020-02-27 06:28:56.469 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM Options: 2020-02-27 06:28:56.469 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -XX:+UseG1GC 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -XX:-ResizePLAB 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -XX:ParallelGCThreads=2 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dakka.loggers=\"[\\\"akka.event.slf4j.Slf4jLogger\\\"]\" 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dakka.loglevel=DEBUG 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dakka.logging-filter=akka.event.slf4j.Slf4jLoggingFilter 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dhere.platform.data-client.request-signer.billing-tag=2152 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xms14336m 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xmx14336m 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dhere.platform.data-client.endpoint-locator.discovery-service-env=custom 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dhere.platform.data-client.endpoint-locator.discovery-service-url=https://sab-int.api-lookup.data.api.platform.here.com 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dolp.pipeline.id=3845f520-aa24-4a5e-ba31-857954b15f68 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dolp.realm=olp-here-cvs-prod 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dolp.deployment.id=bed4d2e6-d5f4-4126-a048-e342cc2f0cba 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dolp.pipeline.version.id=38be4bfc-ce7b-47df-9143-a5cb1cc3324b 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog4j.configuration=file:/etc/pipeline-logback/log4j-console.properties 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlogback.configurationFile=file:/etc/pipeline-logback/logback.xml 2020-02-27 06:28:56.470 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Program Arguments: 2020-02-27 06:28:56.471 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir 2020-02-27 06:28:56.471 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - /etc/flink 2020-02-27 06:28:56.471 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --executionMode 2020-02-27 06:28:56.471 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - cluster 2020-02-27 06:28:56.471 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Classpath: /etc/pipeline:/opt/flink/lib/flink-python_2.11-1.7.1.jar:/opt/flink/lib/flink-s3-fs-hadoop-1.7.1.jar:/opt/flink/lib/flink-table_2.11-1.7.1.jar:/opt/flink/lib/log4j-over-slf4j-1.7.25.jar:/opt/flink/lib/logback-classic-1.2.3.jar:/opt/flink/lib/logback-core-1.2.3.jar:/opt/flink/lib/flink-dist_2.11-1.7.1.jar:/opt/flink/lib/em/event-management-client-1.6.4-jar-with-dependencies.jar::: 2020-02-27 06:28:56.471 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -------------------------------------------------------------------------------- 2020-02-27 06:28:56.473 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Registered UNIX signal handlers for [TERM, HUP, INT] 2020-02-27 06:28:56.491 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: blob.server.port, 6124 2020-02-27 06:28:56.493 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: query.server.port, 6125 2020-02-27 06:28:56.493 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 2020-02-27 06:28:56.493 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081 2020-02-27 06:28:56.494 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 60s 2020-02-27 06:28:56.494 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.lookup.timeout, 60s 2020-02-27 06:28:56.494 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.heartbeat.interval, 30s 2020-02-27 06:28:56.494 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.heartbeat.pause, 60s 2020-02-27 06:28:56.494 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.threshold, 14 2020-02-27 06:28:56.494 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 14336m 2020-02-27 06:28:56.495 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.size, 7168m 2020-02-27 06:28:56.495 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2020-02-27 06:28:56.495 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.exit-on-fatal-akka-error, true 2020-02-27 06:28:56.495 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: restart-strategy, none 2020-02-27 06:28:56.495 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.backend, rocksdb 2020-02-27 06:28:56.495 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.checkpoints.dir, s3a://S3_BUCKET/checkpoints 2020-02-27 06:28:56.496 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.savepoints.dir, s3a://S3_BUCKET/savepoints 2020-02-27 06:28:56.496 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.backend.incremental, true 2020-02-27 06:28:56.496 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.backend.rocksdb.localdir, /tmp/taskmanager 2020-02-27 06:28:56.496 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, s3.amazonaws.com 2020-02-27 06:28:56.496 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporters, prometheus 2020-02-27 06:28:56.497 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prometheus.class, com.here.dp.eventmanagement.client.flink.FlinkPrometheusReporter 2020-02-27 06:28:56.497 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prometheus.port, 9249 2020-02-27 06:28:56.497 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prometheus.interval, 15 SECONDS 2020-02-27 06:28:56.497 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.opts, -Dhere.platform.data-client.endpoint-locator.discovery-service-env=custom -Dhere.platform.data-client.endpoint-locator.discovery-service-url=https://sab-int.api-lookup.data.api.platform.here.com -Dolp.pipeline.id=3845f520-aa24-4a5e-ba31-857954b15f68 -Dolp.realm=olp-here-cvs-prod -Dolp.deployment.id=bed4d2e6-d5f4-4126-a048-e342cc2f0cba -Dolp.pipeline.version.id=38be4bfc-ce7b-47df-9143-a5cb1cc3324b 2020-02-27 06:28:56.497 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2020-02-27 06:28:56.498 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability, zookeeper 2020-02-27 06:28:56.498 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.zookeeper.quorum, ZOOKEEPER_STRING:2181 2020-02-27 06:28:56.498 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.zookeeper.path.root, /flink/olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba 2020-02-27 06:28:56.498 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.cluster-id, job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-flink-1-x 2020-02-27 06:28:56.498 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.storageDir, s3a://S3_BUCKET/bed4d2e6-d5f4-4126-a048-e342cc2f0cba 2020-02-27 06:28:56.499 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.jobmanager.port, 6126 2020-02-27 06:28:56.499 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: zookeeper.sasl.disable, true 2020-02-27 06:28:56.499 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, JOBMANAGER 2020-02-27 06:28:56.499 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.address, JOBMANAGER 2020-02-27 06:28:56.621 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint. 2020-02-27 06:28:56.621 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install default filesystem. 2020-02-27 06:28:56.642 [main] level=INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available. 2020-02-27 06:28:56.655 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install security context. 2020-02-27 06:28:56.667 [main] level=INFO o.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath. 2020-02-27 06:28:56.690 [main] level=INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath. 2020-02-27 06:28:56.691 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Initializing cluster services. 2020-02-27 06:28:56.930 [main] level=INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at JOBMANAGER:6126 2020-02-27 06:28:57.812 [main] level=INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink@JOBMANAGER:6126 2020-02-27 06:28:58.447 [main] level=INFO o.a.f.f.s.h.o.a.c.beanutils.FluentPropertyBeanIntrospector - Error when creating PropertyDescriptor for public final void org.apache.flink.fs.shaded.hadoop3.org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2020-02-27 06:28:58.469 [main] level=WARN o.a.f.f.s.h.org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2020-02-27 06:28:58.619 [main] level=INFO o.a.f.f.s.h.o.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled Metric snapshot period at 10 second(s). 2020-02-27 06:28:58.619 [main] level=INFO o.a.f.f.s.h.o.apache.hadoop.metrics2.impl.MetricsSystemImpl - s3a-file-system metrics system started 2020-02-27 06:29:00.339 [main] level=INFO o.a.f.f.s.h.org.apache.hadoop.conf.Configuration.deprecation - fs.s3a.server-side-encryption-key is deprecated. Instead, use fs.s3a.server-side-encryption.key 2020-02-27 06:29:00.356 [main] level=INFO org.apache.flink.runtime.blob.FileSystemBlobStore - Creating highly available BLOB storage directory at s3a://S3_BUCKET/bed4d2e6-d5f4-4126-a048-e342cc2f0cba/job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-flink-1-x/blob 2020-02-27 06:29:00.437 [main] level=INFO org.apache.flink.runtime.util.ZooKeeperUtils - Enforcing default ACL for ZK connections 2020-02-27 06:29:00.437 [main] level=INFO org.apache.flink.runtime.util.ZooKeeperUtils - Using '/flink/olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba/job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-flink-1-x' as Zookeeper namespace. 2020-02-27 06:29:00.500 [main] level=INFO o.a.f.s.c.o.a.curator.framework.imps.CuratorFrameworkImpl - Starting 2020-02-27 06:29:00.507 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:host.name=JOBMANAGER 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_212 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.212.b04-0.el7_6.x86_64/jre 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/etc/pipeline:/opt/flink/lib/flink-python_2.11-1.7.1.jar:/opt/flink/lib/flink-s3-fs-hadoop-1.7.1.jar:/opt/flink/lib/flink-table_2.11-1.7.1.jar:/opt/flink/lib/log4j-over-slf4j-1.7.25.jar:/opt/flink/lib/logback-classic-1.2.3.jar:/opt/flink/lib/logback-core-1.2.3.jar:/opt/flink/lib/flink-dist_2.11-1.7.1.jar:/opt/flink/lib/em/event-management-client-1.6.4-jar-with-dependencies.jar::: 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:java.compiler= 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.10.0-1062.12.1.el7.x86_64 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:user.name=flink 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:user.home=/opt/flink 2020-02-27 06:29:00.508 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/flink 2020-02-27 06:29:00.509 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=ZOOKEEPER_STRING:2181 sessionTimeout=60000 watcher=org.apache.flink.shaded.curator.org.apache.curator.ConnectionState@77a2aa4a 2020-02-27 06:29:00.518 [main] level=ERROR o.a.f.s.c.o.a.curator.framework.imps.CuratorFrameworkImpl - Background exception was not retry-able or retry gave up\njava.net.UnknownHostException: job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-zk-0.job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-zk-hdlss: Name or service not known at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929) at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324) at java.net.InetAddress.getAllByName0(InetAddress.java:1277) at java.net.InetAddress.getAllByName(InetAddress.java:1193) at java.net.InetAddress.getAllByName(InetAddress.java:1127) at org.apache.flink.shaded.zookeeper.org.apache.zookeeper.client.StaticHostProvider.(StaticHostProvider.java:61) at org.apache.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:445) at org.apache.flink.shaded.curator.org.apache.curator.utils.DefaultZookeeperFactory.newZooKeeper(DefaultZookeeperFactory.java:29) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl$2.newZooKeeper(CuratorFrameworkImpl.java:150) at org.apache.flink.shaded.curator.org.apache.curator.HandleHolder$1.getZooKeeper(HandleHolder.java:94) at org.apache.flink.shaded.curator.org.apache.curator.HandleHolder.getZooKeeper(HandleHolder.java:55) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.reset(ConnectionState.java:262) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.start(ConnectionState.java:109) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.start(CuratorZookeeperClient.java:191) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.start(CuratorFrameworkImpl.java:259) at org.apache.flink.runtime.util.ZooKeeperUtils.startCuratorFramework(ZooKeeperUtils.java:129) at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createHighAvailabilityServices(HighAvailabilityServicesUtils.java:124) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.createHaServices(ClusterEntrypoint.java:304) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:261) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:207) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:163) at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:162) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:517) at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65) 2020-02-27 06:29:00.524 [main] level=INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-607de1fe-ab34-4dcd-94cd-5fa8b31fb218 2020-02-27 06:29:00.528 [main] level=INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: blob.server.port, 6124 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: query.server.port, 6125 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 60s 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.lookup.timeout, 60s 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.heartbeat.interval, 30s 2020-02-27 06:29:00.770 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.heartbeat.pause, 60s 2020-02-27 06:29:00.783 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.threshold, 14 2020-02-27 06:29:00.783 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 14336m 2020-02-27 06:29:00.783 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.size, 7168m 2020-02-27 06:29:00.783 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2020-02-27 06:29:00.783 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.exit-on-fatal-akka-error, true 2020-02-27 06:29:00.783 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: restart-strategy, none 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.backend, rocksdb 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.checkpoints.dir, s3a://S3_BUCKET/checkpoints 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.savepoints.dir, s3a://S3_BUCKET/savepoints 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.backend.incremental, true 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: state.backend.rocksdb.localdir, /tmp/taskmanager 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, s3.amazonaws.com 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporters, prometheus 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prometheus.class, com.here.dp.eventmanagement.client.flink.FlinkPrometheusReporter 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prometheus.port, 9249 2020-02-27 06:29:00.784 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.prometheus.interval, 15 SECONDS 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.opts, -Dhere.platform.data-client.endpoint-locator.discovery-service-env=custom -Dhere.platform.data-client.endpoint-locator.discovery-service-url=https://sab-int.api-lookup.data.api.platform.here.com -Dolp.pipeline.id=3845f520-aa24-4a5e-ba31-857954b15f68 -Dolp.realm=olp-here-cvs-prod -Dolp.deployment.id=bed4d2e6-d5f4-4126-a048-e342cc2f0cba -Dolp.pipeline.version.id=38be4bfc-ce7b-47df-9143-a5cb1cc3324b 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability, zookeeper 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.zookeeper.quorum, ZOOKEEPER_STRING:2181 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.zookeeper.path.root, /flink/olp-here-cvs-prod-j-bed4d2e6-d5f4-4126-a048-e342cc2f0cba 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.cluster-id, job-bed4d2e6-d5f4-4126-a048-e342cc2f0cba-flink-1-x 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.storageDir, s3a://S3_BUCKET/bed4d2e6-d5f4-4126-a048-e342cc2f0cba 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: high-availability.jobmanager.port, 6126 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: zookeeper.sasl.disable, true 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, JOBMANAGER 2020-02-27 06:29:00.785 [main] level=INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.address, JOBMANAGER 2020-02-27 06:29:00.786 [main] level=INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - Configuring prometheus with {port=9249, interval=15 SECONDS, class=com.here.dp.eventmanagement.client.flink.FlinkPrometheusReporter}. 2020-02-27 06:29:00.796 [main] level=INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - Reporting metrics for reporter prometheus of type com.here.dp.eventmanagement.client.flink.FlinkPrometheusReporter. 2020-02-27 06:29:00.798 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Trying to start actor system at JOBMANAGER:0 2020-02-27 06:29:00.879 [main] level=INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Actor system started at akka.tcp://flink-metrics@JOBMANAGER:39167 2020-02-27 06:29:00.885 [main] level=INFO o.a.flink.runtime.dispatcher.FileArchivedExecutionGraphStore - Initializing FileArchivedExecutionGraphStore: Storage directory /tmp/executionGraphStore-82f302cb-9902-4585-aa59-355ac5b2a6ff, expiration time 3600000, maximum cache size 52428800 bytes. 2020-02-27 06:29:00.916 [main] level=INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-eb2caa99-8f55-4a3a-b85f-2025ff833e87 2020-02-27 06:29:00.957 [main] level=WARN org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Upload directory /tmp/flink-web-79d9177a-1bce-45d1-9329-4d638f0bf7fc/flink-web-upload does not exist, or has been deleted externally. Previously uploaded files are no longer available. 2020-02-27 06:29:00.959 [main] level=INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Created directory /tmp/flink-web-79d9177a-1bce-45d1-9329-4d638f0bf7fc/flink-web-upload for file uploads. 2020-02-27 06:29:00.965 [main] level=INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Starting rest endpoint. 2020-02-27 06:29:01.276 [main] level=WARN org.apache.flink.runtime.webmonitor.WebMonitorUtils - Log file environment variable 'log.file' is not set. 2020-02-27 06:29:01.276 [main] level=WARN org.apache.flink.runtime.webmonitor.WebMonitorUtils - JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'Key: 'web.log.path' , default: null (deprecated keys: [jobmanager.web.log.path])'. 2020-02-27 06:29:01.458 [main] level=INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Rest endpoint listening at JOBMANAGER:8081 2020-02-27 06:29:01.458 [main] level=INFO o.a.f.runtime.leaderelection.ZooKeeperLeaderElectionService - Starting ZooKeeperLeaderElectionService ZooKeeperLeaderElectionService{leaderPath='/leader/rest_server_lock'}. 2020-02-27 06:29:16.477 [main] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (15969) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceImpl$1.call(NamespaceImpl.java:90) at org.apache.flink.shaded.curator.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceImpl.fixForNamespace(NamespaceImpl.java:83) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.fixForNamespace(CuratorFrameworkImpl.java:594) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:158) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:32) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.reset(NodeCache.java:242) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.start(NodeCache.java:175) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.start(NodeCache.java:154) at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService.start(ZooKeeperLeaderElectionService.java:134) at org.apache.flink.runtime.webmonitor.WebMonitorEndpoint.startInternal(WebMonitorEndpoint.java:712) at org.apache.flink.runtime.rest.RestServerEndpoint.start(RestServerEndpoint.java:218) at org.apache.flink.runtime.entrypoint.component.AbstractDispatcherResourceManagerComponentFactory.create(AbstractDispatcherResourceManagerComponentFactory.java:145) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:215) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:163) at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:162) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:517) at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65) 2020-02-27 06:29:16.478 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=ZOOKEEPER_STRING:2181 sessionTimeout=60000 watcher=org.apache.flink.shaded.curator.org.apache.curator.ConnectionState@77a2aa4a 2020-02-27 06:29:36.490 [main] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (35987) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceImpl$1.call(NamespaceImpl.java:90) at org.apache.flink.shaded.curator.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceImpl.fixForNamespace(NamespaceImpl.java:83) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.fixForNamespace(CuratorFrameworkImpl.java:594) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:158) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:32) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.reset(NodeCache.java:242) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.start(NodeCache.java:175) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.start(NodeCache.java:154) at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService.start(ZooKeeperLeaderElectionService.java:134) at org.apache.flink.runtime.webmonitor.WebMonitorEndpoint.startInternal(WebMonitorEndpoint.java:712) at org.apache.flink.runtime.rest.RestServerEndpoint.start(RestServerEndpoint.java:218) at org.apache.flink.runtime.entrypoint.component.AbstractDispatcherResourceManagerComponentFactory.create(AbstractDispatcherResourceManagerComponentFactory.java:145) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:215) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:163) at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:162) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:517) at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65) 2020-02-27 06:29:36.490 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=ZOOKEEPER_STRING:2181 sessionTimeout=60000 watcher=org.apache.flink.shaded.curator.org.apache.curator.ConnectionState@77a2aa4a 2020-02-27 06:29:56.499 [main] level=ERROR o.a.flink.shaded.curator.org.apache.curator.ConnectionState - Connection timed out for connection string (ZOOKEEPER_STRING:2181) and timeout (15000) / elapsed (55997) \norg.apache.flink.shaded.curator.org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:225) at org.apache.flink.shaded.curator.org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:94) at org.apache.flink.shaded.curator.org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:117) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceImpl$1.call(NamespaceImpl.java:90) at org.apache.flink.shaded.curator.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:109) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.NamespaceImpl.fixForNamespace(NamespaceImpl.java:83) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.CuratorFrameworkImpl.fixForNamespace(CuratorFrameworkImpl.java:594) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:158) at org.apache.flink.shaded.curator.org.apache.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:32) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.reset(NodeCache.java:242) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.start(NodeCache.java:175) at org.apache.flink.shaded.curator.org.apache.curator.framework.recipes.cache.NodeCache.start(NodeCache.java:154) at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService.start(ZooKeeperLeaderElectionService.java:134) at org.apache.flink.runtime.webmonitor.WebMonitorEndpoint.startInternal(WebMonitorEndpoint.java:712) at org.apache.flink.runtime.rest.RestServerEndpoint.start(RestServerEndpoint.java:218) at org.apache.flink.runtime.entrypoint.component.AbstractDispatcherResourceManagerComponentFactory.create(AbstractDispatcherResourceManagerComponentFactory.java:145) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:215) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:163) at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:162) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:517) at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65) 2020-02-27 06:29:56.500 [main] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=ZOOKEEPER_STRING:2181 sessionTimeout=60000 watcher=org.apache.flink.shaded.curator.org.apache.curator.ConnectionState@77a2aa4a 2020-02-27 06:29:56.520 [main-SendThread(100-96-31-234.ZOOKEEPER:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Opening socket connection to server 100-96-31-234.ZOOKEEPER/100.96.31.234:2181 2020-02-27 06:29:56.521 [main-SendThread(100-96-31-234.ZOOKEEPER:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Socket connection established to 100-96-31-234.ZOOKEEPER/100.96.31.234:2181, initiating session 2020-02-27 06:29:56.533 [main-SendThread(100-96-31-234.ZOOKEEPER:2181)] level=INFO o.a.flink.shaded.zookeeper.org.apache.zookeeper.ClientCnxn - Session establishment complete on server 100-96-31-234.ZOOKEEPER/100.96.31.234:2181, sessionid = 0x170855659e80000, negotiated timeout = 40000 2020-02-27 06:29:56.539 [main-EventThread] level=INFO o.a.f.s.c.o.a.curator.framework.state.ConnectionStateManager - State change: CONNECTED 2020-02-27 06:30:01.522 [main] level=INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Web frontend listening at http://JOBMANAGER:8081. 2020-02-27 06:30:01.522 [main-EventThread] level=INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - http://JOBMANAGER:8081 was granted leadership with leaderSessionID=e1de2cfa-74d2-472b-b129-022561a98029 2020-02-27 06:30:01.573 [main] level=INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/resourcemanager . 2020-02-27 06:30:01.619 [main] level=INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher . 2020-02-27 06:30:01.643 [main] level=INFO o.a.f.runtime.leaderelection.ZooKeeperLeaderElectionService - Starting ZooKeeperLeaderElectionService ZooKeeperLeaderElectionService{leaderPath='/leader/resource_manager_lock'}. 2020-02-27 06:30:01.650 [main] level=INFO o.a.f.r.leaderretrieval.ZooKeeperLeaderRetrievalService - Starting ZooKeeperLeaderRetrievalService /leader/resource_manager_lock. 2020-02-27 06:30:01.655 [main] level=INFO o.a.f.runtime.leaderelection.ZooKeeperLeaderElectionService - Starting ZooKeeperLeaderElectionService ZooKeeperLeaderElectionService{leaderPath='/leader/dispatcher_lock'}. 2020-02-27 06:30:01.657 [main] level=INFO o.a.f.r.leaderretrieval.ZooKeeperLeaderRetrievalService - Starting ZooKeeperLeaderRetrievalService /leader/dispatcher_lock. 2020-02-27 06:30:01.677 [flink-akka.actor.default-dispatcher-16] level=INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher akka.tcp://flink@JOBMANAGER:6126/user/dispatcher was granted leadership with fencing token 113d78b5-6c33-401b-9f47-2f7a1d6dfefc 2020-02-27 06:30:01.677 [flink-akka.actor.default-dispatcher-5] level=INFO o.a.flink.runtime.resourcemanager.StandaloneResourceManager - ResourceManager akka.tcp://flink@JOBMANAGER:6126/user/resourcemanager was granted leadership with fencing token a2c453481ea4e0c7722cab1e4dd741db 2020-02-27 06:30:01.678 [flink-akka.actor.default-dispatcher-5] level=INFO o.a.flink.runtime.resourcemanager.slotmanager.SlotManager - Starting the SlotManager. 2020-02-27 06:30:01.681 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all persisted jobs. 2020-02-27 06:30:02.083 [flink-akka.actor.default-dispatcher-22] level=INFO o.a.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID 844e25f7b0da5e7959690767c22aa2b0 (akka.tcp://flink@100.104.118.28:42433/user/taskmanager_0) at ResourceManager 2020-02-27 06:30:02.095 [flink-akka.actor.default-dispatcher-22] level=INFO o.a.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID d2620851a220e6a3c4f0c8e825f7f939 (akka.tcp://flink@100.104.118.30:33475/user/taskmanager_0) at ResourceManager 2020-02-27 06:30:02.095 [flink-akka.actor.default-dispatcher-22] level=INFO o.a.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID c6f95a975705bf1b25bffa651b0cc308 (akka.tcp://flink@100.120.59.44:44568/user/taskmanager_0) at ResourceManager 2020-02-27 06:30:02.096 [flink-akka.actor.default-dispatcher-22] level=INFO o.a.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID b17f48c89925a3c0535fd8f5f4288acb (akka.tcp://flink@100.123.26.85:41870/user/taskmanager_0) at ResourceManager 2020-02-27 06:30:02.137 [flink-akka.actor.default-dispatcher-21] level=INFO o.a.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID 844e25f7b0da5e7959690767c22aa2b0 (akka.tcp://flink@100.104.118.28:42433/user/taskmanager_0) at ResourceManager 2020-02-27 06:30:02.492 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore - Recovered SubmittedJobGraph(5a910928a71b469a091be168b0e74722, null). 2020-02-27 06:30:05.027 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/jobmanager_0 . 2020-02-27 06:30:05.040 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Initializing job HHW_WEATHER_PROCESSOR (5a910928a71b469a091be168b0e74722). 2020-02-27 06:30:05.070 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Using restart strategy FailureRateRestartStrategy(failuresInterval=1200000 msdelayInterval=30000 msmaxFailuresPerInterval=25) for HHW_WEATHER_PROCESSOR (5a910928a71b469a091be168b0e74722). 2020-02-27 06:30:05.076 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.slotpool.SlotPool at akka://flink/user/76e82403-8146-492b-bd2a-5cb565ddd4ad . 2020-02-27 06:30:05.097 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via failover strategy: full graph restart 2020-02-27 06:30:05.122 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master for job HHW_WEATHER_PROCESSOR (5a910928a71b469a091be168b0e74722). 2020-02-27 06:30:05.122 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Successfully ran initialization on master in 0 ms. 2020-02-27 06:30:05.164 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.checkpoint.ZooKeeperCompletedCheckpointStore - Initialized in '/checkpoints/5a910928a71b469a091be168b0e74722'. 2020-02-27 06:30:05.178 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Loading state backend via factory org.apache.flink.contrib.streaming.state.RocksDBStateBackendFactory 2020-02-27 06:30:05.511 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.checkpoint.ZooKeeperCompletedCheckpointStore - Recovering checkpoints from ZooKeeper. 2020-02-27 06:30:05.527 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.checkpoint.ZooKeeperCompletedCheckpointStore - Found 2 checkpoints in ZooKeeper. 2020-02-27 06:30:05.528 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.checkpoint.ZooKeeperCompletedCheckpointStore - Trying to fetch 2 checkpoints from storage. 2020-02-27 06:30:05.528 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.checkpoint.ZooKeeperCompletedCheckpointStore - Trying to retrieve checkpoint 186446. 2020-02-27 06:30:05.781 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.checkpoint.ZooKeeperCompletedCheckpointStore - Trying to retrieve checkpoint 189270. 2020-02-27 06:30:06.226 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Restoring job 5a910928a71b469a091be168b0e74722 from latest valid checkpoint: Checkpoint 189270 @ 1582784885581 for 5a910928a71b469a091be168b0e74722. 2020-02-27 06:30:06.238 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - No master state to restore 2020-02-27 06:30:06.240 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.runtime.leaderelection.ZooKeeperLeaderElectionService - Starting ZooKeeperLeaderElectionService ZooKeeperLeaderElectionService{leaderPath='/leader/5a910928a71b469a091be168b0e74722/job_manager_lock'}. 2020-02-27 06:30:06.251 [main-EventThread] level=INFO org.apache.flink.runtime.jobmaster.JobManagerRunner - JobManager runner for job HHW_WEATHER_PROCESSOR (5a910928a71b469a091be168b0e74722) was granted leadership with session id 32637c78-cfd4-4e44-8c10-c551bac40742 at akka.tcp://flink@JOBMANAGER:6126/user/jobmanager_0. 2020-02-27 06:30:06.272 [flink-akka.actor.default-dispatcher-17] level=INFO o.a.f.r.leaderretrieval.ZooKeeperLeaderRetrievalService - Starting ZooKeeperLeaderRetrievalService /leader/resource_manager_lock. 2020-02-27 06:30:06.272 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.jobmaster.JobMaster - Starting execution of job HHW_WEATHER_PROCESSOR (5a910928a71b469a091be168b0e74722) 2020-02-27 06:30:06.273 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job HHW_WEATHER_PROCESSOR (5a910928a71b469a091be168b0e74722) switched from state CREATED to RUNNING. 2020-02-27 06:30:06.282 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (1/20) (fd58396a7fcb3c9ba4e27e6eb3bab20c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.296 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (2/20) (cc975942d5cfc06aa25bfdd67845b777) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.296 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (3/20) (f081b608b74b833f023721b1860cb192) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.296 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (4/20) (f2c9158b1559550a00442334f7ea504e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.297 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (5/20) (39033c5e2cbb97314a4a61f797a27433) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.297 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (6/20) (aab982571fe9770c68394c7781982cd8) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.297 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (7/20) (bd267711fe98f867a55dd89390d5076c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.297 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (8/20) (0653966f7f8fd003409e8c10ae3bad30) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.298 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (9/20) (3d890d0ec0c50e14a8001515deffd1fb) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.298 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (10/20) (9b418cdb191d98c409f472af97bd72b5) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.298 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (11/20) (df14317e664d76af9536ad4f6ac963dc) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.298 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (12/20) (de4674e648a7e96556351f46a1953002) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.299 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (13/20) (61f833c76de857ecbf4c4d50b240464c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.299 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (14/20) (481bc218633e093c8f544f06cbb078f5) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.299 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (15/20) (4eac0f936624aec0f842c76ae3cbcbc9) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.299 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (16/20) (acd2dc3952d3bedb9de36d5fccad92aa) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.300 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (17/20) (a1f0fccc1e4e9f6142e9242ed6f0e00f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.300 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (18/20) (6ebaaf54415fa01ac0d9a404706a4380) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.300 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (19/20) (c0d9ff9b1907c5423595b26effead81b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.304 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_SOURCE (20/20) (75c93bb0882d620c277feae3f7e6a312) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.305 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (1/20) (bdd778681593831abf84173abb18422b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.305 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (2/20) (148925d8586429071e811830777bea3e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.305 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (3/20) (37c6b3dcc4d752dd41d75de38d3bb5bb) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.305 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (4/20) (438b4693d1c0d89fe11df05a70674321) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.306 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (5/20) (5c057ae1ff0f15c12d4007fb3590a388) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.306 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (6/20) (dc5c3aed7c8463aa5f85361322a89918) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.306 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (7/20) (d489a2a00f35643995461d50aeb42590) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.306 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (8/20) (bcfdf42b5b961c3d8b4fba4b543568c0) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.306 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (9/20) (aafc9c80e91fddfc6a373bf87b61cf0f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.307 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (10/20) (fce547d90bda03adfb206c338a7f8ff6) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.307 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (11/20) (69db062e5f4f79fe4ab8a83edc047c82) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.307 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (12/20) (9c7b7fbea5bb1a8ef668693df3501dd6) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.307 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (13/20) (0498398ead74d6741dfd5cb8ca1b23a7) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.308 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (14/20) (5823e9e655e9b0b63a4f0d1b79f622be) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.308 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (15/20) (4fc5dccdeca888d3e7a01a35d671a37a) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.308 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (16/20) (87c56896e24db53a08be01bbc5c9804b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.308 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (17/20) (123f725346576dd0862177c7472d9438) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.308 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (18/20) (33d80259902d066f52914f521f01b95a) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.309 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (19/20) (f859e8c7fae2f9614d09f2bd12af175f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.309 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SDII_FORD_SOURCE (20/20) (c8f671fa2085c1e90deb6c4d76e0c208) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.309 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: TICK_TUPLE_SOURCE (1/1) (a95a1ca1f6ee6a5ae51ec027428f5716) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.309 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (1/20) (d6246c4a34118d611ed0aea807d3cc34) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.310 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (2/20) (8357b3f53ee75d5957cac576e54d7770) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.310 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (3/20) (8964e1e2735d4ebce2994889bc69e958) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.310 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (4/20) (d51ebf562580aeba31f9787c459d9c4b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.311 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (5/20) (de90cd1b8b1585b4ab97030ab41fdafc) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.311 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (6/20) (cc252fffcb3749c13dd7039955ccf6f3) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.311 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (7/20) (36ebad531d6d612c56d293ad0fa8cf0c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.311 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (8/20) (8d13b769e4dd74f3bce2eb6f6cbba5f5) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.312 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (9/20) (dfeb8a1edf85934ab361122f324348b4) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.312 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (10/20) (82f6574dd4a82216c87b1ede11728520) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.312 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (11/20) (41eb8358a8d3a173a34108931c38f063) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.312 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (12/20) (1bb0f1a561303e2f2b4b070717ccfd7e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.313 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (13/20) (60a2611b6afd344c6d9b8318a4f263c5) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.313 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (14/20) (cab7d8a86f680182b49e974c7b36d55f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.317 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (15/20) (a65d23bd172767ba63692043a19f05c7) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.318 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (16/20) (6b0c5ecf64843f9446995d4ca47e004e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.318 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (17/20) (32fd93d7b5ba1ae2377b20d44570ce96) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.318 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (18/20) (597d66d414d9b72b205190eb07b86f18) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.318 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (19/20) (27bcd24535974029aae877c9486c1b9f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.319 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_NORMALIZER (20/20) (e02bf3b064ae624b24cf2448473ddfcb) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.319 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (1/20) (a8b1e81db7c62d346ededa65a1cb7f90) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.319 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (2/20) (cc53b89bfffec63a1feed3c448b5adb4) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.319 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (3/20) (8d1c56bb5c92eae85cd7d029e2f79254) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.320 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (4/20) (4757a90fce37437c4a293600e938a15f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.320 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (5/20) (f772a7b4d72185696631c2d68012c119) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.320 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (6/20) (4c1288c706e165d68c3dcbdf3d86c09a) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.320 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (7/20) (4e34fce64c755c1edc2d0e6d93191e4d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.321 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (8/20) (516b7bb80c45344f43c2107e8b511e72) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.321 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (9/20) (4e83a06542ec71abf14d112fe694319c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.321 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (10/20) (032e961c70fe8129899489436897ab33) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.321 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (11/20) (3179948ca72ebbf4951d3b9e54e2c7f2) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.322 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (12/20) (22296c6dcd8639eb3b33d5caae1b046a) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.322 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (13/20) (1d4b23f72b9174200b5a2078c914c37e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.322 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (14/20) (e48ba3654aafb75947f9bff929e244e5) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.322 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (15/20) (5b28717986ee6692df7e84c16e5aebac) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.322 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (16/20) (6f8b7ffb061a0d79033a4bed3ed4d4b1) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.323 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (17/20) (0ae4083157ef42f115b46fb8db0abd29) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.323 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (18/20) (434e7768b5955b907c46c807de68391a) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.328 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (19/20) (4d5d6b73b1ccec20ba2a3ae0443639e2) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.329 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - INPUT_FILTER (20/20) (b215bf272e7c1c211d54dceb8961e4ae) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.329 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (1/20) (1c999e2cca7c80d2a8422fbf352b2693) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.329 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (2/20) (5923de42ea7610c6df5ed3031391b6fc) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.330 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (3/20) (223221e691b4c7346d53cd2ae2ee54ea) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.330 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (4/20) (ecc9a2c1fd5cbead97e6e052a63002ab) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.330 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (5/20) (cc657df5077cf5741832cd6955ba2790) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.330 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (6/20) (02310ea67151a31b859fef96b671c4ea) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.331 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (7/20) (3f6502cbd9a55b5f6d61bbf2f5715a4b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.331 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (8/20) (269e163691db7a4556d7f16aac0854fb) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.331 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (9/20) (10109fe2a2e59575acb884eab15426b9) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.331 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (10/20) (02d45d7e1878eed6b79995cfb4265fb4) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.331 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (11/20) (286829370588246bc090f691744c67c9) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.332 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (12/20) (513d85c9d690996ed66915aba4eab2fe) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.332 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (13/20) (f7d82cc915f254ab1da152cef5b68d3f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.332 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (14/20) (3e160b2d298c501fa7520c497daed957) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.332 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (15/20) (c3c8581d287675d16d5af0b02ac55f32) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.333 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (16/20) (b926b1fe512dc5f0b73c60d2edf78552) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.333 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (17/20) (e9116dbbfd1e622e12e2ede2f5de918f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.333 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (18/20) (88d08457036a7a5c83be3fdd6204cd13) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.336 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (19/20) (b340cab1235c564728faf03ac28e2795) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.337 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - VALIDATOR_FUNCTION (20/20) (8e715f96545cf8d285e124db614035d6) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.337 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (1/20) (ba2a9ed949287d09e519a2f855dd9dcc) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (2/20) (f58b20a8ca8e13c3f61847ccb3f8aafb) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (3/20) (a46711de3c196835708ff3a690068f67) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (4/20) (c334b55561d11d450d0ab677d2191de7) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (5/20) (518fa0716872900d051aa056dbfa90a8) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (6/20) (ce370794af736a5c8da421fe638b9fa9) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (7/20) (b2d91aab79b305343ee3fd4ac95de73d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (8/20) (963d719f9d059b4d7012c5bf78c49e8c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.338 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (9/20) (1ba088e564034b91a6c7f1018bd59e11) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (10/20) (1e524df018c4eb9e5c7e775d0314b61d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (11/20) (98e9bbb91a78aa4786dd043e5dc35553) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (12/20) (9f9f873cf2f8821381a3b6b8450e7f2a) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (13/20) (65a1dbfe9ccc7bbd336172004995126e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (14/20) (ad7328820d42c0b28852bdf168005fc0) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (15/20) (34a5fad021877d96a90c378926a91011) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (16/20) (a387ecf640e694bfa4d29169a3825b2b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.339 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (17/20) (498da18561a120b8a1c22459d6c58e28) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (18/20) (7791d012a100c6c007280fc2a417e1f9) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (19/20) (993961b84a92d94980aeea331124a1e0) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - RAIN_PREDICTION_FUNCTION (20/20) (470e9d91fdb54a792b4101dd1de5a1f6) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (1/20) (6b2565409bdf6eacb6c22d17481405a6) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (2/20) (3a5a816acd508ef0ca032ad9b87b5630) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (3/20) (347ffe39350e4b87809093457628e927) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (4/20) (960897d7e05cce696c3f581ac0b196f3) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (5/20) (a60436fa191acdbf1e98d53fe007c150) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.340 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (6/20) (137f7d5185ab5e69e088713f4d9ba9cd) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (7/20) (2598621b6c579679e8eccdc717c0184e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (8/20) (d9d9de920351ffb614ee8828c58d518b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (9/20) (2cb0aa76f1c5da1adf3e89dbcebc5d8f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (10/20) (b00b0890899c2e54159de8f9f0349e39) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (11/20) (4475a326cce0b047965158c04345b5be) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (12/20) (4147788704f0718931622a1202c7bd25) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (13/20) (98aed7818cdc63e5a3cedbf4569bcac9) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.341 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (14/20) (8cb16bee73a9abda850d3c125346c8db) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (15/20) (5a715b22c659c319e980173898a09bde) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (16/20) (d949707ea4e46b0a6ec279da9fd19929) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (17/20) (6b9259e1c08d6f4860ea808fd6184d69) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (18/20) (c722f43185403820aa25b88f1711931c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (19/20) (0bdda7d8fadb2d1748511038f67cf916) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - FOG_PREDICTION_FUNCTION (20/20) (56dcd5425e94e761166e578e8eb77900) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (1/20) (8110515e8fe5346ad21950b736667dd4) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.342 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (2/20) (005df225af9be851675e507a950d3a63) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.343 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (3/20) (f2972b0ebb0f8068b7946ec90b864fcf) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.343 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (4/20) (31d5b997808d95b6421d47344a9bc411) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.343 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (5/20) (f21161c105771f75502c49713f374874) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.345 [flink-akka.actor.default-dispatcher-20] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{7f9f60b69510c0ac234574e820015f35}] 2020-02-27 06:30:06.347 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (6/20) (d000ba9159b2859486f799db30e4d018) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.347 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (7/20) (69970a8edf5d83350df481f00ca17670) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.348 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (8/20) (90b1344940e8d930c90170d25b30b5c4) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.348 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (9/20) (e8c3b2cfab07d08f809f8bc74f71edb0) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.348 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (10/20) (489ba63a631d8d10349dceb9ae7039a3) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.349 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (11/20) (8984f01f7e122fa63fd7bcb710269761) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.349 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (12/20) (8567601d4eb9c8f865e9a0731d325d82) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.349 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (13/20) (e5acf0551e371be15dfc5cc0faee01f0) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.349 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (14/20) (0d0311eae4042feef00acd1e0cae306d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.350 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (15/20) (d6490988fe8ab3e34442b6258e1b310b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.350 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (16/20) (1b3d5bdc607630379663461c4fe09eb2) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.350 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (17/20) (f5bc4a16422a0993193b25670d2d6d9d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.350 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (18/20) (76a15e6b2a05535678a8170f65be41dd) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (19/20) (1d9e0894095e721412ba2943856c15d5) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - STITCHING_WINDOW_FUNCTION (20/20) (b5974a4f3f608e12b2dc75d6e77930bc) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-20] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{7c2a86a9d2d862c73705990c8cdc0d74}] 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (1/20) (595c73db8e34d5cc542572bf71166d1e) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (2/20) (4cc8f081722190703230d29653dacf5b) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-20] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{373a9fb35bba53de8f117d32be45fe61}] 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (3/20) (06a32307d58900603a24f519c6276c27) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (4/20) (3fca523bcff215b4bfc5e7aba4b19f08) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.351 [flink-akka.actor.default-dispatcher-20] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{2f2ed96236ed4cba1c654e4bc8aa453e}] 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (5/20) (1c85a56ff984f0b634b7f5d47dad90db) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (6/20) (8d0630f6dfa534648253c9bb5b530e50) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-20] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{40e33ca53089bb7193fee26682a79698}] 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (7/20) (d26e12ad529428f190ae1caee0b6ae69) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (8/20) (adee9e6b9744ae4477b4f7a2f13148ff) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-20] level=INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{a274e8652db8a6a56b64c9afe8b2da2e}] 2020-02-27 06:30:06.352 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (9/20) (1fcf9a9803cafe77d18483ac27cfbd3d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.355 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (10/20) (c4718c9430124059a7556a84d9850823) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.355 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (11/20) (cd9d154aafc1e9ed7ca6c70c3a18ab04) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (12/20) (4eb15da83d7cf2e90e85a5c2810b6208) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (13/20) (1283931d5ae4d7387714154e98ec2aab) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (14/20) (7a01741fac0a697887b1c6fcf8d79a3c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (15/20) (f2e8eca9c036757d56683f37c51b845f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (16/20) (6e26c2b58d3432cc2d7c96143938f18c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (17/20) (ddae52c79d8787214648c7c6aabe658d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (18/20) (29dc5c62d53918e9fabe952a29b47604) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (19/20) (3eb6de91bc2231c96335f43be096b0e3) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - OUTPUT_NORMALIZER (20/20) (c99c04606fe27115a869109edb12d2f1) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (1/20) (767186ef8b8169b8bcdc26381677972d) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.356 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (2/20) (0032215fbae94e59abbfdc18c8084e4c) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.357 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (3/20) (8afe2502da1eb1bc6ebc53459ddc4299) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.357 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (4/20) (51aabe25513d6bd40a4d2f14a08220e2) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.357 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (5/20) (f6bcc34ff029f1c01a39400fc7ac938f) switched from CREATED to SCHEDULED. 2020-02-27 06:30:06.357 [flink-akka.actor.default-dispatcher-17] level=INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: RTTI_SINK (6/20) (33aab4cadeebb8f8e91f791edaa4faf6) switched from CREATED to SCHEDULED.