(DEPRECATED) Apache Flink User Mailing List archive.

java.io.IOException: Could not create storage directory for BLOB store in '/tmp'

classic Classic list List threaded Threaded
♦
♦
 2 messages Options
wheatdog liou
Reply | Threaded
Open this post in threaded view
♦
♦
|

java.io.IOException: Could not create storage directory for BLOB store in '/tmp'

wheatdog liou
Hi, I am new to Flink and was following Flink with docker-compose and encounter this error. I used the session-cluster docker-compose.yml template from the document:

version: "2.2"
services:                                                                      
  jobmanager:                                                                  
    image: flink:1.12.0-scala_2.11                                              
    ports:                                                                      
      - "8081:8081"                                                            
    command: jobmanager                                                        
    environment:                                                                
      - |                                                                      
        FLINK_PROPERTIES=                                                      
        jobmanager.rpc.address: jobmanager                                      
                                                                               
  taskmanager:                                                                  
    image: flink:1.12.0-scala_2.11                                              
    depends_on:                                                                
      - jobmanager                                                              
    command: taskmanager                                                        
    scale: 1                                                                    
    environment:                                                                
      - |                                                                      
        FLINK_PROPERTIES=                                                      
        jobmanager.rpc.address: jobmanager                                      
        taskmanager.numberOfTaskSlots: 2

jobmanager and taskmanager both got the same error at initialization:

taskmanager_1  | 2021-02-19 02:30:36,940 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService              - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService_35cd708df0ef5a7b90ed8839b105eaa5 .
taskmanager_1  | 2021-02-19 02:30:36,978 ERROR org.apache.flink.runtime.taskexecutor.TaskManagerRunner       - TaskManager initialization failed.
taskmanager_1  | java.io.IOException: Could not create storage directory for BLOB store in '/tmp'.
taskmanager_1  | at org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
taskmanager_1  | at org.apache.flink.runtime.blob.AbstractBlobCache.<init>(AbstractBlobCache.java:106)
taskmanager_1  | at org.apache.flink.runtime.blob.PermanentBlobCache.<init>(PermanentBlobCache.java:104)
taskmanager_1  | at org.apache.flink.runtime.blob.BlobCacheService.<init>(BlobCacheService.java:58)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:153)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:327)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$3(TaskManagerRunner.java:351)
taskmanager_1  | at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:350)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:335)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:306)

jobmanager_1   | 2021-02-19 02:30:25,739 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Could not start cluster entrypoint StandaloneSessionClusterEntrypoint.
jobmanager_1   | org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to initialize the cluster entrypoint StandaloneSessionClusterEntrypoint.
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:189)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:520)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:64)
jobmanager_1   | Caused by: java.io.IOException: Could not create storage directory for BLOB store in '/tmp'.
jobmanager_1   | at org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
jobmanager_1   | at org.apache.flink.runtime.blob.BlobServer.<init>(BlobServer.java:140)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:266)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:209)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:171)
jobmanager_1   | at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:170)
jobmanager_1   | ... 2 more

Any idea how I can solve it? Thanks!
wheatdog liou
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: java.io.IOException: Could not create storage directory for BLOB store in '/tmp'

wheatdog liou
Turns out the disk used by docker for mac is full. I followed the operation on docker site [1] and everything is fine.


wheatdog liou <[hidden email]> 於 2021年2月19日 週五 上午10:47寫道：
Hi, I am new to Flink and was following Flink with docker-compose and encounter this error. I used the session-cluster docker-compose.yml template from the document:

version: "2.2"
services:                                                                      
  jobmanager:                                                                  
    image: flink:1.12.0-scala_2.11                                              
    ports:                                                                      
      - "8081:8081"                                                            
    command: jobmanager                                                        
    environment:                                                                
      - |                                                                      
        FLINK_PROPERTIES=                                                      
        jobmanager.rpc.address: jobmanager                                      
                                                                               
  taskmanager:                                                                  
    image: flink:1.12.0-scala_2.11                                              
    depends_on:                                                                
      - jobmanager                                                              
    command: taskmanager                                                        
    scale: 1                                                                    
    environment:                                                                
      - |                                                                      
        FLINK_PROPERTIES=                                                      
        jobmanager.rpc.address: jobmanager                                      
        taskmanager.numberOfTaskSlots: 2

jobmanager and taskmanager both got the same error at initialization:

taskmanager_1  | 2021-02-19 02:30:36,940 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService              - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService_35cd708df0ef5a7b90ed8839b105eaa5 .
taskmanager_1  | 2021-02-19 02:30:36,978 ERROR org.apache.flink.runtime.taskexecutor.TaskManagerRunner       - TaskManager initialization failed.
taskmanager_1  | java.io.IOException: Could not create storage directory for BLOB store in '/tmp'.
taskmanager_1  | at org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
taskmanager_1  | at org.apache.flink.runtime.blob.AbstractBlobCache.<init>(AbstractBlobCache.java:106)
taskmanager_1  | at org.apache.flink.runtime.blob.PermanentBlobCache.<init>(PermanentBlobCache.java:104)
taskmanager_1  | at org.apache.flink.runtime.blob.BlobCacheService.<init>(BlobCacheService.java:58)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:153)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:327)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$3(TaskManagerRunner.java:351)
taskmanager_1  | at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:350)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:335)
taskmanager_1  | at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:306)

jobmanager_1   | 2021-02-19 02:30:25,739 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Could not start cluster entrypoint StandaloneSessionClusterEntrypoint.
jobmanager_1   | org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to initialize the cluster entrypoint StandaloneSessionClusterEntrypoint.
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:189)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:520)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:64)
jobmanager_1   | Caused by: java.io.IOException: Could not create storage directory for BLOB store in '/tmp'.
jobmanager_1   | at org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
jobmanager_1   | at org.apache.flink.runtime.blob.BlobServer.<init>(BlobServer.java:140)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:266)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:209)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:171)
jobmanager_1   | at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
jobmanager_1   | at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:170)
jobmanager_1   | ... 2 more

Any idea how I can solve it? Thanks!
Free forum by Nabble Edit this page