Link on Azure HDInsight cluster with WASB storage

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Link on Azure HDInsight cluster with WASB storage

Fakrudeen Ali Ahmed

Hi there,

 

https://stackoverflow.com/questions/52996054/resource-changed-on-src-filesystem-in-azure-flink

 

We are unable to start flink on Azure Hadoop cluster [on top of WASB]. This throws:

 

Application application_1539730571763_0046 failed 1 times (global limit =5; local limit is =1) due to AM Container for appattempt_1539730571763_0046_000001 exited with exitCode: -1000

Failing this attempt.

Diagnostics: [2018-10-23 23:31:31.563]Resource wasb://[hidden email]/user/aliahmed/.flink/application_1539730571763_0046/logback.xml changed on src filesystem (expected 1536955416000, was 1540337488000

java.io.IOException: Resource wasb://[hidden email]/user/aliahmed/.flink/application_1539730571763_0046/logback.xml changed on src filesystem (expected 1536955416000, was 1540337488000

at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:273)

 

Is Flink not supported on Azure Hadoop cluster?

 

It looks like this file timestamp changes in WASB during file copy and YARN is complaining about original timestamp.

 

Thanks,

-Fakrudeen