|
|
Hi,
I'm seeing an issue when trying to set a different credentials provider for AWS S3.
I'm setting in flink-conf.json the fs.s3a.aws.credentials.provider to a different value. I'm using the flink-s3-fs-hadoop dependency and I get an exception when job starts:
RuntimeException: Failed to start checkpoint ID counter: From option fs.s3a.aws.credentials.provider java.lang.ClassNotFoundException: Class org.apache.flink.fs.s3hadoop.shaded.com.amazonaws.auth.ContainerCredentialsProvider not found
I took a look at the code at org.apache.flink.fs.s3hadoop.S3FileSystemFactory [1] and saw that the shaded prefix is set to: org.apache.flink.fs.s3hadoop.shaded
But in the pom.xml file I see that the AWS packages are migrated to: org.apache.flink.fs.s3base.shaded.com.amazon [2]
Is this a bug in the shaded prefix? Or am I missing something?
|
Locked
