Hi,
I am running Flin k Jobs on EMR (5.30.1) and trying to save the StateBackend
info to S3.
I have the following in flink-conf.xml file and when i try to submit the
jobs to flink cluster the JobManager is is failing as it is unable to save
the StateBackend info to S3.
s3.access-key: <<S3_ACCESS_KEY_VAL>>
s3.secret-key: <<S3_SECRET_KEY_VAL>>
s3.sse.enabled: true
s3.server-side-encryption-algorithm: AES256
And the Error i am getting is
2020-07-31 03:03:27,965 INFO org.apache.flink.runtime.jobmaster.JobMaster
- Configuring application-defined state backend with job/cluster config
2020-07-31 03:03:29,997 ERROR
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Failed to
submit job ae00efc463917546b02c3a3f3586046c.
java.lang.RuntimeException:
org.apache.flink.runtime.client.JobExecutionException: Could not set up
JobManager
at
org.apache.flink.util.function.CheckedSupplier.lambda$unchecked$0(CheckedSupplier.java:36)
Caused by: org.apache.flink.runtime.client.JobExecutionException: Could not
set up JobManager
at
org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:152)
... 7 more
Caused by:
com.amazon.ws.emr.hadoop.fs.shaded.com.amazonaws.services.s3.model.AmazonS3Exception:
Access Denied (Service: Amazon S3; Status Code: 403; Error Code:
AccessDenied; Request ID: 515261D45A03B5C5; S3 Extended Request ID:
N1IpKJnJVIRA84QKXqKarjGL71+DYlwXbdXY99N02ykf6q1XEjbSzBoXFU8XfBJXIDrywlG3sTo=),
S3 Extended Request ID:
N1IpKJnJVIRA84QKXqKarjGL71+DYlwXbdXY99N02ykf6q1XEjbSzBoXFU8XfBJXIDrywlG3sTo=
at
com.amazon.ws.emr.hadoop.fs.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1742)
Thanks
Sateesh
--
Sent from:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Locked
