Re: Processing S3 data with Apache Flink

Posted by snntr on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Processing-S3-data-with-Apache-Flink-tp3046p3104.html

Hey everyone,

I was having the same problem with S3 and found this thread very useful. Everything works fine now, when I start Flink from my IDE, but when I run the jar in local mode I keep getting

java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3n URL, or by setting the fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey properties (respectively).

I have set fs.hdfs.hadoopconf to point to a core-site.xml on my local machine with the required properties. What am I missing?

Any advice is highly appreciated ;)

Cheers,

Konstantin