Best approach for S3 integration testing without using deprecated ConfigConstants.HDFS_SITE_CONFIG?
Posted by
Ken Krugler on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Best-approach-for-S3-integration-testing-without-using-deprecated-ConfigConstants-HDFS-SITE-CONFIG-tp29694.html
Hi all,
I noticed that ConfigConstants.HDFS_SITE_CONFIG is deprecated, though YarnFileStageTestS3ITCase.setupCustomHadoopConfig() still uses it to specify a file that provides AWS credentials for S3 integration testing.
What’s the recommended approach for S3 integration tests, without HDFS_SITE_CONFIG?
The Javadoc says to use HADOOP_CONF_DIR, but setting up an environment variable from inside a unit test is…messy.
Thanks,
— Ken
--------------------------