Best approach for S3 integration testing without using deprecated ConfigConstants.HDFS_SITE_CONFIG?

[Ken Krugler]

Hi all,

I noticed that ConfigConstants.HDFS_SITE_CONFIG is deprecated, though YarnFileStageTestS3ITCase.setupCustomHadoopConfig() still uses it to specify a file that provides AWS credentials for S3 integration testing.

What’s the recommended approach for S3 integration tests, without HDFS_SITE_CONFIG?

The Javadoc says to use HADOOP_CONF_DIR, but setting up an environment variable from inside a unit test is…messy.

Thanks,

— Ken

--------------------------

Ken Krugler
[phone]
http://www.scaleunlimited.com
Custom big data solutions & training
Flink, Solr, Hadoop, Cascading & Cassandra