Impersonate user for hdfs

[Vishal Santoshi]

Hello folks,

         I need to write to hdfs as a proxy user ( I am running TM /JM as root but hive on our setup is under this proxy user and thus the permissions issue ) . I think that this is possible in Hadoop MR and I am sure this is a common request.

Thanks

Vishal

[Timo Walther]

Hi Vishal,

shouldn't it be possible to configure a proxy user via core-site.xml? Flink is also using this XML for HDFS.

You can also set the configuration files manually, see https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#hdfs

Regards,
Timo


Am 11/21/17 um 3:05 PM schrieb Vishal Santoshi:

Hello folks,

         I need to write to hdfs as a proxy user ( I am running TM /JM as root but hive on our setup is under this proxy user and thus the permissions issue ) . I think that this is possible in Hadoop MR and I am sure this is a common request. 

Thanks 

Vishal

[Vishal Santoshi]

Thank you Timo,  I should have thought through. We have done this for oozie, so definitely an avenue to explore.  Will let you know.

On Wed, Nov 22, 2017 at 9:05 AM, Timo Walther <[hidden email]> wrote:

Hi Vishal,

shouldn't it be possible to configure a proxy user via core-site.xml? Flink is also using this XML for HDFS.

You can also set the configuration files manually, see https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#hdfs

Regards,
Timo


Am 11/21/17 um 3:05 PM schrieb Vishal Santoshi:

Hello folks,

         I need to write to hdfs as a proxy user ( I am running TM /JM as root but hive on our setup is under this proxy user and thus the permissions issue ) . I think that this is possible in Hadoop MR and I am sure this is a common request. 

Thanks 

Vishal