hadoop

[Raja.Aravapalli]

 

Hi,

 

I triggered an flink yarn-session on a running Hadoop cluster… and triggering streaming application on that.

 

But, I see after few days of running without any issues, the flink application which is writing data to hdfs failing with below exception.

 

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token xxxxxx for xxxxxx) can't be found in cache

 

 

Can someone please help me how I can fix this. Thanks a lot.

 

 

 

Regards,

Raja.

[Will Du]

Is the kerberos token expired without renewing?

On Aug 16, 2017, at 7:48 PM, Raja.Aravapalli <[hidden email]> wrote:

 

Hi,

 

I triggered an flink yarn-session on a running Hadoop cluster… and triggering streaming application on that.

 

But, I see after few days of running without any issues, the flink application which is writing data to hdfs failing with below exception.

 

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token xxxxxx for xxxxxx) can't be found in cache

 

 

Can someone please help me how I can fix this. Thanks a lot.

 

 

 

Regards,

Raja.

[Ted Yu]

Can you check the following config in yarn-site.xml ?

yarn.resourcemanager.proxy-user-privileges.enabled (true)

Cheers

On Wed, Aug 16, 2017 at 4:48 PM, Raja.Aravapalli <[hidden email]> wrote:

 

Hi,

 

I triggered an flink yarn-session on a running Hadoop cluster… and triggering streaming application on that.

 

But, I see after few days of running without any issues, the flink application which is writing data to hdfs failing with below exception.

 

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token xxxxxx for xxxxxx) can't be found in cache

 

 

Can someone please help me how I can fix this. Thanks a lot.

 

 

 

Regards,

Raja.