Articles in this section
Category / Section

How to resolve HDFS /tmp directory permission for MapReduce job execution?

1 min read

MapReduce job’s intermediate output and artifacts are maintained temporarily under /tmp directory in HDFS and will be deleted after MapReduce job execution. In secure cluster environment, user needs permissions to this /tmp directory along with the directories that the user actually working with.

You need to grant permission for /tmp directory before executing MR Jobs if you are submitting jobs as non-super user. Also, ensure the user need to be in “Administrators” group in Active Directory otherwise MR Job will fail at reducer phase.

In cluster manager HDFS ACL page, you can grant permissions for the directory to the specific user or group as shown below.

Did you find this information helpful?
Yes
No
Help us improve this page
Please provide feedback or comments
Comments (0)
Please sign in to leave a comment
Access denied
Access denied