We use cookies to give you the best experience on our website. If you continue to browse, then you agree to our privacy policy and cookie policy. (Last updated on: November 16, 2018).
Unfortunately, activation email could not send to your email. Please try again.
Syncfusion Feedback

How to resolve HDFS /tmp directory permission for MapReduce job execution?

Platform: Big Data Platform |
Control: General |
Published Date: August 18, 2016 |
Last Revised Date: August 18, 2016

MapReduce job’s intermediate output and artifacts are maintained temporarily under /tmp directory in HDFS and will be deleted after MapReduce job execution. In secure cluster environment, user needs permissions to this /tmp directory along with the directories that the user actually working with.

You need to grant permission for /tmp directory before executing MR Jobs if you are submitting jobs as non-super user. Also, ensure the user need to be in “Administrators” group in Active Directory otherwise MR Job will fail at reducer phase.

In cluster manager HDFS ACL page, you can grant permissions for the directory to the specific user or group as shown below.

ADD COMMENT
You must log in to leave a comment

Please sign in to access our KB

This page will automatically be redirected to the sign-in page in 10 seconds.

Up arrow icon

Warning Icon You are using an outdated version of Internet Explorer that may not display all features of this and other websites. Upgrade to Internet Explorer 8 or newer for a better experience.Close Icon