MapReduce job’s intermediate output and artifacts are maintained temporarily under /tmp directory in HDFS and will be deleted after MapReduce job execution. In secure cluster environment, user needs permissions to this /tmp directory along with the directories that the user actually working with.
You need to grant permission for /tmp directory before executing MR Jobs if you are submitting jobs as non-super user. Also, ensure the user need to be in “Administrators” group in Active Directory otherwise MR Job will fail at reducer phase.
In cluster manager HDFS ACL page, you can grant permissions for the directory to the specific user or group as shown below.
|Article ID:||Published Date:||Last Revised Date:||Platform:||Control:|
|7056||08/18/2016||08/18/2016||Big Data Platform||General|