Oozie on YARN - oozie is not allowed to impersonate hadoop
NickName:Kobe-Wan Kenobi Ask DateTime:2015-06-19T05:47:17

Oozie on YARN - oozie is not allowed to impersonate hadoop

I'm trying to use Oozie from Java to start a job on a Hadoop cluster. I have very limited experience with Oozie on Hadoop 1 and now I'm struggling trying out the same thing on YARN.

I'm given a machine that doesn't belong to the cluster, so when I try to start my job I get the following exception:

E0501 : E0501: Could not perform authorization operation, User: oozie is not allowed to impersonate hadoop

Why is that and what to do?

I read a bit about core-site properties that need to be set

<property>
  <name>hadoop.proxyuser.oozie.groups</name>
  <value>users</value>
</property>

<property>
  <name>hadoop.proxyuser.oozie.hosts</name>
  <value>master</value>
</property>

Does it seem that this is the problem? Should I contact people responsible for cluster to fix that?

Could there be problems because I'm using same code for YARN as I did for Hadoop 1? Should something be changed? For example, I'm setting nameNode and jobTracker in workflow.xml, should jobTracker exist, since there is now ResourceManager? I have set the address of ResourceManager, but left the property name as jobTracker, could that be the error?

Maybe I should also mention that Ambari is used...

Copyright Notice:Content Author:「Kobe-Wan Kenobi」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/30926357/oozie-on-yarn-oozie-is-not-allowed-to-impersonate-hadoop

Answers
karthik 2015-06-19T07:22:06

Hi please update the core-site.xml \n\n<property>\n <name>hadoop.proxyuser.hadoop.groups</name>\n <value>*</value>\n</property>\n\n<property>\n <name>hadoop.proxyuser.hadoop.hosts</name>\n <value>*</value>\n</property>\n\n\nand jobTracker address is the Resourcemananger address that will not be the case . once update the core-site.xml file it will works.",


More about “Oozie on YARN - oozie is not allowed to impersonate hadoop” related questions

Oozie on YARN - oozie is not allowed to impersonate hadoop

I'm trying to use Oozie from Java to start a job on a Hadoop cluster. I have very limited experience with Oozie on Hadoop 1 and now I'm struggling trying out the same thing on YARN. I'm given a ma...

Show Detail

oozie is not allowed to impersonate oozie

I am kinda new with oozie. I installed (with the cdh repo )oozie on my server (I followed the CDH4 documentation [my hadoop is running in cdh4]). I have update my core-site.xml with the following

Show Detail

Error running spark action in oozie: User: root is not allowed to impersonate root

I have installed oozie-4.2 on AWS as root and am running the workflow as root as well.I have hadoop-2.4 running on a cluster I have added the following in oozie-site.xml &lt;property&gt; &lt;name...

Show Detail

Sharelib error-[User: oozie is not allowed to impersonate oozie]

Executed the command "sudo -u oozie ./bin/oozie-setup.sh sharelib create -fs hdfs://localhost:54310 -locallib oozie-sharelib-4.1.0.tar.gz" Iam getting the error "Error: E0902: Exception occured: [...

Show Detail

Getting E0902: Exception occured: [User: oozie is not allowed to impersonate oozie]

Hi i am new to Oozie and i am getting this error E0902: Exception occured: [User: pramod is not allowed to impersonate pramod] when i run the following command ./oozie job -oozie htt p://local...

Show Detail

Hadoop 3.3 and oozie 5.2.0

I am using hadoop 3.3 and oozie 5.2.0. I am getting below error: Exception in thread &quot;main&quot; java.lang.NullPointerException at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.

Show Detail

Executing oozie job - yarn problems

I am trying to execute bash script, which contains multiple hive commands using oozie. I have encountered several exceptions: permission-issue - impersonate oozie job - permission issue - solved by

Show Detail

Oozie sharelib creation in hdfs.(Root is not able to impersonate root)

I am following http://hadooptutorial.info/apache-oozie-installation-on-ubuntu-14-04/ for installing oozie 4.1.0 with hadoop 2.7.2 Build is successfull and i can able to create oozie war by issuin...

Show Detail

Oozie executing hadoop commands in shell action as yarn

Environment : Hortonworks Sandbox HDP 2.2.4 Issue : Unable to run the hadoop commands present in the shell scripts as a root user. The oozie job is getting triggered as a root user, but when the h...

Show Detail

Oozie Hadoop Streaming

I am trying to write a simple map only hadoop streaming job reading data from hdfs and pushing it to vertica. I have written few shell scripts as below load.sh hadoop jar hadoop-streaming-2.7....

Show Detail