Problems in running oozie with hadoop
NickName:supernovae Ask DateTime:2015-07-16T22:44:47

Problems in running oozie with hadoop

I'm trying to run oozie 4.2.0 on hadoop 2.7.0 working in a psudo-distributed mode on my local machine. I built a distro of oozie binding it to the correct hadoop version I'm using, then, according to the documentation I did the following steps

<ul>
<li>Created a folder called <b>libext</b> where I put a .zip of <i>ext-2.2</i> library</li>
<li>Lauched the commands 

    oozie-setup.sh prepare-war 
    ooziedb.sh create -sqlfile oozie.sql -run
    oozied.sh start

Everything went fine, in fact I can navigate <code>localhost:11000/oozie/</code> and also if, i execute <code>oozie admin -oozie http://localhost:11000/oozie -status</code> the server replies with <b>NORMAL</B>.

However I'm not able to launch any jobs, neither the examples. After moving the example folder in the correct position on HDSF if I execute <br> <code>oozie job -oozie localhost:11000/oozie -config /path/to/examples/apps/map-reduce/job.properties -run</code>

The server replies with

Error: HTTP error code: 500 : Internal Server Error.

Same situation if I try to submit a workflow programmatically using the Java API.

Looking at the <code>oozie.log</code> file I get the following error/warning:

ERROR V2AdminServlet:517 - SERVER[Matteos-MBP.vimond.local] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[GET http://localhost:11000/oozie/v2/admin/instrumentation?_dc=1437056225186] error, null java.lang.NullPointerException at org.apache.oozie.service.ShareLibService.getLatestLibPath(ShareLibService.java:687) at org.apache.oozie.service.ShareLibService$7.getValue(ShareLibService.java:742) at org.apache.oozie.service.ShareLibService$7.getValue(ShareLibService.java:737) at org.apache.oozie.servlet.BaseAdminServlet.instrElementsToJson(BaseAdminServlet.java:312) at org.apache.oozie.servlet.BaseAdminServlet.instrToJson(BaseAdminServlet.java:339) at org.apache.oozie.servlet.BaseAdminServlet.sendInstrumentationResponse(BaseAdminServlet.java:396) at org.apache.oozie.servlet.V2AdminServlet.sendInstrumentationResponse(V2AdminServlet.java:124) at org.apache.oozie.servlet.BaseAdminServlet.doGet(BaseAdminServlet.java:127) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)

everytime I refresh the webapp interface and

AuthenticationToken ignored:   
org.apache.hadoop.security.authentication.util.SignerException: Invalid  
signature

Every-time I submit a workflow either via command line or java API

My working environment:
Mac Os Yosemite
java version "1.8.0_45"
Hadoop 2.7.0
oozie 4.2.0
Apache Maven 3.3.3

Can anyone help me to get it working?

Copyright Notice:Content Author:「supernovae」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/31457496/problems-in-running-oozie-with-hadoop

More about “Problems in running oozie with hadoop” related questions

Problems in running oozie with hadoop

I'm trying to run oozie 4.2.0 on hadoop 2.7.0 working in a psudo-distributed mode on my local machine. I built a distro of oozie binding it to the correct hadoop version I'm using, then, according...

Show Detail

Hadoop logs while running through oozie

I am running a map-reduce job through oozie. The command I use is as follows. oozie job -verbose -oozie http://myoozieurl -config job.properties -run How can I view the logs generated by the hado...

Show Detail

Oozie on YARN - oozie is not allowed to impersonate hadoop

I'm trying to use Oozie from Java to start a job on a Hadoop cluster. I have very limited experience with Oozie on Hadoop 1 and now I'm struggling trying out the same thing on YARN. I'm given a ma...

Show Detail

installation of Oozie on a separate machine then Hadoop

Very new to Oozie, hence please excuse me if I sound like a newbie. I have a hadoop cluster which is up and running. I want to install Oozie, this i want on a separate machine then then hadoop. Is ...

Show Detail

configuring/running oozie 3.3.2 and hadoop 1.2.0

I have been working with different versions of both hadoop and oozie to get them working together but haven't suceeded. Recently i considered the two versions(hadoop 1.2.0 and oozie 3.3.2) which ar...

Show Detail

How to install Oozie 3.3.1 on Hadoop 1.1.1?

I am running Hadoop Ver 1.1.1 and want to install Oozie 3.3.1 while installing I am getting following error hduseros@MT2012018:/usr/local/oozie-3.3.1$ ./distro/target/oozie-3.3.1-distro/oozie-3.3...

Show Detail

Failed to execute goal on project oozie-hadoop in Maven for Oozie installation

i am trying to configure Oozie-4.0.1 with JDK 1.7, Hadoop-2.2.0 and Ubuntu, Maven 3. But i am getting following error: 1.jar [INFO] ---------------------------------------------------------------...

Show Detail

how to change user account when oozie submit job to hadoop

When I am running a shell script using oozie, I noticed that in yarn log, "user.name=yarn", So it causes permission problems,how can I switch account to my hadoop account when oozie submit the job to

Show Detail

Oozie - Hadoop commands are not executing (Shell)

I am running a shell script that has hadoop commands. Getting the following error when executing the same Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] I am running a s...

Show Detail

Oozie with Hadoop 2, Job hangs in "RUNNING"

I have workflow job with a java action node. Run with Hadoop 2.1.0.2.0.4.0-38 and Oozie 3.3.2.2.0.4.0 When I submit the job I see 2 lines in Hadoop Resource Manager screen. 1. with original job nam...

Show Detail