Hadoop Basic Examples WordCount
NickName:Berlin Brown Ask DateTime:2011-08-13T09:27:33

Hadoop Basic Examples WordCount

I am getting this error with a mostly out of the box configuration from version 0.20.203.0

Where should I look for a potential issue. Most of the configuration is out of the box. I was able to visit the local websites for hdfs, task manager.

I am guessing the error is related to a permissions issue on cygwin and windows. Also, googling the problem, they say there might be some kind of out of memory issue. It is such a simple example, I don't see how that could be.

When I try to run the wordcount examples.

$ hadoop jar hadoop-examples-0.20.203.0.jar wordcount /user/hduser/gutenberg /user/hduser/gutenberg-output6

I get this error:

2011-08-12 15:45:38,299 WARN org.apache.hadoop.mapred.TaskRunner:
attempt_201108121544_0001_m_000008_2 : Child Error
java.io.IOException: Task process exit with nonzero status of 127.
 at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
2011-08-12 15:45:38,878 WARN org.apache.hadoop.mapred.TaskLog: Failed to
retrieve stdout log for task: attempt_201108121544_0001_m_000008_1
java.io.FileNotFoundException:
E:\projects\workspace_mar11\ParseLogCriticalErrors\lib\h\logs\userlogs\j
ob_201108121544_0001\attempt_201108121544_0001_m_000008_1\log.index (The
system cannot find the file specified)
 at java.io.FileInputStream.open(Native Method)
 at java.io.FileInputStream.<init>(FileInputStream.java:106)
 at
org.apache.hadoop.io.SecureIOUtils.openForRead(SecureIOUtils.java:102)
 at
org.apache.hadoop.mapred.TaskLog.getAllLogsFileDetails(TaskLog.java:112)
...

The userlogs/job* directory is empty. Maybe there is some permission issue with those directories.

I am running on windows with cygwin so I don't really know permissions to set.

Copyright Notice:Content Author:「Berlin Brown」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/7047945/hadoop-basic-examples-wordcount

More about “Hadoop Basic Examples WordCount” related questions

Hadoop Basic Examples WordCount

I am getting this error with a mostly out of the box configuration from version 0.20.203.0 Where should I look for a potential issue. Most of the configuration is out of the box. I was able to v...

Show Detail

Wordcount example hadoop

I am new to Hadoop and trying to explore it via examples available on their website.So this might sound like a very basic question. In Eclipse IDE I simply created a java project ,imported necessary

Show Detail

Error while running basic Hadoop wordcount in cloudera

I am way too new to Cloudera and Hadoop. I encountered a problem while executing the following command in Cloudera Quickstart VM terminal hadoop jar hadoop-mapreduce-examples.jar wordcount /user/

Show Detail

NoClassDefFoundError in Hadoop wordcount

I am new to java, I tried to setup and run hadoop in windows 10. however, when I run the wordcount main function, I get the following error. Exception in thread "main" java.lang.NoClassDefFoundErr...

Show Detail

at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)

I use the eclipse debug hadoop, there is an error, how to solve this problem log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). log4j:WARN Pl...

Show Detail

unable to run hadoop wordcount example?

I am running hadoop wordcount example in single node environment on ubuntu 12.04 in vmware. i running the example like this:-- hadoop@master:~/hadoop$ hadoop jar hadoop-examples-1.0.4.jar wordcoun...

Show Detail

Hadoop issue, trying to run basic WordCount MapReduce on hadoop

I'm running hadoop on my Windows 10 laptop, but I found some guides on getting it up and running and running a basic word count program. The hadoop installation seems fine as I'm able to see the

Show Detail

Running wordcount Hadoop example on Windows using Hadoop 2.6.0

I am new to Hadoop and learnt that with 2.x version, I can try Hadoop on my local Windows 7 64-bit machine. I installed hadoop 2.6.0 and installed cygwin. I could execute bin/hadoop version but I g...

Show Detail

Hadoop 2.6.0 wordcount example running forever

I started all the daemons in my hadoop 2.6.0 machine on ububtu 14.4 LTS vaibhav@vaibhav-300E4Z-300E5Z-300E7Z:~$ jps 5644 NodeManager 10116 Jps 9602 SecondaryNameNode 5324 ResourceManager 8001

Show Detail

Exception in running hadoop wordcount example in cassandra

i have cluster with 2 node and i installed hadoop and cassandra on these nodes correctly, when i run the word count example in [https://github.com/apache/cassandra/tree/trunk/examples/

Show Detail