[
https://issues.apache.org/jira/browse/HADOOP-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13442750#comment-13442750
]
Jianbin Wei commented on HADOOP-8717:
-------------------------------------
After the patch, I start dfs and yarn and rerun the job successfully.
⚡ bin/hadoop jar
./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar wordcount
/file.txt output3
12/08/27 14:52:34 INFO input.FileInputFormat: Total input paths to process : 1
12/08/27 14:52:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
12/08/27 14:52:34 WARN snappy.LoadSnappy: Snappy native library not loaded
12/08/27 14:52:34 INFO mapreduce.JobSubmitter: number of splits:1
12/08/27 14:52:34 WARN conf.Configuration: mapred.jar is deprecated. Instead,
use mapreduce.job.jar
12/08/27 14:52:34 WARN conf.Configuration: mapred.output.value.class is
deprecated. Instead, use mapreduce.job.output.value.class
12/08/27 14:52:34 WARN conf.Configuration: mapreduce.combine.class is
deprecated. Instead, use mapreduce.job.combine.class
12/08/27 14:52:34 WARN conf.Configuration: mapreduce.map.class is deprecated.
Instead, use mapreduce.job.map.class
12/08/27 14:52:34 WARN conf.Configuration: mapred.job.name is deprecated.
Instead, use mapreduce.job.name
12/08/27 14:52:34 WARN conf.Configuration: mapreduce.reduce.class is
deprecated. Instead, use mapreduce.job.reduce.class
12/08/27 14:52:34 WARN conf.Configuration: mapred.input.dir is deprecated.
Instead, use mapreduce.input.fileinputformat.inputdir
12/08/27 14:52:34 WARN conf.Configuration: mapred.output.dir is deprecated.
Instead, use mapreduce.output.fileoutputformat.outputdir
12/08/27 14:52:34 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
12/08/27 14:52:34 WARN conf.Configuration: mapred.output.key.class is
deprecated. Instead, use mapreduce.job.output.key.class
12/08/27 14:52:34 WARN conf.Configuration: mapred.working.dir is deprecated.
Instead, use mapreduce.job.working.dir
12/08/27 14:52:35 INFO mapred.ResourceMgrDelegate: Submitted application
application_1346104327473_0002 to ResourceManager at /0.0.0.0:8032
12/08/27 14:52:35 INFO mapreduce.Job: The url to track the job:
http://LM-SJN-00714134:8088/proxy/application_1346104327473_0002/
12/08/27 14:52:35 INFO mapreduce.Job: Running job: job_1346104327473_0002
12/08/27 14:52:42 INFO mapreduce.Job: Job job_1346104327473_0002 running in
uber mode : false
12/08/27 14:52:42 INFO mapreduce.Job: map 0% reduce 0%
12/08/27 14:52:46 INFO mapreduce.Job: map 100% reduce 0%
12/08/27 14:52:50 INFO mapreduce.Job: map 100% reduce 100%
12/08/27 14:52:50 INFO mapreduce.Job: Job job_1346104327473_0002 completed
successfully
12/08/27 14:52:50 INFO mapreduce.Job: Counters: 43
File System Counters
FILE: Number of bytes read=3267
FILE: Number of bytes written=131819
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=2767
HDFS: Number of bytes written=2279
HDFS: Number of read operations=6
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Launched reduce tasks=1
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=15752
Total time spent by all reduces in occupied slots (ms)=18328
Map-Reduce Framework
Map input records=87
Map output records=317
Map output bytes=3881
Map output materialized bytes=3027
Input split bytes=95
Combine input records=317
Combine output records=186
Reduce input groups=186
Reduce shuffle bytes=3027
Reduce input records=186
Reduce output records=186
Spilled Records=372
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=15
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Total committed heap usage (bytes)=282660864
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=2672
File Output Format Counters
Bytes Written=2279
> JAVA_HOME detected in hadoop-config.sh under OS X does not work
> ---------------------------------------------------------------
>
> Key: HADOOP-8717
> URL: https://issues.apache.org/jira/browse/HADOOP-8717
> Project: Hadoop Common
> Issue Type: Bug
> Components: bin
> Environment: OS: Darwin 11.4.0 Darwin Kernel Version 11.4.0: Mon Apr
> 9 19:32:15 PDT 2012; root:xnu-1699.26.8~1/RELEASE_X86_64 x86_64
> java version "1.6.0_33"
> Java(TM) SE Runtime Environment (build 1.6.0_33-b03-424-11M3720)
> Java HotSpot(TM) 64-Bit Server VM (build 20.8-b03-424, mixed mode)
> Reporter: Jianbin Wei
> Priority: Minor
> Fix For: 3.0.0
>
> Attachments: HADOOP-8717.patch, HADOOP-8717.patch
>
>
> After setting up a single node hadoop on mac, copy some text file to it and
> run
> $ hadoop jar
> ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar
> wordcount /file.txt output
> It reports
> 12/08/21 15:32:18 INFO Job.java:mapreduce.Job:1265: Running job:
> job_1345588312126_0001
> 12/08/21 15:32:22 INFO Job.java:mapreduce.Job:1286: Job
> job_1345588312126_0001 running in uber mode : false
> 12/08/21 15:32:22 INFO Job.java:mapreduce.Job:1293: map 0% reduce 0%
> 12/08/21 15:32:22 INFO Job.java:mapreduce.Job:1306: Job
> job_1345588312126_0001 failed with state FAILED due to: Application
> application_1345588312126_0001 failed 1 times due to AM Container for
> appattempt_1345588312126_0001_000001 exited with exitCode: 127 due to:
> .Failing this attempt.. Failing the application.
> 12/08/21 15:32:22 INFO Job.java:mapreduce.Job:1311: Counters: 0
> $ cat
> /tmp/logs/application_1345588312126_0001/container_1345588312126_0001_01_000001/stderr
> /bin/bash: /bin/java: No such file or directory
> The detected JAVA_HOME is not used somehow.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
