Hi Mahmood,

> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira

(2014/03/06 11:08), Mahmood Naderan wrote:
Stuck at this step.....
Hope to receive any idea...

Regards,
Mahmood


On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
<nt_mahm...@yahoo.com> wrote:
Hi
I have downloaded hadoop-2.3.0-src and followed the guide from
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The first command "mvn clean install -DskipTests" was successful.
However wen I run

    cd hadoop-mapreduce-project
    mvn clean install assembly:assembly -Pnative

At some point I get an error. Searching the error message on the web
shows some Q&A on the mailing list archive but seems that they are
related to developers. Please see the full messages below (sorry for
long post).

Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
sec <<< FAILURE! - in
org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
Time elapsed: 2.978 sec  <<< FAILURE!
java.lang.AssertionError: null
     at org.junit.Assert.fail(Assert.java:92)
     at org.junit.Assert.assertTrue(Assert.java:43)
     at org.junit.Assert.assertNotNull(Assert.java:526)
     at org.junit.Assert.assertNotNull(Assert.java:537)
     at
org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)

testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
Time elapsed: 0.255 sec  <<< FAILURE!
java.lang.AssertionError: null
     at org.junit.Assert.fail(Assert.java:92)
     at org.junit.Assert.assertTrue(Assert.java:43)
     at org.junit.Assert.assertNotNull(Assert.java:526)
     at org.junit.Assert.assertNotNull(Assert.java:537)
     at
org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)

Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
Running org.apache.hadoop.mapreduce.v2.app.TestFail
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
Running org.apache.hadoop.mapreduce.v2.app.TestKill
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
sec <<< FAILURE! - in
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
Time elapsed: 5.28 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
     at org.junit.Assert.fail(Assert.java:93)
     at org.junit.Assert.failNotEquals(Assert.java:647)
     at org.junit.Assert.assertEquals(Assert.java:128)
     at org.junit.Assert.assertEquals(Assert.java:147)
     at
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
     at
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)

Running
org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
sec - in
org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
Running
org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
sec - in
org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
sec - in
org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl

Results :

Failed tests:
   TestCommitterEventHandler.testFailure:314 null
   TestCommitterEventHandler.testBasic:263 null
   TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
expected:<SETUP> but was:<RUNNING>

Tests run: 243, Failures: 3, Errors: 0, Skipped: 0

[INFO]
[INFO]
------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO]
------------------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] hadoop-mapreduce-client ........................... SUCCESS [
4.600 s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS
[02:34 min]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS
[01:08 min]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
6.173 s]
[INFO] hadoop-mapreduce-client-app ....................... FAILURE
[11:20 min]
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
[INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 15:25 min
[INFO] Finished at: 2014-03-06T18:35:49+03:30
[INFO] Final Memory: 29M/126M
[INFO]
------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because
it does not exist.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
on project hadoop-mapreduce-client-app: ExecutionException; nested
exception is java.util.concurrent.ExecutionException:
java.lang.RuntimeException: The forked VM terminated without saying
properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd
/export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
&& /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
-XX:+HeapDumpOnOutOfMemoryError -jar
/export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
/export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
/export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app


Regards,
Mahmood



Reply via email to