See <https://builds.apache.org/job/Hadoop-Yarn-trunk/248/changes>
Changes:
[bikas] MiniYARNCluster broken after YARN-827 (bikas)
[jlowe] HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe
[bikas] Deleting files missed for YARN-827
[daryn] HADOOP-9421. [RPC v9] Convert SASL to use ProtoBuf and provide
negotiation capabilities (daryn)
[sradia] HADOOP-9619 Mark stability of .proto files (sanjay Radia)
[brandonli] Update CHANGES.txt to move HDFS-4772 to 2.1.0 section
[bikas] YARN-827. Need to make Resource arithmetic methods accessible^CJian He
via bikas)
[tucu] YARN-866. Add test for class ResourceWeights. (ywskycn via tucu)
------------------------------------------
[...truncated 12163 lines...]
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:624)
... 40 more
testBlockNewContainerRequestsOnStartAndResync(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerResync)
Time elapsed: 20 sec <<< ERROR!
org.apache.hadoop.metrics2.MetricsException: Metrics source JvmMetrics already
exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:134)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:115)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:217)
at
org.apache.hadoop.metrics2.source.JvmMetrics.create(JvmMetrics.java:79)
at
org.apache.hadoop.yarn.server.nodemanager.metrics.NodeManagerMetrics.create(NodeManagerMetrics.java:49)
at
org.apache.hadoop.yarn.server.nodemanager.metrics.NodeManagerMetrics.create(NodeManagerMetrics.java:45)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.<init>(NodeManager.java:76)
at
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerResync$TestNodeManager2.<init>(TestNodeManagerResync.java:194)
at
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerResync.testBlockNewContainerRequestsOnStartAndResync(TestNodeManagerResync.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
Running org.apache.hadoop.yarn.server.nodemanager.TestLinuxContainerExecutor
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.596 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestContainerManagerWithLCE
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.104 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestDefaultContainerExecutor
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.665 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestRPCFactories
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.581 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.09 sec <<<
FAILURE!
testKillContainersOnShutdown(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown)
Time elapsed: 1840 sec <<< ERROR!
java.io.IOException: Failed on local exception: java.io.IOException:
java.io.IOException: Server asks us to fall back to SIMPLE auth, but this
client is configured to only allow secure connections.; Host Details : local
host is: "asf009.sp2.ygridcore.net/67.195.138.22"; destination host is:
"127.0.0.1":12345;
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
at org.apache.hadoop.ipc.Client.call(Client.java:1318)
at org.apache.hadoop.ipc.Client.call(Client.java:1266)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at $Proxy26.startContainer(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainer(ContainerManagementProtocolPBClientImpl.java:110)
at
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown.startContainer(TestNodeManagerShutdown.java:213)
at
org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown.testKillContainersOnShutdown(TestNodeManagerShutdown.java:115)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
Caused by: java.io.IOException: java.io.IOException: Server asks us to fall
back to SIMPLE auth, but this client is configured to only allow secure
connections.
at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:589)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489)
at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:552)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:635)
at org.apache.hadoop.ipc.Client$Connection.access$2200(Client.java:258)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1367)
at org.apache.hadoop.ipc.Client.call(Client.java:1285)
... 37 more
Caused by: java.io.IOException: Server asks us to fall back to SIMPLE auth, but
this client is configured to only allow secure connections.
at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:250)
at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:464)
at org.apache.hadoop.ipc.Client$Connection.access$1500(Client.java:258)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:628)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:625)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1489)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:624)
... 40 more
Running org.apache.hadoop.yarn.server.nodemanager.TestNodeStatusUpdater
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.529 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestDirectoryCollection
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.517 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestLocalDirsHandlerService
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.605 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestDeletionService
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.381 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestNodeHealthService
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.712 sec
Running
org.apache.hadoop.yarn.server.nodemanager.api.protocolrecords.impl.pb.TestPBRecordImpl
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.561 sec
Running
org.apache.hadoop.yarn.server.nodemanager.api.protocolrecords.impl.pb.TestPBLocalizerRPC
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.891 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestRecordFactory
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.164 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestNMAuditLogger
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.765 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.TestNonAggregatingLogHandler
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.881 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.675 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.application.TestApplication
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.214 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.TestContainer
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.237 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceRetention
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.381 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestLocalCacheDirectoryManager
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.603 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.128 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestLocalResourcesTrackerImpl
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.639 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestContainerLocalizer
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.052 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestLocalResource
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.286 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestLocalizedResource
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.502 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.49 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestLogAggregationService
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.369 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.TestAuxServices
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.427 sec
Running
org.apache.hadoop.yarn.server.nodemanager.containermanager.TestContainerManager
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.237 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestNodeManager
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.889 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerReboot
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.502 sec
Running org.apache.hadoop.yarn.server.nodemanager.metrics.TestNodeManagerMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.49 sec
Running
org.apache.hadoop.yarn.server.nodemanager.TestLinuxContainerExecutorWithMocks
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.875 sec
Running org.apache.hadoop.yarn.server.nodemanager.util.TestProcessIdFileReader
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.155 sec
Running org.apache.hadoop.yarn.server.nodemanager.TestEventFlow
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.347 sec
Running org.apache.hadoop.yarn.server.nodemanager.webapp.TestNMWebServices
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.25 sec
Running org.apache.hadoop.yarn.server.nodemanager.webapp.TestContainerLogsPage
Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.699 sec
Running org.apache.hadoop.yarn.server.nodemanager.webapp.TestNMWebServicesApps
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.134 sec
Running org.apache.hadoop.yarn.server.nodemanager.webapp.TestNMWebServer
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.886 sec
Running
org.apache.hadoop.yarn.server.nodemanager.webapp.TestNMWebServicesContainers
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.932 sec
Results :
Tests in error:
testKillContainersOnResync(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerResync):
Failed on local exception: java.io.IOException: java.io.IOException: Server
asks us to fall back to SIMPLE auth, but this client is configured to only
allow secure connections.; Host Details : local host is:
"asf009.sp2.ygridcore.net/67.195.138.22"; destination host is:
"127.0.0.1":12345;
testBlockNewContainerRequestsOnStartAndResync(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerResync):
Metrics source JvmMetrics already exists!
testKillContainersOnShutdown(org.apache.hadoop.yarn.server.nodemanager.TestNodeManagerShutdown):
Failed on local exception: java.io.IOException: java.io.IOException: Server
asks us to fall back to SIMPLE auth, but this client is configured to only
allow secure connections.; Host Details : local host is:
"asf009.sp2.ygridcore.net/67.195.138.22"; destination host is:
"127.0.0.1":12345;
Tests run: 175, Failures: 0, Errors: 3, Skipped: 1
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] hadoop-yarn ....................................... SUCCESS [2.812s]
[INFO] hadoop-yarn-api ................................... SUCCESS [1:39.414s]
[INFO] hadoop-yarn-common ................................ SUCCESS [1:59.817s]
[INFO] hadoop-yarn-server ................................ SUCCESS [0.111s]
[INFO] hadoop-yarn-server-common ......................... SUCCESS [26.367s]
[INFO] hadoop-yarn-server-nodemanager .................... FAILURE [3:26.875s]
[INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
[INFO] hadoop-yarn-server-tests .......................... SKIPPED
[INFO] hadoop-yarn-client ................................ SKIPPED
[INFO] hadoop-yarn-applications .......................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED
[INFO] hadoop-yarn-site .................................. SKIPPED
[INFO] hadoop-yarn-project ............................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7:36.732s
[INFO] Finished at: Sat Jun 22 10:41:23 UTC 2013
[INFO] Final Memory: 49M/778M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on
project hadoop-yarn-server-nodemanager: There are test failures.
[ERROR]
[ERROR] Please refer to
<https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/surefire-reports>
for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-yarn-server-nodemanager
Build step 'Execute shell' marked build as failure
Archiving artifacts
Updating HADOOP-9619
Updating HADOOP-9421
Updating HDFS-4205
Updating HDFS-4772
Updating YARN-827
Updating YARN-866
