See <https://builds.apache.org/job/Hadoop-Yarn-trunk/621/changes>
Changes:
[sandy] YARN-2313. Livelock can occur in FairScheduler when there are lots of
running apps (Tsuyoshi Ozawa via Sandy Ryza)
[wang] HADOOP-10881. Clarify usage of encryption and encrypted encryption key
in KeyProviderCryptoExtension. (wang)
[todd] HADOOP-10855. Allow Text to be read with a known Length. Contributed by
Todd Lipcon.
[kasha] YARN-2273. NPE in ContinuousScheduling thread when we lose a node. (Wei
Yan via kasha)
[brandonli] HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode
will cause a null pointer exception. Contributed by Masatake Iwasaki
[brandonli] HDFS-6703. NFS: Files can be deleted from a read-only mount.
Contributed by Srikanth Upputuri
[arp] HDFS-6712. Document HDFS Multihoming Settings. (Contributed by Arpit
Agarwal)
[jlowe] MAPREDUCE-5963. ShuffleHandler DB schema should be versioned with
compatible/incompatible changes. Contributed by Junping Du
[kasha] YARN-2131. Addendum2: Document -format-state-store. Add a way to format
the RMStateStore. (Robert Kanter via kasha)
[jianhe] YARN-2295. Refactored DistributedShell to use public APIs of protocol
records. Contributed by Li Lu
[wang] HDFS-6701. Make seed optional in NetworkTopology#sortByDistance.
Contributed by Ashwin Shankar.
[jing9] HDFS-6704. Fix the command to launch JournalNode in HDFS-HA document.
Contributed by Akira AJISAKA.
[arp] HADOOP-10864. Tool documentenation is broken. (Contributed by Akira
Ajisaka)
[tucu] HADOOP-10826. Iteration on KeyProviderFactory.serviceLoader is
thread-unsafe. (benoyantony viat tucu)
[zjshen] YARN-2319. Made the MiniKdc instance start/close before/after the
class of TestRMWebServicesDelegationTokens. Contributed by Wenwu Peng.
[junping_du] YARN-2242. Addendum patch. Improve exception information on AM
launch crashes. (Contributed by Li Lu)
------------------------------------------
[...truncated 15147 lines...]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:99)
at
org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
"main" prio=5 tid=1 runnable
java.lang.Thread.State: RUNNABLE
at java.lang.Thread.dumpThreads(Native Method)
at java.lang.Thread.getAllStackTraces(Thread.java:1530)
at
org.apache.hadoop.test.TimedOutTestsListener.buildThreadDump(TimedOutTestsListener.java:86)
at
org.apache.hadoop.test.TimedOutTestsListener.buildThreadDiagnosticString(TimedOutTestsListener.java:72)
at
org.apache.hadoop.test.TimedOutTestsListener.testFailure(TimedOutTestsListener.java:61)
at
org.junit.runner.notification.RunNotifier$4.notifyListener(RunNotifier.java:139)
at
org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:61)
at
org.junit.runner.notification.RunNotifier.fireTestFailures(RunNotifier.java:134)
at
org.junit.runner.notification.RunNotifier.fireTestFailure(RunNotifier.java:128)
at
org.junit.internal.runners.model.EachTestNotifier.addFailure(EachTestNotifier.java:23)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:275)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"Thread-3" prio=5 tid=11 runnable
java.lang.Thread.State: RUNNABLE
at java.net.Inet4AddressImpl.getLocalHostName(Native Method)
at java.net.InetAddress.getLocalHost(InetAddress.java:1374)
at sun.security.provider.SeedGenerator$1.run(SeedGenerator.java:154)
at java.security.AccessController.doPrivileged(Native Method)
at
sun.security.provider.SeedGenerator.getSystemEntropy(SeedGenerator.java:139)
at
sun.security.provider.SecureRandom$SeederHolder.<clinit>(SecureRandom.java:165)
at
sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:184)
at java.security.SecureRandom.nextBytes(SecureRandom.java:433)
at java.util.UUID.randomUUID(UUID.java:159)
at org.apache.hadoop.ipc.ClientId.getClientId(ClientId.java:42)
at org.apache.hadoop.ipc.Client.<init>(Client.java:1193)
at org.apache.hadoop.ipc.ClientCache.getClient(ClientCache.java:57)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:130)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:119)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:107)
at
org.apache.hadoop.ipc.ProtobufRpcEngine.getProxy(ProtobufRpcEngine.java:90)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:541)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:486)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:451)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:604)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:561)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.<init>(ApplicationClientProtocolPBClientImpl.java:132)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:76)
at
org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getProxy(HadoopYarnProtoRPC.java:48)
at org.apache.hadoop.yarn.client.RMProxy$1.run(RMProxy.java:134)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:337)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1606)
at org.apache.hadoop.yarn.client.RMProxy.getProxy(RMProxy.java:130)
at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:93)
at
org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:70)
at
org.apache.hadoop.yarn.server.webproxy.AppReportFetcher.<init>(AppReportFetcher.java:53)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:72)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.serviceInit(WebAppProxyServer.java:64)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.startServer(WebAppProxyServer.java:113)
at
org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet.testWebAppProxyServerMainMethod(TestWebAppProxyServlet.java:200)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
"Finalizer" daemon prio=8 tid=3 in Object.wait()
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 10.36 sec <<<
FAILURE! - in org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet
testWebAppProxyServerMainMethod(org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet)
Time elapsed: 5.013 sec <<< ERROR!
java.lang.Exception: test timed out after 5000 milliseconds
at java.net.Inet4AddressImpl.getLocalHostName(Native Method)
at java.net.InetAddress.getLocalHost(InetAddress.java:1374)
at sun.security.provider.SeedGenerator$1.run(SeedGenerator.java:154)
at java.security.AccessController.doPrivileged(Native Method)
at
sun.security.provider.SeedGenerator.getSystemEntropy(SeedGenerator.java:139)
at
sun.security.provider.SecureRandom$SeederHolder.<clinit>(SecureRandom.java:165)
at
sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:184)
at java.security.SecureRandom.nextBytes(SecureRandom.java:433)
at java.util.UUID.randomUUID(UUID.java:159)
at org.apache.hadoop.ipc.ClientId.getClientId(ClientId.java:42)
at org.apache.hadoop.ipc.Client.<init>(Client.java:1193)
at org.apache.hadoop.ipc.ClientCache.getClient(ClientCache.java:57)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:130)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:119)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:107)
at
org.apache.hadoop.ipc.ProtobufRpcEngine.getProxy(ProtobufRpcEngine.java:90)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:541)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:486)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:451)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:604)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:561)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.<init>(ApplicationClientProtocolPBClientImpl.java:132)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:76)
at
org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getProxy(HadoopYarnProtoRPC.java:48)
at org.apache.hadoop.yarn.client.RMProxy$1.run(RMProxy.java:134)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:337)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1606)
at org.apache.hadoop.yarn.client.RMProxy.getProxy(RMProxy.java:130)
at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:93)
at
org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:70)
at
org.apache.hadoop.yarn.server.webproxy.AppReportFetcher.<init>(AppReportFetcher.java:53)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:72)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.serviceInit(WebAppProxyServer.java:64)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.startServer(WebAppProxyServer.java:113)
at
org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet.testWebAppProxyServerMainMethod(TestWebAppProxyServlet.java:200)
testWebAppProxyServlet(org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet)
Time elapsed: 5.002 sec <<< ERROR!
java.lang.Exception: test timed out after 5000 milliseconds
at org.apache.hadoop.ipc.ClientCache.getClient(ClientCache.java:55)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:130)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:119)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.<init>(ProtobufRpcEngine.java:107)
at
org.apache.hadoop.ipc.ProtobufRpcEngine.getProxy(ProtobufRpcEngine.java:90)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:541)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:486)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:451)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:604)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:561)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.<init>(ApplicationClientProtocolPBClientImpl.java:132)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.apache.hadoop.yarn.factories.impl.pb.RpcClientFactoryPBImpl.getClient(RpcClientFactoryPBImpl.java:76)
at
org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getProxy(HadoopYarnProtoRPC.java:48)
at org.apache.hadoop.yarn.client.RMProxy$1.run(RMProxy.java:134)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:337)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1606)
at org.apache.hadoop.yarn.client.RMProxy.getProxy(RMProxy.java:130)
at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:93)
at
org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:70)
at
org.apache.hadoop.yarn.server.webproxy.AppReportFetcher.<init>(AppReportFetcher.java:53)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxy.serviceInit(WebAppProxy.java:72)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet$WebAppProxyServerForTest.init(TestWebAppProxyServlet.java:280)
at
org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServlet.testWebAppProxyServlet(TestWebAppProxyServlet.java:128)
"2133473171@qtp-608889682-0" prio=5 tid=9 t
Running org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServer
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.593 sec - in
org.apache.hadoop.yarn.server.webproxy.TestWebAppProxyServer
Results :
Failed tests:
TestAmFilterInitializer.testGetProxyHostsAndPortsForAmFilter:135
expected:<asf900[.gq1.ygridcore.net]:8088> but was:<asf900[]:8088>
Tests in error:
TestWebAppProxyServlet.testWebAppProxyServerMainMethod:200 ? test timed out
a...
TestWebAppProxyServlet.testWebAppProxyServlet:128 ? test timed out after
5000...
Tests run: 16, Failures: 1, Errors: 2, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] hadoop-yarn ....................................... SUCCESS [ 3.326 s]
[INFO] hadoop-yarn-api ................................... SUCCESS [02:20 min]
[INFO] hadoop-yarn-common ................................ SUCCESS [02:09 min]
[INFO] hadoop-yarn-server ................................ SUCCESS [ 0.090 s]
[INFO] hadoop-yarn-server-common ......................... SUCCESS [ 37.732 s]
[INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [05:02 min]
[INFO] hadoop-yarn-server-web-proxy ...................... FAILURE [01:13 min]
[INFO] hadoop-yarn-server-applicationhistoryservice ...... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
[INFO] hadoop-yarn-server-tests .......................... SKIPPED
[INFO] hadoop-yarn-client ................................ SKIPPED
[INFO] hadoop-yarn-applications .......................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED
[INFO] hadoop-yarn-site .................................. SKIPPED
[INFO] hadoop-yarn-project ............................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11:29 min
[INFO] Finished at: 2014-07-23T10:57:14+00:00
[INFO] Final Memory: 80M/995M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on
project hadoop-yarn-server-web-proxy: There are test failures.
[ERROR]
[ERROR] Please refer to
<https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/target/surefire-reports>
for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-yarn-server-web-proxy
Build step 'Execute shell' marked build as failure
Archiving artifacts
Updating YARN-2273
Updating YARN-2313
Updating HDFS-6703
Updating YARN-2295
Updating HADOOP-10826
Updating HDFS-6704
Updating HDFS-6701
Updating HDFS-6712
Updating HDFS-6731
Updating HADOOP-10855
Updating HADOOP-10881
Updating YARN-2131
Updating HADOOP-10864
Updating MAPREDUCE-5963
Updating YARN-2319
Updating YARN-2242
