Eugene, do you know if these two failures happen on 0.13.0 as well? I would assume that TestHive_7 is an issue on 0.13.0 as well, given that the fix for it went into trunk. What is your sense for how important it is that we fix this? i.e., per my understanding, (a) It does not cause a crash or adversly affect the ability for webhcat to continue operating, and (b) It means that the feature does not work (at all, but in isolation), and that there is no work around for it. This means I treat it as critical(valid bug without workaround) but not severe(breaks product, affects other features from being used). Thus, I'm willing to include HIVE-6521 in an RC2 if we have 2 more committers +1 an inclusion request for this.
As for TestHeartbeat_1, that's an interesting failure. Do you have logs on what commandline options org.apache.hive.hcatalog.templeton.LauncherDelegator sent along that caused it to break? Would that affect other job launches? On Tue, May 13, 2014 at 8:14 PM, Eugene Koifman <ekoif...@hortonworks.com> wrote: > TestHive_7 is explained by https://issues.apache.org/jira/browse/HIVE-6521, > which is in trunk but not 13.1 > > > On Tue, May 13, 2014 at 6:50 PM, Eugene Koifman > <ekoif...@hortonworks.com>wrote: > >> I downloaded src tar, built it and ran webhcat e2e tests. >> I see 2 failures (which I don't see on trunk) >> >> TestHive_7 fails with >> "got percentComplete map 100% reduce 0%, expected map 100% reduce 100%" >> >> TestHeartbeat_1 fails to even launch the job. This looks like the root >> cause >> >> ERROR | 13 May 2014 18:24:00,394 | >> org.apache.hive.hcatalog.templeton.CatchallExceptionMapper | >> java.lang.NullPointerException >> at >> org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:312) >> at >> org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:479) >> at >> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170) >> at >> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) >> at >> org.apache.hive.hcatalog.templeton.LauncherDelegator$1.run(LauncherDelegator.java:107) >> at >> org.apache.hive.hcatalog.templeton.LauncherDelegator$1.run(LauncherDelegator.java:103) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:396) >> at >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) >> at >> org.apache.hive.hcatalog.templeton.LauncherDelegator.queueAsUser(LauncherDelegator.java:103) >> at >> org.apache.hive.hcatalog.templeton.LauncherDelegator.enqueueController(LauncherDelegator.java:81) >> at >> org.apache.hive.hcatalog.templeton.JarDelegator.run(JarDelegator.java:55) >> at >> org.apache.hive.hcatalog.templeton.Server.mapReduceJar(Server.java:711) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at >> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) >> at >> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185) >> at >> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) >> at >> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) >> at >> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) >> at >> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108) >> at >> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) >> at >> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) >> at >> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1480) >> at >> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1411) >> at >> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1360) >> at >> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1350) >> at >> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416) >> at >> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:538) >> at >> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:716) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) >> at >> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:565) >> at >> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1360) >> at >> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:392) >> at >> org.apache.hadoop.hdfs.web.AuthFilter.doFilter(AuthFilter.java:87) >> at >> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1331) >> at >> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:477) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1031) >> at >> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:406) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:965) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) >> at >> org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111) >> at org.eclipse.jetty.server.Server.handle(Server.java:349) >> at >> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:449) >> at >> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:925) >> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857) >> at >> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) >> at >> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:76) >> at >> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:609) >> at >> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:45) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534) >> at java.lang.Thread.run(Thread.java:680) >> >> >> >> On Mon, May 12, 2014 at 7:30 PM, Sushanth Sowmyan <khorg...@apache.org>wrote: >> >>> >>> Apache Hive 0.13.1 Release Candidate 1 is available here: >>> >>> http://people.apache.org/~khorgath/releases/0.13.1_RC1/artifacts/ >>> >>> Maven artifacts are available here: >>> >>> https://repository.apache.org/content/repositories/orgapachehive-1013/ >>> >>> Source tag for RC1 is at : >>> https://svn.apache.org/viewvc/hive/tags/release-0.13.1-rc1/ >>> >>> Voting will conclude in 72 hours. >>> >>> Hive PMC Members: Please test and vote. >>> >>> Thanks. >>> -Sushanth >>> >> >> >> >> -- >> >> Thanks, >> Eugene >> > > > > -- > > Thanks, > Eugene > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You.
