kevinw66 commented on PR #965:
URL: https://github.com/apache/bigtop/pull/965#issuecomment-1214158360
> We upgraded Hadoop version to 3.3.4 in #964.
>
> Then the Hive depolyment is against on Hadoop-3.3.4.
>
> Failed to start `WebHCat Server`:
>
> ```
> resource_management.core.exceptions.ExecutionFailed: Execution of 'cd
/var/run/webhcat ; /usr/lib/hive-hcatalog/sbin/webhcat_server.sh start'
returned 1. Lenght of string is non zero
> webhcat: starting ...
> webhcat: /usr/lib/hadoop/bin/hadoop jar
/usr/lib/hive-hcatalog/sbin/../share/webhcat/svr/lib/hive-webhcat-3.1.3.jar
org.apache.hive.hcatalog.templeton.Main
> /usr/lib/hive-hcatalog/sbin/webhcat_server.sh: failed to start. Check logs
in /var/log/webhcat
> ```
>
> ```
> 2022-08-08 06:33:09,263 - Execute['cd /var/run/webhcat ;
/usr/lib/hive-hcatalog/sbin/webhcat_server.sh start'] {'environment':
{'HIVE_HOME': '/usr/lib/hive'}, 'not_if': 'ls /var/run/webhcat/webhcat.pid
>/dev/null 2>&1 && ps -p `cat /var/run/webhcat/webhcat.pid` >/dev/null 2>&1',
'user': 'hcat'}
> 2022-08-08 06:33:19,463 - Execute['find /var/log/webhcat -maxdepth 1 -type
f -name '*' -exec echo '==> {} <==' \; -exec tail -n 40 {} \;'] {'logoutput':
True, 'ignore_failures': True, 'user': 'hcat'}
> ==> /var/log/webhcat/webhcat-console-error.log <==
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
[jar:file:/usr/lib/hive/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
[jar:file:/usr/lib/hadoop/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
> SLF4J: Actual binding is of type
[org.apache.logging.slf4j.Log4jLoggerFactory]
> templeton: Server failed to start: Authentication type must be specified:
simple|kerberos|<class>
> ==> /var/log/webhcat/webhcat.log <==
> INFO | 08 Aug 2022 06:33:12,392 |
org.apache.curator.framework.imps.CuratorFrameworkImpl |
backgroundOperationsLoop exiting
> INFO | 08 Aug 2022 06:33:12,437 |
com.sun.jersey.api.core.ScanningResourceConfig | Root resource classes found:
> class org.apache.hive.hcatalog.templeton.Server
> INFO | 08 Aug 2022 06:33:12,437 |
com.sun.jersey.api.core.ScanningResourceConfig | Provider classes found:
> class org.apache.hive.hcatalog.templeton.CatchallExceptionMapper
> class org.apache.hive.hcatalog.templeton.SimpleExceptionMapper
> INFO | 08 Aug 2022 06:33:12,443 | org.eclipse.jetty.server.Server |
jetty-9.3.20.v20170531
> INFO | 08 Aug 2022 06:33:12,525 |
org.apache.hive.hcatalog.templeton.tool.ZooKeeperCleanup | Next execution: Mon
Aug 08 06:38:09 UTC 2022
> INFO | 08 Aug 2022 06:33:12,599 |
com.sun.jersey.server.impl.application.WebApplicationImpl | Initiating Jersey
application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
> INFO | 08 Aug 2022 06:33:13,005 |
com.sun.jersey.api.wadl.config.WadlGeneratorLoader | Loading wadlGenerator
com.sun.jersey.server.wadl.generators.resourcedoc.WadlGeneratorResourceDocSupport
> INFO | 08 Aug 2022 06:33:13,473 |
org.eclipse.jetty.server.AbstractConnector | Started
ServerConnector@15dd5ac2{HTTP/1.1,[http/1.1]}{0.0.0.0:50111}
> ERROR | 08 Aug 2022 06:33:13,474 | org.apache.hive.hcatalog.templeton.Main
| Server failed to start:
> javax.servlet.ServletException: Authentication type must be specified:
simple|kerberos|<class>
> at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:164)
~[hadoop-auth-3.3.4.jar:?]
> at
org.apache.hadoop.security.authentication.server.ProxyUserAuthenticationFilter.init(ProxyUserAuthenticationFilter.java:57)
~[hadoop-common-3.3.4.jar:?]
> at
org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:349)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at org.eclipse.jetty.server.Server.start(Server.java:422)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at org.eclipse.jetty.server.Server.doStart(Server.java:389)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
~[jetty-runner-9.3.20.v20170531.jar:9.3.20.v20170531]
> at org.apache.hive.hcatalog.templeton.Main.runServer(Main.java:235)
~[hive-webhcat-3.1.3.jar:3.1.3]
> at org.apache.hive.hcatalog.templeton.Main.run(Main.java:134)
[hive-webhcat-3.1.3.jar:3.1.3]
> at org.apache.hive.hcatalog.templeton.Main.main(Main.java:345)
[hive-webhcat-3.1.3.jar:3.1.3]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_342]
> at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_342]
> at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_342]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_342]
> at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
[hadoop-common-3.3.4.jar:?]
> at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
[hadoop-common-3.3.4.jar:?]
> ==> /var/log/webhcat/webhcat-console.log <==
> ```
WebHCat in Hive 3.1.3 is not compatible with Hadoop 3.3.x.
Related to [HIVE-3520](https://github.com/apache/hive/pull/3520)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
