[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069234#comment-16069234
]
John Zhuge commented on HADOOP-14024:
-
Just a little explanation on the fix:
* Changing jetty scope from "test" to "compile" is a lie technically because
only KMS test code depends on jetty directly, while KMS main code depends on
jetty indirectly via hadoop-common.
* Even if I remove the jetty exclusion from hadoop-common dependency, the local
jetty test dependency will trump the transitive jetty compile dependency. See
http://maven.apache.org/guides/introduction/introduction-to-dependency-mechanism.html#Dependency_Scope.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL: https://issues.apache.org/jira/browse/HADOOP-14024
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 2.8.0
>Reporter: Andrew Wang
>Assignee: John Zhuge
>Priority: Critical
> Fix For: 2.9.0, 2.8.2
>
> Attachments: HADOOP-14024-branch-2.001.patch
>
>
> Throws like this:
> {noformat}
> root cause java.lang.ClassNotFoundException:
> org.mortbay.jetty.servlet.Context
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1698)
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1544)
> org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:174)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
>
> org.apache.hadoop.crypto.key.kms.server.KMSMDCFilter.doFilter(KMSMDCFilter.java:84)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:636)
>
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:304)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:588)
>
> org.apache.hadoop.crypto.key.kms.server.KMSAuthenticationFilter.doFilter(KMSAuthenticationFilter.java:129)
> {noformat}
> I tried out branch-2.6 and it seems to be okay, so something changed between
> 2.6.x and 2.8.x/branch-2
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067771#comment-16067771
]
Xiao Chen commented on HADOOP-14024:
Thanks [~jzhuge] for chasing this down! +1 to the fix.
I also manually verified the jmx to show correctly.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL: https://issues.apache.org/jira/browse/HADOOP-14024
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 2.8.0
>Reporter: Andrew Wang
>Assignee: John Zhuge
>Priority: Critical
> Attachments: HADOOP-14024-branch-2.001.patch
>
>
> Throws like this:
> {noformat}
> root cause java.lang.ClassNotFoundException:
> org.mortbay.jetty.servlet.Context
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1698)
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1544)
> org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:174)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
>
> org.apache.hadoop.crypto.key.kms.server.KMSMDCFilter.doFilter(KMSMDCFilter.java:84)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:636)
>
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:304)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:588)
>
> org.apache.hadoop.crypto.key.kms.server.KMSAuthenticationFilter.doFilter(KMSAuthenticationFilter.java:129)
> {noformat}
> I tried out branch-2.6 and it seems to be okay, so something changed between
> 2.6.x and 2.8.x/branch-2
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067478#comment-16067478
]
Hadoop QA commented on HADOOP-14024:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 13m
14s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
1s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
27s{color} | {color:green} branch-2 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 6m
22s{color} | {color:green} branch-2 passed with JDK v1.8.0_131 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
17s{color} | {color:green} branch-2 passed with JDK v1.7.0_131 {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
24s{color} | {color:green} branch-2 passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
13s{color} | {color:green} branch-2 passed with JDK v1.8.0_131 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
14s{color} | {color:green} branch-2 passed with JDK v1.7.0_131 {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
22s{color} | {color:green} the patch passed with JDK v1.8.0_131 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 7m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m
41s{color} | {color:green} the patch passed with JDK v1.7.0_131 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 7m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
12s{color} | {color:green} the patch passed with JDK v1.8.0_131 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
14s{color} | {color:green} the patch passed with JDK v1.7.0_131 {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 1m
46s{color} | {color:green} hadoop-kms in the patch passed with JDK v1.7.0_131.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
23s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 56m 13s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:5e40efe |
| JIRA Issue | HADOOP-14024 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12874973/HADOOP-14024-branch-2.001.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit xml |
| uname | Linux 44300d1c4ebe 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31
14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | branch-2 / c5f43fe |
| Default Java | 1.7.0_131 |
| Multi-JDK versions | /usr/lib/jvm/java-8-oracle:1.8.0_131
/usr/lib/jvm/java-7-openjdk-amd64:1.7.0_131 |
| JDK v1.7.0_131 Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12655/testReport/ |
| modules | C: hadoop-common-project/hadoop-kms U:
hadoop-common-project/hadoop-kms |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12655/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL:
[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067323#comment-16067323
]
John Zhuge commented on HADOOP-14024:
-
Fixed after changing this section in JMXJsonServlet.java:
{code:java}
if (!HttpServer2.isStaticUserAndNoneAuthType(servletContext, request) &&
!isInstrumentationAccessAllowed(request, response)) {
{code}
to
{code:java}
if (!isInstrumentationAccessAllowed(request, response)) {
{code}
Somehow HADOOP-13707 introduced the dependency on jetty indirectly via
hadoop-common's {{HttpServer2.isStaticUserAndNoneAuthType}} but
hadoop-kms/pom.xml has jetty shaded from hadoop-common.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL: https://issues.apache.org/jira/browse/HADOOP-14024
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 2.8.0
>Reporter: Andrew Wang
>Assignee: John Zhuge
>Priority: Critical
>
> Throws like this:
> {noformat}
> root cause java.lang.ClassNotFoundException:
> org.mortbay.jetty.servlet.Context
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1698)
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1544)
> org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:174)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
>
> org.apache.hadoop.crypto.key.kms.server.KMSMDCFilter.doFilter(KMSMDCFilter.java:84)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:636)
>
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:304)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:588)
>
> org.apache.hadoop.crypto.key.kms.server.KMSAuthenticationFilter.doFilter(KMSAuthenticationFilter.java:129)
> {noformat}
> I tried out branch-2.6 and it seems to be okay, so something changed between
> 2.6.x and 2.8.x/branch-2
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839063#comment-15839063
]
Xiao Chen commented on HADOOP-14024:
bq. This looks the same as HADOOP-13872.
Not exactly, because that jira allegedly only affecting 3.0, and with
HADOOP-13597 that's be taken care of.
Here the problem is on branch-2, so needs investigation.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL: https://issues.apache.org/jira/browse/HADOOP-14024
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 2.8.0
>Reporter: Andrew Wang
>Priority: Critical
>
> Throws like this:
> {noformat}
> root cause java.lang.ClassNotFoundException:
> org.mortbay.jetty.servlet.Context
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1698)
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1544)
> org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:174)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
>
> org.apache.hadoop.crypto.key.kms.server.KMSMDCFilter.doFilter(KMSMDCFilter.java:84)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:636)
>
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:304)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:588)
>
> org.apache.hadoop.crypto.key.kms.server.KMSAuthenticationFilter.doFilter(KMSAuthenticationFilter.java:129)
> {noformat}
> I tried out branch-2.6 and it seems to be okay, so something changed between
> 2.6.x and 2.8.x/branch-2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838954#comment-15838954
]
John Zhuge commented on HADOOP-14024:
-
This looks the same as HADOOP-13872.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL: https://issues.apache.org/jira/browse/HADOOP-14024
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 2.8.0
>Reporter: Andrew Wang
>Priority: Critical
>
> Throws like this:
> {noformat}
> root cause java.lang.ClassNotFoundException:
> org.mortbay.jetty.servlet.Context
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1698)
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1544)
> org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:174)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
>
> org.apache.hadoop.crypto.key.kms.server.KMSMDCFilter.doFilter(KMSMDCFilter.java:84)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:636)
>
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:304)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:588)
>
> org.apache.hadoop.crypto.key.kms.server.KMSAuthenticationFilter.doFilter(KMSAuthenticationFilter.java:129)
> {noformat}
> I tried out branch-2.6 and it seems to be okay, so something changed between
> 2.6.x and 2.8.x/branch-2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14024) KMS JMX endpoint throws ClassNotFoundException
[
https://issues.apache.org/jira/browse/HADOOP-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838806#comment-15838806
]
Andrew Wang commented on HADOOP-14024:
--
Works in branch-2.7 also, which narrows the diff.
> KMS JMX endpoint throws ClassNotFoundException
> --
>
> Key: HADOOP-14024
> URL: https://issues.apache.org/jira/browse/HADOOP-14024
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 2.8.0
>Reporter: Andrew Wang
>
> Throws like this:
> {noformat}
> root cause java.lang.ClassNotFoundException:
> org.mortbay.jetty.servlet.Context
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1698)
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1544)
> org.apache.hadoop.jmx.JMXJsonServlet.doGet(JMXJsonServlet.java:174)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
>
> org.apache.hadoop.crypto.key.kms.server.KMSMDCFilter.doFilter(KMSMDCFilter.java:84)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:636)
>
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:304)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:588)
>
> org.apache.hadoop.crypto.key.kms.server.KMSAuthenticationFilter.doFilter(KMSAuthenticationFilter.java:129)
> {noformat}
> I tried out branch-2.6 and it seems to be okay, so something changed between
> 2.6.x and 2.8.x/branch-2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
