[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null realm name (601)
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710345#comment-16710345
]
Eric Yang commented on HADOOP-15966:
[~ste...@apache.org] The patch is fine. I am more concerned about the
recommendation description in this JIRA that the realm can be defined in
HADOOP_CLIENT_OPTS, which is misleading. The realm is better applied to
HADOOP_OPTS to ensure client and server have the same coverage, if someone
chose to build a cluster out of Mac.
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null
> realm name (601)
> ---
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Fix For: 3.0.4, 3.2.1, 3.1.3
>
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null realm name (601)
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710027#comment-16710027
]
Steve Loughran commented on HADOOP-15966:
-
Pulling the JVM settings out stops it saying "no realm". If there's some
multi-realm thing, we're in a deep world of pain, aren't we?
Bear in mind this is macos only, so isn't going to have any impact on servers
at all, not unless you've built a cluster out of mac minis
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null
> realm name (601)
> ---
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Fix For: 3.0.4, 3.2.1, 3.1.3
>
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null realm name (601)
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709268#comment-16709268
]
Eric Yang commented on HADOOP-15966:
[~ste...@apache.org] Hadoop server side should dictate which realm to
authenticate. Instead of recommending in HADOOP_CLIENT_OPTS, the
recommendation should be in HADOOP_*_OPTS, I think.
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null
> realm name (601)
> ---
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Fix For: 3.0.4, 3.2.1, 3.1.3
>
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null realm name (601)
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709209#comment-16709209
]
Lars Francke commented on HADOOP-15966:
---
Thanks [~ste...@apache.org] you beat me to it!
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null
> realm name (601)
> ---
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Fix For: 3.0.4, 3.2.1, 3.1.3
>
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null realm name (601)
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708911#comment-16708911
]
Hudson commented on HADOOP-15966:
-
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15557 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/15557/])
HADOOP-15966. Hadoop Kerberos broken on macos as (stevel: rev
db2d8b01c65fdff3acf83b4c4f0a79fe48270487)
* (edit) hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null
> realm name (601)
> ---
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Fix For: 3.0.4, 3.2.1, 3.1.3
>
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null realm name (601)
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708896#comment-16708896
]
Steve Loughran commented on HADOOP-15966:
-
And a bit of a stack for searches; HOST1 is the host in question.
Note how there's not a chance of recovery but the retry logic doesn't recognise
this.
IllegalArgumentExceptions need to uprated to unrecoverable errors
{code}
2018-12-04 15:32:30,173 [main] INFO retry.RetryInvocationHandler
(RetryInvocationHandler.java:log(411)) - java.io.IOException: DestHost:destPort
HOST1:8020 , LocalHost:localPort HW13176.local/192.168.99.1:0. Failed on local
exception: java.io.IOException: Couldn't set up IO streams:
java.lang.IllegalArgumentException: Null realm name (601), while invoking
ClientNamenodeProtocolTranslatorPB.getFileInfo over HOST1/172.27.15.4:8020
after 1 failover attempts. Trying to failover after sleeping for 1316ms.
2018-12-04 15:32:31,850 [main] INFO retry.RetryInvocationHandler
(RetryInvocationHandler.java:log(411)) - java.io.IOExcepti
{code}
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset: Null
> realm name (601)
> ---
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Fix For: 3.0.4, 3.2.1, 3.1.3
>
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707645#comment-16707645
]
Larry McCay commented on HADOOP-15966:
--
Lack of tests doesn't seem like it should be an issue for this.
+1
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset
>
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15966) Hadoop Kerberos broken on macos as java.security.krb5.realm is reset
[
https://issues.apache.org/jira/browse/HADOOP-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707531#comment-16707531
]
Hadoop QA commented on HADOOP-15966:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
15s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 21m
25s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
11s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 36s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} shellcheck {color} | {color:green} 0m
0s{color} | {color:green} There were no new shellcheck issues. {color} |
| {color:green}+1{color} | {color:green} shelldocs {color} | {color:green} 0m
14s{color} | {color:green} There were no new shelldocs issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 45s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
23s{color} | {color:green} hadoop-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
28s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 54m 50s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:8f97d6f |
| JIRA Issue | HADOOP-15966 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12950420/HADOOP-15966-001.patch
|
| Optional Tests | dupname asflicense mvnsite unit shellcheck shelldocs |
| uname | Linux 6f6cfe138561 4.4.0-134-generic #160~14.04.1-Ubuntu SMP Fri Aug
17 11:07:07 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 3044b78 |
| maven | version: Apache Maven 3.3.9 |
| shellcheck | v0.4.6 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/15596/testReport/ |
| Max. process+thread count | 336 (vs. ulimit of 1) |
| modules | C: hadoop-common-project/hadoop-common U:
hadoop-common-project/hadoop-common |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/15596/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Hadoop Kerberos broken on macos as java.security.krb5.realm is reset
>
>
> Key: HADOOP-15966
> URL: https://issues.apache.org/jira/browse/HADOOP-15966
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
>Affects Versions: 3.0.3
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Major
> Attachments: HADOOP-15966-001.patch
>
>
> HADOOP-8719 may have been valid at some point, but since then the world has
> moved on
> * nobody should be using Hadoop without Kerberos
> * kerberos support on java 8 + macos works just fine
> The clause to reset the java system properties is enough to stop kerberos
> working, even
> when the user is kinited in.
> Propose: remove/revert the changes. If people want it, they can set the
> options in {{HADOOP_CLIENT_OPTS}}
--
This
