[jira] [Created] (HADOOP-14350) Relative path for Kerberos keytab is not working on IBM JDK
Wen Yuan Chen created HADOOP-14350:
--
Summary: Relative path for Kerberos keytab is not working on IBM
JDK
Key: HADOOP-14350
URL: https://issues.apache.org/jira/browse/HADOOP-14350
Project: Hadoop Common
Issue Type: Bug
Components: common, security
Affects Versions: 2.7.3
Reporter: Wen Yuan Chen
Priority: Blocker
For the sample code below:
public class TestKrb {
public static void main(String[] args) throws IOException {
String user = args[0], path = args[1];
UserGroupInformation ugi =
UserGroupInformation.loginUserFromKeytabAndReturnUGI(user, path);
System.out.println("Login successfully");
}
}
When I use IBM JDK and pass a relative path for the Kerberos keytab, it will
throw error messages. According to the debug log, it always tries to read the
keytab from the root path. See the debug logs below:
2017-04-19 02:29:13,982 DEBUG
[org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with
annotation @org.apache.hadoop.metrics2.annotation.Metric(about=,
sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful kerberos
logins and latency (milliseconds)], valueName=Time)
2017-04-19 02:29:13,990 DEBUG
[org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with
annotation @org.apache.hadoop.metrics2.annotation.Metric(about=,
sampleName=Ops, always=false, type=DEFAULT, value=[Rate of failed kerberos
logins and latency (milliseconds)], valueName=Time)
2017-04-19 02:29:13,991 DEBUG
[org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with
annotation @org.apache.hadoop.metrics2.annotation.Metric(about=,
sampleName=Ops, always=false, type=DEFAULT, value=[GetGroups], valueName=Time)
2017-04-19 02:29:13,992 DEBUG
[org.apache.hadoop.metrics2.impl.MetricsSystemImpl] - UgiMetrics, User and
group related metrics
[KRB_DBG_CFG] Config:main: Java config file:
/opt/ibm/java/jre/lib/security/krb5.conf
[KRB_DBG_CFG] Config:main: Loaded from Java config
2017-04-19 02:29:14,175 DEBUG [org.apache.hadoop.security.Groups] - Creating
new Groups object
2017-04-19 02:29:14,178 DEBUG [org.apache.hadoop.util.NativeCodeLoader] -
Trying to load the custom-built native-hadoop library...
2017-04-19 02:29:14,179 DEBUG [org.apache.hadoop.util.NativeCodeLoader] -
Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: hadoop
(Not found in java.library.path)
2017-04-19 02:29:14,179 DEBUG [org.apache.hadoop.util.NativeCodeLoader] -
java.library.path=/opt/ibm/java/jre/lib/amd64/compressedrefs:/opt/ibm/java/jre/lib/amd64:/usr/lib64:/usr/lib
2017-04-19 02:29:14,179 WARN [org.apache.hadoop.util.NativeCodeLoader] - Unable
to load native-hadoop library for your platform... using builtin-java classes
where applicable
2017-04-19 02:29:14,180 DEBUG
[org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback] - Falling
back to shell based
2017-04-19 02:29:14,180 DEBUG
[org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback] - Group
mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
2017-04-19 02:29:14,334 DEBUG [org.apache.hadoop.util.Shell] - setsid exited
with exit code 0
2017-04-19 02:29:14,334 DEBUG [org.apache.hadoop.security.Groups] - Group
mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
cacheTimeout=30; warningDeltaMs=5000
IBMJGSSProvider Build-Level: -20161128
[JGSS_DBG_CRED] main JAAS config: principal=job/analytics
[JGSS_DBG_CRED] main JAAS config: credsType=initiate and accept
[JGSS_DBG_CRED] main config: useDefaultCcache=false
[JGSS_DBG_CRED] main config: useCcache=null
[JGSS_DBG_CRED] main config: useDefaultKeytab=false
[JGSS_DBG_CRED] main config: useKeytab=//job.keytab
[JGSS_DBG_CRED] main JAAS config: forwardable=false (default)
[JGSS_DBG_CRED] main JAAS config: renewable=false (default)
[JGSS_DBG_CRED] main JAAS config: proxiable=false (default)
[JGSS_DBG_CRED] main JAAS config: tryFirstPass=false (default)
[JGSS_DBG_CRED] main JAAS config: useFirstPass=false (default)
[JGSS_DBG_CRED] main JAAS config: moduleBanner=false (default)
[JGSS_DBG_CRED] main JAAS config: interactive login? no
[JGSS_DBG_CRED] main JAAS config: refreshKrb5Config = true
[KRB_DBG_CFG] Config:main: Java config file:
/opt/ibm/java/jre/lib/security/krb5.conf
[KRB_DBG_CFG] Config:main: Loaded from Java config
[KRB_DBG_KDC] KdcComm:main: >>> KdcAccessibility: reset
[KRB_DBG_KDC] KdcComm:main: >>> KdcAccessibility: reset
[JGSS_DBG_CRED] main Try keytab for principal=job/analytics
[KRB
[jira] [Resolved] (HADOOP-9994) Incorrect ANT_HOME references in build.xml in branch-1
[
https://issues.apache.org/jira/browse/HADOOP-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haohui Mai resolved HADOOP-9994.
Resolution: Won't Fix
> Incorrect ANT_HOME references in build.xml in branch-1
> --
>
> Key: HADOOP-9994
> URL: https://issues.apache.org/jira/browse/HADOOP-9994
> Project: Hadoop Common
> Issue Type: Bug
>Affects Versions: 1.2.1
>Reporter: Haohui Mai
>Assignee: Haohui Mai
>Priority: Minor
> Attachments: HDFS-5261.000.patch
>
>
> In branch-1, {code}ant eclipse{code} reads build.xml and generates eclipse
> projects.
> However, the reference of ANT_HOME is incorrect therefore ant fails to
> generate a working eclipse project out-of-the-box.
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14349) Rename ADLS CONTRACT_ENABLE_KEY
Mingliang Liu created HADOOP-14349: -- Summary: Rename ADLS CONTRACT_ENABLE_KEY Key: HADOOP-14349 URL: https://issues.apache.org/jira/browse/HADOOP-14349 Project: Hadoop Common Issue Type: Sub-task Components: fs/adl Affects Versions: 2.8.0 Reporter: Mingliang Liu dfs.adl.test.contract.enable -> fs.adl.test.contract.enable -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [jira] [Created] (HADOOP-12607) wrong pid dir results in cat error messages during stop
unsubscribe On Mon, Nov 30, 2015 at 7:49 AM, Allen Wittenauer (JIRA) wrote: > Allen Wittenauer created HADOOP-12607: > - > > Summary: wrong pid dir results in cat error messages during > stop > Key: HADOOP-12607 > URL: https://issues.apache.org/jira/browse/HADOOP-12607 > Project: Hadoop Common > Issue Type: Bug > Components: scripts > Affects Versions: 3.0.0 > Reporter: Allen Wittenauer > Priority: Minor > > > If the wrong pid dir is configured (via wrong HADOOP_CONF_DIR, or > whatever), scripts throw cat errors. We should do something more > human-friendly there. Also keep in mind that it shouldn't be a fatal exit > since the daemon may also not be started. > > > > -- > This message was sent by Atlassian JIRA > (v6.3.4#6332) >
[jira] [Resolved] (HADOOP-12607) wrong pid dir results in cat error messages during stop
[ https://issues.apache.org/jira/browse/HADOOP-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12607. --- Resolution: Cannot Reproduce > wrong pid dir results in cat error messages during stop > --- > > Key: HADOOP-12607 > URL: https://issues.apache.org/jira/browse/HADOOP-12607 > Project: Hadoop Common > Issue Type: Bug > Components: scripts >Affects Versions: 3.0.0-alpha1 >Reporter: Allen Wittenauer >Priority: Minor > > If the wrong pid dir is configured (via wrong HADOOP_CONF_DIR, or whatever), > scripts throw cat errors. We should do something more human-friendly there. > Also keep in mind that it shouldn't be a fatal exit since the daemon may also > not be started. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-6501) RawLocalFileSystem.mkdirs does not throw IOException when it should?
[
https://issues.apache.org/jira/browse/HADOOP-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andras Bokor resolved HADOOP-6501.
--
Resolution: Duplicate
Fixed by HADOOP-6229.
> RawLocalFileSystem.mkdirs does not throw IOException when it should?
>
>
> Key: HADOOP-6501
> URL: https://issues.apache.org/jira/browse/HADOOP-6501
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
>Affects Versions: 0.20.1
> Environment: Fedora, Java 1.6.0_17, hadoop 20.1
>Reporter: robert Cook
>Assignee: Andras Bokor
>Priority: Minor
>
> public boolean mkdirs(Path f) throws IOException {
> Path parent = f.getParent();
> File p2f = pathToFile(f);
> return (parent == null || mkdirs(parent)) &&
> (p2f.mkdir() || p2f.isDirectory());
> }
> none of the methods called throw IOException
> yet FileSystemContract
> BaseTest.testMkdirsFailsForSubdirectoryOfExistingFile fails
> createFile(path("/test/hadoop/file"));
> Path testSubDir = path("/test/hadoop/file/subdir");
> try {
> fs.mkdirs(testSubDir);//<-returns false instead of throwing
> exception
> fail("Should throw IOException.");
> } catch (IOException e) {
> // expected
> }
> --
> further UNIX mkdir operates on a path argument. why does hadoop mkdir
> create directories in the path one at a time???
> NOTE that a permission or other failure leaves a garbage partially-completed
> path in the current hadoop impl.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: HADOOP-14316: Switching from Findbugs to Spotbugs
unsubscribe On Wed, Apr 19, 2017 at 10:44 AM, Allen Wittenauer wrote: > Hey gang. > > HADOOP-14316 enables the spotbugs back-end for the findbugs > front-end. Spotbugs (https://spotbugs.github.io/) is the fork of > findbugs that the community and some of the major contributors have made to > move findbugs forward. It is geared towards JDK8 and JDK9. > > Before I commit, I wanted to give a heads up to the community > about this change. > > After committal, there will be (approx) 62 new findbugs issues > that will pop up in the source tree. My quick pass over a handful of them > indicates that a good number are legit/not false positives (and one of > them, well, we got lucky it's an API that no one updates/uses). It will > take the community to fix up those 62 problems, either by actually fixing > them (better) or exempting them (not great, but sometimes required). > > Thanks. > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >
