[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Fix Version/s: (was: 2.2.0) Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Status: Patch Available (was: Open) Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 2.2.0 Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Affects Version/s: 2.0.0-alpha Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[
https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791296#comment-13791296
]
Hadoop QA commented on HADOOP-10029:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607702/HADOOP-10029.3.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:red}-1 javac{color}. The applied patch generated 1535 javac
compiler warnings (more than the trunk's current 1525 warnings).
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3198//testReport/
Javac warnings:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3198//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3198//console
This message is automatically generated.
Specifying har file to MR job fails in secure cluster
-
Key: HADOOP-10029
URL: https://issues.apache.org/jira/browse/HADOOP-10029
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0-alpha
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch,
HADOOP-10029.3.patch, HADOOP-10029.patch
This is an issue found by [~rramya]. See the exception stack trace in the
following comment.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-9897) Add method to get path start position without drive specifier in o.a.h.fs.Path
[
https://issues.apache.org/jira/browse/HADOOP-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791328#comment-13791328
]
Binglin Chang commented on HADOOP-9897:
---
Hi [~cnauroth],
Could you help review the patch again and get this committed? Thanks.
Add method to get path start position without drive specifier in
o.a.h.fs.Path
Key: HADOOP-9897
URL: https://issues.apache.org/jira/browse/HADOOP-9897
Project: Hadoop Common
Issue Type: Improvement
Reporter: Binglin Chang
Assignee: Binglin Chang
Priority: Trivial
Attachments: HADOOP-9897.v1.patch, HADOOP-9897.v2.patch,
HADOOP-9897.v2.patch
There are a lot of code in Path to get start position after skipping drive
specifier, like:
{code}
int start = hasWindowsDrive(uri.getPath()) ? 3 : 0;
{code}
Also there is a minor bug in mergePaths:
mergePath(/, /foo) will yield Path(//foo) which will be parsed as uri
authority, not path.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10031) FsShell -get/copyToLocal/moveFromLocal should support Windows local path
[ https://issues.apache.org/jira/browse/HADOOP-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791387#comment-13791387 ] Hudson commented on HADOOP-10031: - SUCCESS: Integrated in Hadoop-Yarn-trunk #358 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/358/]) HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu. (cnauroth: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1530823) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java FsShell -get/copyToLocal/moveFromLocal should support Windows local path Key: HADOOP-10031 URL: https://issues.apache.org/jira/browse/HADOOP-10031 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0, 2.2.0 Reporter: Chuan Liu Assignee: Chuan Liu Fix For: 3.0.0, 2.2.1 Attachments: HADOOP-10031.1.patch, HADOOP-10031.patch In current trunk code, running 'hadoop fs -get /hdfs/path c:\windows\path' will lead to an error put: unexpected URISyntaxException. This is a regression to the 1.0 fs shell commands. FsShell get, copyToLocal, and moveFromLocal should support Windows local path formats as localSrc argument to the two commands. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-9470) eliminate duplicate FQN tests in different Hadoop modules
[ https://issues.apache.org/jira/browse/HADOOP-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791382#comment-13791382 ] Hudson commented on HADOOP-9470: SUCCESS: Integrated in Hadoop-Yarn-trunk #358 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/358/]) HADOOP-9470. eliminate duplicate FQN tests in different Hadoop modules (Ivan A. Veselovsky via daryn) (daryn: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1530667) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestHdfsTextCommand.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestTextCommand.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestMRCJCSocketFactory.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestSocketFactory.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobClient.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobConf.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCJobClient.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCJobConf.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestMRCJCFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/output/TestFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/output/TestMRCJCFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestMRCJCReflectionUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestMRCJCRunJar.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestReflectionUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestRunJar.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestRPCFactories.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestRecordFactory.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestYSCRPCFactories.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestYSCRecordFactory.java eliminate duplicate FQN tests in different Hadoop modules - Key: HADOOP-9470 URL: https://issues.apache.org/jira/browse/HADOOP-9470 Project: Hadoop Common Issue Type: Improvement Affects Versions: 3.0.0, 2.3.0 Reporter: Ivan A. Veselovsky
[jira] [Commented] (HADOOP-9470) eliminate duplicate FQN tests in different Hadoop modules
[ https://issues.apache.org/jira/browse/HADOOP-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791483#comment-13791483 ] Hudson commented on HADOOP-9470: FAILURE: Integrated in Hadoop-Hdfs-trunk #1548 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1548/]) HADOOP-9470. eliminate duplicate FQN tests in different Hadoop modules (Ivan A. Veselovsky via daryn) (daryn: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1530667) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestHdfsTextCommand.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestTextCommand.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestMRCJCSocketFactory.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestSocketFactory.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobClient.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobConf.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCJobClient.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCJobConf.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestMRCJCFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/output/TestFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/output/TestMRCJCFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestMRCJCReflectionUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestMRCJCRunJar.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestReflectionUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestRunJar.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestRPCFactories.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestRecordFactory.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestYSCRPCFactories.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestYSCRecordFactory.java eliminate duplicate FQN tests in different Hadoop modules - Key: HADOOP-9470 URL: https://issues.apache.org/jira/browse/HADOOP-9470 Project: Hadoop Common Issue Type: Improvement Affects Versions: 3.0.0, 2.3.0 Reporter: Ivan A. Veselovsky
[jira] [Commented] (HADOOP-10031) FsShell -get/copyToLocal/moveFromLocal should support Windows local path
[ https://issues.apache.org/jira/browse/HADOOP-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791488#comment-13791488 ] Hudson commented on HADOOP-10031: - FAILURE: Integrated in Hadoop-Hdfs-trunk #1548 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1548/]) HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu. (cnauroth: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1530823) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java FsShell -get/copyToLocal/moveFromLocal should support Windows local path Key: HADOOP-10031 URL: https://issues.apache.org/jira/browse/HADOOP-10031 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0, 2.2.0 Reporter: Chuan Liu Assignee: Chuan Liu Fix For: 3.0.0, 2.2.1 Attachments: HADOOP-10031.1.patch, HADOOP-10031.patch In current trunk code, running 'hadoop fs -get /hdfs/path c:\windows\path' will lead to an error put: unexpected URISyntaxException. This is a regression to the 1.0 fs shell commands. FsShell get, copyToLocal, and moveFromLocal should support Windows local path formats as localSrc argument to the two commands. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-9059) hadoop-daemons.sh script constraint that all the nodes should use the same installation path.
[
https://issues.apache.org/jira/browse/HADOOP-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791497#comment-13791497
]
Vivek Ganesan commented on HADOOP-9059:
---
I would like to take up and work on this bug. Can someone please assign this
JIRA to me?
hadoop-daemons.sh script constraint that all the nodes should use the same
installation path.
-
Key: HADOOP-9059
URL: https://issues.apache.org/jira/browse/HADOOP-9059
Project: Hadoop Common
Issue Type: Bug
Components: bin
Affects Versions: 1.0.4
Environment: Linux
Reporter: Chunliang Lu
Priority: Critical
Original Estimate: 25h
Remaining Estimate: 25h
To run command on all slave hosts, the bin/hadoop-daemons.sh will call the
bin/slaves.sh at last line:
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@
{code}
where slaves.sh will call ssh and pass the `cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@` part to the slaves.
In bash, the $HADOOP_HOME $bin, and $HADOOP_CONF_DIR will be replaced as
current settings on the master, which means that this constraints that all
the slave nodes need to share the same path setting as master node. This is
not reasonable. In my setting, the cluster has a shared NFS, and I would like
to use different configuration files for different machines. I know this is
not a recommended way to manage clusters, but I just have no choice. I think
other people may face the same problem. How about replace it like following
and allow different configuration for master and slaves?
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd '$HADOOP_PREFIX' \;
bin/hadoop-daemon.sh $@
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HADOOP-9059) hadoop-daemons.sh script constraint that all the nodes should use the same installation path.
[
https://issues.apache.org/jira/browse/HADOOP-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uma Maheswara Rao G updated HADOOP-9059:
Assignee: Chunliang Lu
hadoop-daemons.sh script constraint that all the nodes should use the same
installation path.
-
Key: HADOOP-9059
URL: https://issues.apache.org/jira/browse/HADOOP-9059
Project: Hadoop Common
Issue Type: Bug
Components: bin
Affects Versions: 1.0.4
Environment: Linux
Reporter: Chunliang Lu
Assignee: Chunliang Lu
Priority: Critical
Original Estimate: 25h
Remaining Estimate: 25h
To run command on all slave hosts, the bin/hadoop-daemons.sh will call the
bin/slaves.sh at last line:
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@
{code}
where slaves.sh will call ssh and pass the `cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@` part to the slaves.
In bash, the $HADOOP_HOME $bin, and $HADOOP_CONF_DIR will be replaced as
current settings on the master, which means that this constraints that all
the slave nodes need to share the same path setting as master node. This is
not reasonable. In my setting, the cluster has a shared NFS, and I would like
to use different configuration files for different machines. I know this is
not a recommended way to manage clusters, but I just have no choice. I think
other people may face the same problem. How about replace it like following
and allow different configuration for master and slaves?
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd '$HADOOP_PREFIX' \;
bin/hadoop-daemon.sh $@
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HADOOP-9059) hadoop-daemons.sh script constraint that all the nodes should use the same installation path.
[
https://issues.apache.org/jira/browse/HADOOP-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uma Maheswara Rao G updated HADOOP-9059:
Assignee: Vivek Ganesan (was: Chunliang Lu)
hadoop-daemons.sh script constraint that all the nodes should use the same
installation path.
-
Key: HADOOP-9059
URL: https://issues.apache.org/jira/browse/HADOOP-9059
Project: Hadoop Common
Issue Type: Bug
Components: bin
Affects Versions: 1.0.4
Environment: Linux
Reporter: Chunliang Lu
Assignee: Vivek Ganesan
Priority: Critical
Original Estimate: 25h
Remaining Estimate: 25h
To run command on all slave hosts, the bin/hadoop-daemons.sh will call the
bin/slaves.sh at last line:
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@
{code}
where slaves.sh will call ssh and pass the `cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@` part to the slaves.
In bash, the $HADOOP_HOME $bin, and $HADOOP_CONF_DIR will be replaced as
current settings on the master, which means that this constraints that all
the slave nodes need to share the same path setting as master node. This is
not reasonable. In my setting, the cluster has a shared NFS, and I would like
to use different configuration files for different machines. I know this is
not a recommended way to manage clusters, but I just have no choice. I think
other people may face the same problem. How about replace it like following
and allow different configuration for master and slaves?
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd '$HADOOP_PREFIX' \;
bin/hadoop-daemon.sh $@
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-9059) hadoop-daemons.sh script constraint that all the nodes should use the same installation path.
[
https://issues.apache.org/jira/browse/HADOOP-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791507#comment-13791507
]
Uma Maheswara Rao G commented on HADOOP-9059:
-
I have assigned this JIRA to you.
hadoop-daemons.sh script constraint that all the nodes should use the same
installation path.
-
Key: HADOOP-9059
URL: https://issues.apache.org/jira/browse/HADOOP-9059
Project: Hadoop Common
Issue Type: Bug
Components: bin
Affects Versions: 1.0.4
Environment: Linux
Reporter: Chunliang Lu
Assignee: Vivek Ganesan
Priority: Critical
Original Estimate: 25h
Remaining Estimate: 25h
To run command on all slave hosts, the bin/hadoop-daemons.sh will call the
bin/slaves.sh at last line:
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@
{code}
where slaves.sh will call ssh and pass the `cd $HADOOP_HOME \;
$bin/hadoop-daemon.sh --config $HADOOP_CONF_DIR $@` part to the slaves.
In bash, the $HADOOP_HOME $bin, and $HADOOP_CONF_DIR will be replaced as
current settings on the master, which means that this constraints that all
the slave nodes need to share the same path setting as master node. This is
not reasonable. In my setting, the cluster has a shared NFS, and I would like
to use different configuration files for different machines. I know this is
not a recommended way to manage clusters, but I just have no choice. I think
other people may face the same problem. How about replace it like following
and allow different configuration for master and slaves?
{code}
exec $bin/slaves.sh --config $HADOOP_CONF_DIR cd '$HADOOP_PREFIX' \;
bin/hadoop-daemon.sh $@
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-9470) eliminate duplicate FQN tests in different Hadoop modules
[ https://issues.apache.org/jira/browse/HADOOP-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791523#comment-13791523 ] Hudson commented on HADOOP-9470: FAILURE: Integrated in Hadoop-Mapreduce-trunk #1574 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1574/]) HADOOP-9470. eliminate duplicate FQN tests in different Hadoop modules (Ivan A. Veselovsky via daryn) (daryn: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1530667) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestHdfsTextCommand.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestTextCommand.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestMRCJCSocketFactory.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestSocketFactory.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobClient.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobConf.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCJobClient.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMRCJCJobConf.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestMRCJCFileInputFormat.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/output/TestFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/output/TestMRCJCFileOutputCommitter.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestMRCJCReflectionUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestMRCJCRunJar.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestReflectionUtils.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/util/TestRunJar.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestRPCFactories.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestRecordFactory.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestYSCRPCFactories.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/TestYSCRecordFactory.java eliminate duplicate FQN tests in different Hadoop modules - Key: HADOOP-9470 URL: https://issues.apache.org/jira/browse/HADOOP-9470 Project: Hadoop Common Issue Type: Improvement Affects Versions: 3.0.0, 2.3.0 Reporter: Ivan A.
[jira] [Commented] (HADOOP-10031) FsShell -get/copyToLocal/moveFromLocal should support Windows local path
[ https://issues.apache.org/jira/browse/HADOOP-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791528#comment-13791528 ] Hudson commented on HADOOP-10031: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1574 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1574/]) HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu. (cnauroth: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1530823) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java FsShell -get/copyToLocal/moveFromLocal should support Windows local path Key: HADOOP-10031 URL: https://issues.apache.org/jira/browse/HADOOP-10031 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0, 2.2.0 Reporter: Chuan Liu Assignee: Chuan Liu Fix For: 3.0.0, 2.2.1 Attachments: HADOOP-10031.1.patch, HADOOP-10031.patch In current trunk code, running 'hadoop fs -get /hdfs/path c:\windows\path' will lead to an error put: unexpected URISyntaxException. This is a regression to the 1.0 fs shell commands. FsShell get, copyToLocal, and moveFromLocal should support Windows local path formats as localSrc argument to the two commands. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791670#comment-13791670 ] Sanjay Radia commented on HADOOP-10029: --- There are compiler warnings. Otherwise +1. Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HADOOP-10029: -- Attachment: HADOOP-10029.4.patch Updated patch that adds suppress warning for deprecation Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.4.patch The javac warnings are due to use of deprecated methods. I have @SuppressWarnings annotation to suppress the warnings. Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[
https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791723#comment-13791723
]
Hadoop QA commented on HADOOP-10029:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607837/HADOOP-10029.4.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:red}-1 javac{color}. The applied patch generated 1529 javac
compiler warnings (more than the trunk's current 1525 warnings).
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common:
org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3199//testReport/
Javac warnings:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3199//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3199//console
This message is automatically generated.
Specifying har file to MR job fails in secure cluster
-
Key: HADOOP-10029
URL: https://issues.apache.org/jira/browse/HADOOP-10029
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0-alpha
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch,
HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch,
HADOOP-10029.patch
This is an issue found by [~rramya]. See the exception stack trace in the
following comment.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[
https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791732#comment-13791732
]
Hadoop QA commented on HADOOP-10029:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607838/HADOOP-10029.4.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:red}-1 javac{color}. The applied patch generated 1535 javac
compiler warnings (more than the trunk's current 1525 warnings).
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3200//testReport/
Javac warnings:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3200//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3200//console
This message is automatically generated.
Specifying har file to MR job fails in secure cluster
-
Key: HADOOP-10029
URL: https://issues.apache.org/jira/browse/HADOOP-10029
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0-alpha
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch,
HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch,
HADOOP-10029.patch
This is an issue found by [~rramya]. See the exception stack trace in the
following comment.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791925#comment-13791925
]
Colin Patrick McCabe commented on HADOOP-10035:
---
Looks good overall. Since the {{DoNotCheck}} class now represents the
functions which {{FilterFileSystem}} must not implement, rather than functions
which are not checked, should it be named {{MustNotImplement}} or similar?
Cleanup TestFilterFileSystem
Key: HADOOP-10035
URL: https://issues.apache.org/jira/browse/HADOOP-10035
Project: Hadoop Common
Issue Type: Improvement
Affects Versions: 2.1.1-beta
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10035.patch
Currently TestFilterFileSystem only checks for FileSystem methods that must
be implemented in FilterFileSystem with a list of methods that are exception
to this rule. This jira wants to make this check stricter by adding a test
for ensuring the methods in exception rule list must not be implemented by
the FilterFileSystem.
This also cleans up the current class that has methods from exception rule
list to interface to avoid having to provide dummy implementation of the
methods.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.5.patch Updated patch. For some reason @SuppressWarnings for deprecation is not working for TestHarFileSystem. I removed explicitly declaring the deprecated AccessControlException in the interface to work around it. Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, HADOOP-10029.5.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791943#comment-13791943 ] Suresh Srinivas commented on HADOOP-10035: -- Seems reasonable. Let me update the patch. Cleanup TestFilterFileSystem Key: HADOOP-10035 URL: https://issues.apache.org/jira/browse/HADOOP-10035 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.1.1-beta Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10035.patch Currently TestFilterFileSystem only checks for FileSystem methods that must be implemented in FilterFileSystem with a list of methods that are exception to this rule. This jira wants to make this check stricter by adding a test for ensuring the methods in exception rule list must not be implemented by the FilterFileSystem. This also cleans up the current class that has methods from exception rule list to interface to avoid having to provide dummy implementation of the methods. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791944#comment-13791944 ] Suresh Srinivas commented on HADOOP-10035: -- I also will do the same change in HADOOP-10029. Cleanup TestFilterFileSystem Key: HADOOP-10035 URL: https://issues.apache.org/jira/browse/HADOOP-10035 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.1.1-beta Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10035.patch Currently TestFilterFileSystem only checks for FileSystem methods that must be implemented in FilterFileSystem with a list of methods that are exception to this rule. This jira wants to make this check stricter by adding a test for ensuring the methods in exception rule list must not be implemented by the FilterFileSystem. This also cleans up the current class that has methods from exception rule list to interface to avoid having to provide dummy implementation of the methods. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.6.patch Renamed the interface DoNoCheck to MustNotImplement. Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10035) Cleanup TestFilterFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10035: - Attachment: HADOOP-10035.1.patch Updated patch to address the comments. Cleanup TestFilterFileSystem Key: HADOOP-10035 URL: https://issues.apache.org/jira/browse/HADOOP-10035 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.1.1-beta Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10035.1.patch, HADOOP-10035.patch Currently TestFilterFileSystem only checks for FileSystem methods that must be implemented in FilterFileSystem with a list of methods that are exception to this rule. This jira wants to make this check stricter by adding a test for ensuring the methods in exception rule list must not be implemented by the FilterFileSystem. This also cleans up the current class that has methods from exception rule list to interface to avoid having to provide dummy implementation of the methods. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10031) FsShell -get/copyToLocal/moveFromLocal should support Windows local path
[ https://issues.apache.org/jira/browse/HADOOP-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-10031: --- Resolution: Fixed Status: Resolved (was: Patch Available) FsShell -get/copyToLocal/moveFromLocal should support Windows local path Key: HADOOP-10031 URL: https://issues.apache.org/jira/browse/HADOOP-10031 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 3.0.0, 2.2.0 Reporter: Chuan Liu Assignee: Chuan Liu Fix For: 3.0.0, 2.2.1 Attachments: HADOOP-10031.1.patch, HADOOP-10031.patch In current trunk code, running 'hadoop fs -get /hdfs/path c:\windows\path' will lead to an error put: unexpected URISyntaxException. This is a regression to the 1.0 fs shell commands. FsShell get, copyToLocal, and moveFromLocal should support Windows local path formats as localSrc argument to the two commands. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[
https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791967#comment-13791967
]
Hadoop QA commented on HADOOP-10029:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607875/HADOOP-10029.5.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3201//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3201//console
This message is automatically generated.
Specifying har file to MR job fails in secure cluster
-
Key: HADOOP-10029
URL: https://issues.apache.org/jira/browse/HADOOP-10029
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0-alpha
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch,
HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch,
HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch
This is an issue found by [~rramya]. See the exception stack trace in the
following comment.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791972#comment-13791972
]
Hadoop QA commented on HADOOP-10035:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607880/HADOOP-10035.1.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3202//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3202//console
This message is automatically generated.
Cleanup TestFilterFileSystem
Key: HADOOP-10035
URL: https://issues.apache.org/jira/browse/HADOOP-10035
Project: Hadoop Common
Issue Type: Improvement
Affects Versions: 2.1.1-beta
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10035.1.patch, HADOOP-10035.patch
Currently TestFilterFileSystem only checks for FileSystem methods that must
be implemented in FilterFileSystem with a list of methods that are exception
to this rule. This jira wants to make this check stricter by adding a test
for ensuring the methods in exception rule list must not be implemented by
the FilterFileSystem.
This also cleans up the current class that has methods from exception rule
list to interface to avoid having to provide dummy implementation of the
methods.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[
https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791975#comment-13791975
]
Hadoop QA commented on HADOOP-10029:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607879/HADOOP-10029.6.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3203//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3203//console
This message is automatically generated.
Specifying har file to MR job fails in secure cluster
-
Key: HADOOP-10029
URL: https://issues.apache.org/jira/browse/HADOOP-10029
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0-alpha
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch,
HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch,
HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch
This is an issue found by [~rramya]. See the exception stack trace in the
following comment.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791997#comment-13791997 ] Colin Patrick McCabe commented on HADOOP-10035: --- Looks like you have MustNoImplement rather than MustNotImplement. I assume that's a typo. +1 once that's addressed. Cleanup TestFilterFileSystem Key: HADOOP-10035 URL: https://issues.apache.org/jira/browse/HADOOP-10035 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.1.1-beta Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10035.1.patch, HADOOP-10035.patch Currently TestFilterFileSystem only checks for FileSystem methods that must be implemented in FilterFileSystem with a list of methods that are exception to this rule. This jira wants to make this check stricter by adding a test for ensuring the methods in exception rule list must not be implemented by the FilterFileSystem. This also cleans up the current class that has methods from exception rule list to interface to avoid having to provide dummy implementation of the methods. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791996#comment-13791996 ] Sanjay Radia commented on HADOOP-10029: --- +1 Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10035) Cleanup TestFilterFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10035: - Attachment: HADOOP-10035.2.patch Updated patch. Cleanup TestFilterFileSystem Key: HADOOP-10035 URL: https://issues.apache.org/jira/browse/HADOOP-10035 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.1.1-beta Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10035.1.patch, HADOOP-10035.2.patch, HADOOP-10035.patch Currently TestFilterFileSystem only checks for FileSystem methods that must be implemented in FilterFileSystem with a list of methods that are exception to this rule. This jira wants to make this check stricter by adding a test for ensuring the methods in exception rule list must not be implemented by the FilterFileSystem. This also cleans up the current class that has methods from exception rule list to interface to avoid having to provide dummy implementation of the methods. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792025#comment-13792025 ] Sanjay Radia commented on HADOOP-10035: --- In MUST not implement you should put the caps on NOT, not caps on MUST +1 Cleanup TestFilterFileSystem Key: HADOOP-10035 URL: https://issues.apache.org/jira/browse/HADOOP-10035 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.1.1-beta Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10035.1.patch, HADOOP-10035.2.patch, HADOOP-10035.patch Currently TestFilterFileSystem only checks for FileSystem methods that must be implemented in FilterFileSystem with a list of methods that are exception to this rule. This jira wants to make this check stricter by adding a test for ensuring the methods in exception rule list must not be implemented by the FilterFileSystem. This also cleans up the current class that has methods from exception rule list to interface to avoid having to provide dummy implementation of the methods. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792039#comment-13792039 ] Hudson commented on HADOOP-10029: - SUCCESS: Integrated in Hadoop-trunk-Commit #4580 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4580/]) HADOOP-10029. Specifying har file to MR job fails in secure cluster. Contributed by Suresh Srinivas. (suresh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1531125) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10035) Cleanup TestFilterFileSystem
[
https://issues.apache.org/jira/browse/HADOOP-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792057#comment-13792057
]
Hadoop QA commented on HADOOP-10035:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607893/HADOOP-10035.2.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3204//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3204//console
This message is automatically generated.
Cleanup TestFilterFileSystem
Key: HADOOP-10035
URL: https://issues.apache.org/jira/browse/HADOOP-10035
Project: Hadoop Common
Issue Type: Improvement
Affects Versions: 2.1.1-beta
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Attachments: HADOOP-10035.1.patch, HADOOP-10035.2.patch,
HADOOP-10035.patch
Currently TestFilterFileSystem only checks for FileSystem methods that must
be implemented in FilterFileSystem with a list of methods that are exception
to this rule. This jira wants to make this check stricter by adding a test
for ensuring the methods in exception rule list must not be implemented by
the FilterFileSystem.
This also cleans up the current class that has methods from exception rule
list to interface to avoid having to provide dummy implementation of the
methods.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Moved] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas moved HDFS-5340 to HADOOP-10039: Component/s: (was: security) security Key: HADOOP-10039 (was: HDFS-5340) Project: Hadoop Common (was: Hadoop HDFS) Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10039: - Affects Version/s: 2.0.0-alpha Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10039: - Target Version/s: 2.2.1 Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Assigned] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HADOOP-10039: --- Assignee: Haohui Mai Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Haohui Mai org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-10039: Attachment: HDFS-5340.000.patch Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Haohui Mai Attachments: HDFS-5340.000.patch org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-10039: Status: Patch Available (was: Open) Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Haohui Mai Attachments: HDFS-5340.000.patch org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Resolution: Fixed Fix Version/s: 2.2.1 Status: Resolved (was: Patch Available) I have committed the change to branch-2.2, branch-2 and trunk. [~sanjay.radia], thank you for the review. Specifying har file to MR job fails in secure cluster - Key: HADOOP-10029 URL: https://issues.apache.org/jira/browse/HADOOP-10029 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 2.2.1 Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch This is an issue found by [~rramya]. See the exception stack trace in the following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[
https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792151#comment-13792151
]
Hadoop QA commented on HADOOP-10039:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12607917/HDFS-5340.000.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3205//testReport/
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/3205//console
This message is automatically generated.
Add Hive to the list of projects using AbstractDelegationTokenSecretManager
---
Key: HADOOP-10039
URL: https://issues.apache.org/jira/browse/HADOOP-10039
Project: Hadoop Common
Issue Type: Bug
Components: security
Affects Versions: 2.0.0-alpha
Reporter: Suresh Srinivas
Assignee: Haohui Mai
Attachments: HDFS-5340.000.patch
org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends
AbstractDelegationTokenSecretManager. This should be captured in the
InterfaceAudience annotation of AbstractDelegationTokenSecretManager.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Created] (HADOOP-10040) hadoop.cmd in UNIX format and would not run by default on Windows
Yingda Chen created HADOOP-10040: Summary: hadoop.cmd in UNIX format and would not run by default on Windows Key: HADOOP-10040 URL: https://issues.apache.org/jira/browse/HADOOP-10040 Project: Hadoop Common Issue Type: Bug Reporter: Yingda Chen The hadoop.cmd currently checked in into hadoop-common is in UNIX format, same as most of other src files. However, the hadoop.cmd is meant to be used on Windows only, the fact that it is in UNIX format makes it unrunnable as is on Window platform. An exception shall be made on hadoop.cmd (and other cmd files for what matters) to make sure they are in DOS format, for them to be runnable as is when checked out from source repository. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792176#comment-13792176 ] Andrew Wang commented on HADOOP-10039: -- +1 LGTM Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Haohui Mai Attachments: HDFS-5340.000.patch org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HADOOP-10039: --- Resolution: Fixed Fix Version/s: 2.2.1 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've committed this to trunk, branch-2, and branch-2.2. Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Haohui Mai Fix For: 2.2.1 Attachments: HDFS-5340.000.patch org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HADOOP-10039) Add Hive to the list of projects using AbstractDelegationTokenSecretManager
[ https://issues.apache.org/jira/browse/HADOOP-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792231#comment-13792231 ] Hudson commented on HADOOP-10039: - SUCCESS: Integrated in Hadoop-trunk-Commit #4583 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4583/]) HADOOP-10039. Add Hive to the list of projects using AbstractDelegationTokenSecretManager. Contributed by Haohui Mai. (jing9: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1531158) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java Add Hive to the list of projects using AbstractDelegationTokenSecretManager --- Key: HADOOP-10039 URL: https://issues.apache.org/jira/browse/HADOOP-10039 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.0.0-alpha Reporter: Suresh Srinivas Assignee: Haohui Mai Fix For: 2.2.1 Attachments: HDFS-5340.000.patch org.apache.hadoop.hive.thrift.DelegationTokenSecretManager extends AbstractDelegationTokenSecretManager. This should be captured in the InterfaceAudience annotation of AbstractDelegationTokenSecretManager. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Moved] (HADOOP-10041) UserGroupInformation#spawnAutoRenewalThreadForUserCreds tries to renew even if the kerberos ticket cache is non-renewable
[
https://issues.apache.org/jira/browse/HADOOP-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli moved HDFS-3691 to HADOOP-10041:
Component/s: (was: namenode)
security
Fix Version/s: (was: 2.3.0)
2.3.0
Affects Version/s: (was: 2.0.1-alpha)
2.0.1-alpha
Key: HADOOP-10041 (was: HDFS-3691)
Project: Hadoop Common (was: Hadoop HDFS)
UserGroupInformation#spawnAutoRenewalThreadForUserCreds tries to renew even
if the kerberos ticket cache is non-renewable
-
Key: HADOOP-10041
URL: https://issues.apache.org/jira/browse/HADOOP-10041
Project: Hadoop Common
Issue Type: Bug
Components: security
Affects Versions: 2.0.1-alpha
Reporter: Colin Patrick McCabe
Priority: Minor
Fix For: 2.3.0
UserGroupInformation#spawnAutoRenewalThreadForUserCreds tries to renew user
credentials. However, it does this even if the kerberos ticket cache in
question is non-renewable.
This leads to an annoying error message being printed out all the time.
{code}
cmccabe@keter:/h klist
Ticket cache: FILE:/tmp/krb5cc_1014
Default principal: hdfs/ke...@cloudera.com
Valid starting ExpiresService principal
07/18/12 15:24:15 07/19/12 15:24:13 krbtgt/cloudera@cloudera.com
{code}
{code}
cmccabe@keter:/h ./bin/hadoop fs -ls /
15:21:39,882 WARN UserGroupInformation:739 - Exception encountered while
running the renewal command. Aborting renew thread.
org.apache.hadoop.util.Shell$ExitCodeException: kinit: KDC can't fulfill
requested option while renewing credentials
Found 3 items
-rw-r--r-- 3 cmccabe users 0 2012-07-09 17:15 /b
-rw-r--r-- 3 hdfssupergroup 0 2012-07-09 17:17 /c
drwxrwxrwx - cmccabe audio 0 2012-07-19 11:25 /tmp
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HADOOP-10041) UserGroupInformation#spawnAutoRenewalThreadForUserCreds tries to renew even if the kerberos ticket cache is non-renewable
[
https://issues.apache.org/jira/browse/HADOOP-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792254#comment-13792254
]
Vinod Kumar Vavilapalli commented on HADOOP-10041:
--
I also ran into this.
UserGroupInformation#spawnAutoRenewalThreadForUserCreds tries to renew even
if the kerberos ticket cache is non-renewable
-
Key: HADOOP-10041
URL: https://issues.apache.org/jira/browse/HADOOP-10041
Project: Hadoop Common
Issue Type: Bug
Components: security
Affects Versions: 2.0.1-alpha
Reporter: Colin Patrick McCabe
Priority: Minor
Fix For: 2.3.0
UserGroupInformation#spawnAutoRenewalThreadForUserCreds tries to renew user
credentials. However, it does this even if the kerberos ticket cache in
question is non-renewable.
This leads to an annoying error message being printed out all the time.
{code}
cmccabe@keter:/h klist
Ticket cache: FILE:/tmp/krb5cc_1014
Default principal: hdfs/ke...@cloudera.com
Valid starting ExpiresService principal
07/18/12 15:24:15 07/19/12 15:24:13 krbtgt/cloudera@cloudera.com
{code}
{code}
cmccabe@keter:/h ./bin/hadoop fs -ls /
15:21:39,882 WARN UserGroupInformation:739 - Exception encountered while
running the renewal command. Aborting renew thread.
org.apache.hadoop.util.Shell$ExitCodeException: kinit: KDC can't fulfill
requested option while renewing credentials
Found 3 items
-rw-r--r-- 3 cmccabe users 0 2012-07-09 17:15 /b
-rw-r--r-- 3 hdfssupergroup 0 2012-07-09 17:17 /c
drwxrwxrwx - cmccabe audio 0 2012-07-19 11:25 /tmp
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
