[jira] [Updated] (HADOOP-10350) BUILDING.txt should mention openssl dependency required for hadoop-pipes
[ https://issues.apache.org/jira/browse/HADOOP-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-10350: --- Attachment: HADOOP-10350.patch Attached patch to update BUILDING.txt with following dependencies * Zlib devel * openssl devel BUILDING.txt should mention openssl dependency required for hadoop-pipes Key: HADOOP-10350 URL: https://issues.apache.org/jira/browse/HADOOP-10350 Project: Hadoop Common Issue Type: Bug Reporter: Vinayakumar B Assignee: Vinayakumar B Attachments: HADOOP-10350.patch BUILDING.txt should mention openssl dependency required for hadoop-pipes -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HADOOP-9344) Configuration.writeXml can warn about deprecated properties user did not set
[ https://issues.apache.org/jira/browse/HADOOP-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved HADOOP-9344. Resolution: Duplicate Looks like this was fixed by HADOOP-10178. Configuration.writeXml can warn about deprecated properties user did not set Key: HADOOP-9344 URL: https://issues.apache.org/jira/browse/HADOOP-9344 Project: Hadoop Common Issue Type: Bug Components: conf Affects Versions: 2.0.3-alpha, 0.23.5 Reporter: Jason Lowe Assignee: Rushabh S Shah When the configuration is serialized it can emit warnings about deprecated properties that the user did not specify. Converting the config to XML causes all the properties in the config to be processed for deprecation, and after HADOOP-8167 setting a proper config property also causes the deprecated forms to be set. Processing all the keys in the config for deprecation therefore can trigger warnings for keys that were never specified by the user, leaving users confused as to how their code could be triggering these warnings. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10314) The ls command help still shows outdated 0.16 format.
[ https://issues.apache.org/jira/browse/HADOOP-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918232#comment-13918232 ] Kihwal Lee commented on HADOOP-10314: - +1 the patch looks good. The ls command help still shows outdated 0.16 format. - Key: HADOOP-10314 URL: https://issues.apache.org/jira/browse/HADOOP-10314 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.2.0 Reporter: Kihwal Lee Assignee: Rushabh S Shah Labels: newbie Attachments: patch-10314-v2.patch, patch-10314.patch The description of output format is vastly outdated. It was changed after version 0.16. {noformat} $ hadoop fs -help ls -ls [-d] [-h] [-R] [path ...]: List the contents that match the specified file pattern. If path is not specified, the contents of /user/currentUser will be listed. Directory entries are of the form dirName (full path) dir and file entries are of the form fileName(full path) r n size where n is the number of replicas specified for the file and size is the size of the file, in bytes. -d Directories are listed as plain files. -h Formats the sizes of files in a human-readable fashion rather than a number of bytes. -R Recursively list the contents of directories. {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10314) The ls command help still shows outdated 0.16 format.
[ https://issues.apache.org/jira/browse/HADOOP-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-10314: Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've committed this to trunk, branch-2 and branch-2.4. Thanks for working on the fix, Rushabh. The ls command help still shows outdated 0.16 format. - Key: HADOOP-10314 URL: https://issues.apache.org/jira/browse/HADOOP-10314 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.2.0 Reporter: Kihwal Lee Assignee: Rushabh S Shah Labels: newbie Fix For: 3.0.0, 2.4.0 Attachments: patch-10314-v2.patch, patch-10314.patch The description of output format is vastly outdated. It was changed after version 0.16. {noformat} $ hadoop fs -help ls -ls [-d] [-h] [-R] [path ...]: List the contents that match the specified file pattern. If path is not specified, the contents of /user/currentUser will be listed. Directory entries are of the form dirName (full path) dir and file entries are of the form fileName(full path) r n size where n is the number of replicas specified for the file and size is the size of the file, in bytes. -d Directories are listed as plain files. -h Formats the sizes of files in a human-readable fashion rather than a number of bytes. -R Recursively list the contents of directories. {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10314) The ls command help still shows outdated 0.16 format.
[ https://issues.apache.org/jira/browse/HADOOP-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918241#comment-13918241 ] Hudson commented on HADOOP-10314: - SUCCESS: Integrated in Hadoop-trunk-Commit #5253 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5253/]) HADOOP-10314. The ls command help still shows outdated 0.16 format. Contributed by Rushabh S Shah. (kihwal: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1573604) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Ls.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/testConf.xml The ls command help still shows outdated 0.16 format. - Key: HADOOP-10314 URL: https://issues.apache.org/jira/browse/HADOOP-10314 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.2.0 Reporter: Kihwal Lee Assignee: Rushabh S Shah Labels: newbie Fix For: 3.0.0, 2.4.0 Attachments: patch-10314-v2.patch, patch-10314.patch The description of output format is vastly outdated. It was changed after version 0.16. {noformat} $ hadoop fs -help ls -ls [-d] [-h] [-R] [path ...]: List the contents that match the specified file pattern. If path is not specified, the contents of /user/currentUser will be listed. Directory entries are of the form dirName (full path) dir and file entries are of the form fileName(full path) r n size where n is the number of replicas specified for the file and size is the size of the file, in bytes. -d Directories are listed as plain files. -h Formats the sizes of files in a human-readable fashion rather than a number of bytes. -R Recursively list the contents of directories. {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10378) Typo in Help
Mit Desai created HADOOP-10378: -- Summary: Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.9, 3.0.0, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HADOOP-10378: --- Attachment: HADOOP-10378.patch Attaching the fix Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HADOOP-10378: --- Status: Patch Available (was: Open) Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.9, 3.0.0, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918331#comment-13918331 ] Hadoop QA commented on HADOOP-10378: {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12632309/HADOOP-10378.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 1 release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-common-project/hadoop-common: org.apache.hadoop.cli.TestCLI {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3622//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3622//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3622//console This message is automatically generated. Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HADOOP-10378: --- Status: Patch Available (was: Open) Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.9, 3.0.0, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HADOOP-10378: --- Attachment: HADOOP-10378-v2.patch Updated the patch. TestCLI now passes Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HADOOP-10378: --- Status: Open (was: Patch Available) Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.9, 3.0.0, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918468#comment-13918468 ] Hadoop QA commented on HADOOP-10378: {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12632324/HADOOP-10378-v2.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:red}-1 release audit{color}. The applied patch generated 1 release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3623//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/3623//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3623//console This message is automatically generated. Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918569#comment-13918569 ] Mit Desai commented on HADOOP-10378: The Release Audit Warning is not for the file that I changed. Related to HDFS-5950 Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10378) Typo in Help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918619#comment-13918619 ] Suresh Srinivas commented on HADOOP-10378: -- +1 for the patch. Typo in Help Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in hdfs dfs -help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10378: - Summary: Typo in hdfs dfs -help (was: Typo in Help) Typo in hdfs dfs -help -- Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in help printed by hdfs dfs -help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10378: - Summary: Typo in help printed by hdfs dfs -help (was: Typo in hdfs dfs -help) Typo in help printed by hdfs dfs -help -- Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10378) Typo in help printed by hdfs dfs -help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10378: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I committed the patch to trunk and branch-2. Thank you [~mitdesai]! Typo in help printed by hdfs dfs -help -- Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Fix For: 2.5.0 Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10378) Typo in help printed by hdfs dfs -help
[ https://issues.apache.org/jira/browse/HADOOP-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918651#comment-13918651 ] Hudson commented on HADOOP-10378: - SUCCESS: Integrated in Hadoop-trunk-Commit #5256 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5256/]) HADOOP-10378. Typo in help printed by hdfs dfs -help. Contributed by Mit Desai. (suresh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1573776) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Count.java * /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/testConf.xml Typo in help printed by hdfs dfs -help -- Key: HADOOP-10378 URL: https://issues.apache.org/jira/browse/HADOOP-10378 Project: Hadoop Common Issue Type: Bug Affects Versions: 3.0.0, 0.23.9, 2.4.0 Reporter: Mit Desai Assignee: Mit Desai Fix For: 2.5.0 Attachments: HADOOP-10378-v2.patch, HADOOP-10378.patch There is a typo in the description of the following command hdfs dfs -help {noformat} -count [-q] path ...: Count the number of directories, files and bytes under the paths that match the specified file pattern. The output columns are: DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME or QUOTA REMAINING_QUATA SPACE_QUOTA REMAINING_SPACE_QUOTA DIR_COUNT FILE_COUNT CONTENT_SIZE FILE_NAME {noformat} REMAINING_QUATA should be REMAINING_QUOTA -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
Haohui Mai created HADOOP-10379: --- Summary: Protect authentication cookies with the HttpOnly and Secure flags Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-3679) calls to junit Assert::assertEquals invert arguments, causing misleading error messages, other minor improvements.
[ https://issues.apache.org/jira/browse/HADOOP-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jay vyas updated HADOOP-3679: - Summary: calls to junit Assert::assertEquals invert arguments, causing misleading error messages, other minor improvements. (was: calls to junit Assert::assertEquals invert arguments, causing misleading error messages) calls to junit Assert::assertEquals invert arguments, causing misleading error messages, other minor improvements. -- Key: HADOOP-3679 URL: https://issues.apache.org/jira/browse/HADOOP-3679 Project: Hadoop Common Issue Type: Test Components: test Reporter: Chris Douglas Priority: Minor JUnit Assert::assertEquals takes its expected and actual arguments in a particular order, but many unit tests invert them. The error message from a failed assertion can be misleading. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-10379: Status: Patch Available (was: Open) Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HADOOP-10379: Attachment: HADOOP-10379.000.patch Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918836#comment-13918836 ] Jing Zhao commented on HADOOP-10379: +1 pending Jenkins. Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918892#comment-13918892 ] Dilli Arumugam commented on HADOOP-10379: - Code review comment: comment 1: Context: +SessionManager sm = webAppContext.getSessionHandler().getSessionManager(); +if (sm instanceof AbstractSessionManager) { + AbstractSessionManager asm = (AbstractSessionManager)sm; + asm.setHttpOnly(true); + asm.setSecureCookies(true); +} + Would this flag JSESSIONID secure even if the the server is listening on HTTP (not HTTPS)? comment 2: Would it be better to have specific configuration properties, at least for hadoop.auth cookie, like the following: property namehadoop.http.authentication.cookie.secure/name valuefalse/value description Should the authentication cookie should be flagged as secure? /description /property property namehadoop.http.authentication.cookie.httponly/name valuefalse/value description Should the authentication cookie should be flagged as HttpOnly? /description /property The idea is backward compatibility with enough switches to secure the system. Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918903#comment-13918903 ] Haohui Mai commented on HADOOP-10379: - Comment 1: Please see http://docs.oracle.com/javaee/6/api/javax/servlet/SessionCookieConfig.html#setSecure(boolean) Comment 2: The configuration is unnecessary. There is no backward compatibility issue since (1) only the browser will respect the flag, and (2) any violations of the flags are security vulnerabilities. Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918910#comment-13918910 ] Dilli Arumugam commented on HADOOP-10379: - Thanks for the pointer to SessionCookieConfig javadoc. So, JSESSIONID would be marked secure even if the request was on Not on SSL? Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918920#comment-13918920 ] Haohui Mai commented on HADOOP-10379: - bq. So, JSESSIONID would be marked secure even if the request was on Not on SSL? No Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10380) Cleanup javac warnings
Akira AJISAKA created HADOOP-10380: -- Summary: Cleanup javac warnings Key: HADOOP-10380 URL: https://issues.apache.org/jira/browse/HADOOP-10380 Project: Hadoop Common Issue Type: Improvement Components: build Affects Versions: 3.0.0 Reporter: Akira AJISAKA Assignee: Akira AJISAKA There are many javac warnings when compiling Hadoop. See https://builds.apache.org/job/PreCommit-HADOOP-Build/3621/artifact/trunk/patchprocess/filteredTrunkJavacWarnings.txt -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HADOOP-10380) Cleanup javac warnings
[ https://issues.apache.org/jira/browse/HADOOP-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HADOOP-10380: --- Attachment: filteredTrunkJavacWarnings.txt Attaching the warnings. Now the file has 1532 lines. Cleanup javac warnings -- Key: HADOOP-10380 URL: https://issues.apache.org/jira/browse/HADOOP-10380 Project: Hadoop Common Issue Type: Improvement Components: build Affects Versions: 3.0.0 Reporter: Akira AJISAKA Assignee: Akira AJISAKA Attachments: filteredTrunkJavacWarnings.txt There are many javac warnings when compiling Hadoop. See https://builds.apache.org/job/PreCommit-HADOOP-Build/3621/artifact/trunk/patchprocess/filteredTrunkJavacWarnings.txt -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-10379) Protect authentication cookies with the HttpOnly and Secure flags
[ https://issues.apache.org/jira/browse/HADOOP-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13919005#comment-13919005 ] Hadoop QA commented on HADOOP-10379: {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12632390/HADOOP-10379.000.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:red}-1 javac{color:red}. The patch appears to cause the build to fail. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3624//console This message is automatically generated. Protect authentication cookies with the HttpOnly and Secure flags - Key: HADOOP-10379 URL: https://issues.apache.org/jira/browse/HADOOP-10379 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10379.000.patch Browser vendors have adopted proposals to enhance the security of HTTP cookies. For example, the server can mark a cookie as {{Secure}} so that it will not be transfer via plain-text HTTP protocol, and the server can mark a cookie as {{HttpOnly}} to prohibit the JavaScript to access that cookie. This jira proposes to adopt these flags in Hadoop to protect the HTTP cookie used for authentication purposes. -- This message was sent by Atlassian JIRA (v6.2#6252)