[jira] [Comment Edited] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015234#comment-16015234 ] Yongjun Zhang edited comment on HADOOP-14407 at 5/18/17 5:39 AM: - Hi

[jira] [Commented] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015234#comment-16015234 ] Yongjun Zhang commented on HADOOP-14407: Hi [~omkarksa], Thanks [~ajisakaa] for pointing out

[jira] [Updated] (HADOOP-14242) Make KMS Tomcat SSL property sslEnabledProtocols and clientAuth configurable

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14242: Status: Patch Available (was: Open) > Make KMS Tomcat SSL property sslEnabledProtocols and

[jira] [Updated] (HADOOP-14242) Make KMS Tomcat SSL property sslEnabledProtocols and clientAuth configurable

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14242: Attachment: (was: HADOOP-14417.branch-2.001.patch) > Make KMS Tomcat SSL property

[jira] [Updated] (HADOOP-14242) Make KMS Tomcat SSL property sslEnabledProtocols and clientAuth configurable

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14242: Attachment: HADOOP-14242.branch-2.001.patch > Make KMS Tomcat SSL property sslEnabledProtocols

[jira] [Commented] (HADOOP-14422) FTPFileSystem and distcp does not work when ecnountered a complex ftp password with char ':' or '@'

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015206#comment-16015206 ] Hongyuan Li commented on HADOOP-14422: -- Anybody available for review? [~arpiagariu], [~chuanliu],

[jira] [Commented] (HADOOP-14430) the accessTime of FileStatus got by SFTPFileSystem's getFileStatus method is always 0

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015205#comment-16015205 ] Hongyuan Li commented on HADOOP-14430: -- Anybody available for review? [~arpiagariu], [~chuanliu],

[jira] [Comment Edited] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015200#comment-16015200 ] Hongyuan Li edited comment on HADOOP-14431 at 5/18/17 4:55 AM: --- Anybody

[jira] [Comment Edited] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015200#comment-16015200 ] Hongyuan Li edited comment on HADOOP-14431 at 5/18/17 4:53 AM: --- Anybody

[jira] [Commented] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015200#comment-16015200 ] Hongyuan Li commented on HADOOP-14431: -- Anybody available for review? Arpit Agarwal, Chuan Liu,

[jira] [Comment Edited] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015200#comment-16015200 ] Hongyuan Li edited comment on HADOOP-14431 at 5/18/17 4:52 AM: --- Anybody

[jira] [Commented] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015170#comment-16015170 ] John Zhuge commented on HADOOP-14421: - That will be great, [~vishwajeet.dusane]! >

[jira] [Commented] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

2017-05-17 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015169#comment-16015169 ] Vishwajeet Dusane commented on HADOOP-14421: [~jzhuge] - No worries. Thanks for the update.

[jira] [Commented] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Omkar Aradhya K S (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015158#comment-16015158 ] Omkar Aradhya K S commented on HADOOP-14407: {quote} Thanks for the updated patch Omkar

[jira] [Commented] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-05-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015149#comment-16015149 ] ASF GitHub Bot commented on HADOOP-14436: - GitHub user maobaolong opened a pull request:

[jira] [Created] (HADOOP-14436) The ViewFs.md's minor error about a redundant colon

2017-05-17 Thread maobaolong (JIRA)
maobaolong created HADOOP-14436: --- Summary: The ViewFs.md's minor error about a redundant colon Key: HADOOP-14436 URL: https://issues.apache.org/jira/browse/HADOOP-14436 Project: Hadoop Common

[jira] [Updated] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14421: Affects Version/s: (was: 2.8.0) 2.7.0 >

[jira] [Resolved] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14421. - Resolution: Duplicate Fix Version/s: 2.8.1 Sorry for the false alarm. This issue is

[jira] [Commented] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015124#comment-16015124 ] Hadoop QA commented on HADOOP-14407: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14435: Component/s: documentation > TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed >

[jira] [Updated] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14435: Issue Type: Task (was: Bug) > TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

[jira] [Reopened] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-14435: - Great idea! Re-opened this as a doc JIRA to add a new section {{Troubleshooting}} to

[jira] [Updated] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14435: Priority: Minor (was: Major) > TestAdlFileSystemContractLive#testMkdirsWithUmask assertion

[jira] [Commented] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015119#comment-16015119 ] Mingliang Liu commented on HADOOP-14435: Glad to know that. Thanks for debugging and

[jira] [Commented] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015107#comment-16015107 ] John Zhuge commented on HADOOP-14421: - HADOOP-14435 turned out to to be caused by the "Other" entry

[jira] [Resolved] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14435. - Resolution: Not A Bug Release Note: The "Other" entry in the default permissions of the

[jira] [Commented] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015102#comment-16015102 ] John Zhuge commented on HADOOP-14435: - It turned out {{jzhugeadls}} had default permissions and one

[jira] [Updated] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14407: --- Attachment: HADOOP-14407.002.patch > DistCp - Introduce a configurable copy buffer size >

[jira] [Commented] (HADOOP-11869) Suppress ParameterNumber checkstyle violations for overridden methods

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015071#comment-16015071 ] Hadoop QA commented on HADOOP-11869: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11869) Suppress ParameterNumber checkstyle violations for overridden methods

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015054#comment-16015054 ] Chris Douglas commented on HADOOP-11869: Submitting [~jeagles] patch. A two-year old JIRA

[jira] [Updated] (HADOOP-11869) Suppress ParameterNumber checkstyle violations for overridden methods

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-11869: --- Summary: Suppress ParameterNumber checkstyle violations for overridden methods (was:

[jira] [Updated] (HADOOP-11869) checkstyle rules/script need re-visiting

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-11869: --- Assignee: Jonathan Eagles (was: Andras Bokor) Status: Patch Available (was:

[jira] [Commented] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015007#comment-16015007 ] Hudson commented on HADOOP-14434: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11746 (See

[jira] [Updated] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-14434: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014983#comment-16014983 ] John Zhuge commented on HADOOP-14435: - Very interesting! The test is ok with my new store {{jznew}}.

[jira] [Commented] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014969#comment-16014969 ] John Zhuge commented on HADOOP-14435: - I can reproduce it consistently with my ADL store. Maybe it

[jira] [Commented] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014965#comment-16014965 ] Mingliang Liu commented on HADOOP-14435: This is intermittent, isn't it? >

[jira] [Commented] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014921#comment-16014921 ] Chris Douglas commented on HADOOP-14434: Sorry [~lukmajercak], I missed your [comment

[jira] [Commented] (HADOOP-14426) Upgrade Kerby version from 1.0.0-RC2 to 1.0.0

2017-05-17 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014916#comment-16014916 ] Akira Ajisaka commented on HADOOP-14426: bq. Would any one object if I target this jira at

[jira] [Commented] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014915#comment-16014915 ] Hadoop QA commented on HADOOP-14434: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14426) Upgrade Kerby version from 1.0.0-RC2 to 1.0.0

2017-05-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014898#comment-16014898 ] Kai Zheng commented on HADOOP-14426: Thanks [~jiajia] and [~jojochuang]! Is there any existing

[jira] [Commented] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014896#comment-16014896 ] John Zhuge commented on HADOOP-14421: - Saw HADOOP-14435

[jira] [Commented] (HADOOP-14146) KerberosAuthenticationHandler should authenticate with SPN in AP-REQ

2017-05-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014891#comment-16014891 ] Kai Zheng commented on HADOOP-14146: I'm in travelling and looking for the time for a full detailed

[jira] [Created] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14435: --- Summary: TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed Key: HADOOP-14435 URL: https://issues.apache.org/jira/browse/HADOOP-14435 Project: Hadoop

[jira] [Updated] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

2017-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14435: Description: Saw the following assertion failure in branch-2 and trunk: {noformat} Tests run: 43,

[jira] [Commented] (HADOOP-11572) s3a delete() operation fails during a concurrent delete of child entries

2017-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014876#comment-16014876 ] Mingliang Liu commented on HADOOP-11572: Ah, that makes sense. I'm +1 on this. Thanks, > s3a

[jira] [Commented] (HADOOP-14426) Upgrade Kerby version from 1.0.0-RC2 to 1.0.0

2017-05-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014861#comment-16014861 ] Wei-Chiu Chuang commented on HADOOP-14426: -- I am +1 but would like to let this one sit for a

[jira] [Commented] (HADOOP-14426) Upgrade Kerby version from 1.0.0-RC2 to 1.0.0

2017-05-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014859#comment-16014859 ] Wei-Chiu Chuang commented on HADOOP-14426: -- We've been on Kerby 1.0.0-RC3-SNAPSHOT (equivalent

[jira] [Updated] (HADOOP-14426) Upgrade Kerby version from 1.0.0-RC2 to 1.0.0

2017-05-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14426: - Target Version/s: 3.0.0-alpha3 Component/s: security > Upgrade Kerby version

[jira] [Updated] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-14434: --- Attachment: HADOOP-14434.002.patch v002 * Reverted spurious change to

[jira] [Assigned] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HADOOP-14434: -- Assignee: Lukas Majercak > Use MoveFileEx to allow renaming a file when the

[jira] [Assigned] (HADOOP-14434) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HADOOP-14434: -- Assignee: (was: Lukas Majercak) Affects Version/s: (was:

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-05-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014800#comment-16014800 ] Aaron Fabbri commented on HADOOP-13345: --- Very interesting [~ste...@apache.org], thanks for

[jira] [Commented] (HADOOP-14427) Avoid reloading of Configuration in ViewFileSystem creation.

2017-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014789#comment-16014789 ] Hudson commented on HADOOP-14427: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11745 (See

[jira] [Commented] (HADOOP-11572) s3a delete() operation fails during a concurrent delete of child entries

2017-05-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014775#comment-16014775 ] Aaron Fabbri commented on HADOOP-11572: --- v3 patch looks good to me as well. [~liuml07] I believe

[jira] [Comment Edited] (HADOOP-11572) s3a delete() operation fails during a concurrent delete of child entries

2017-05-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014765#comment-16014765 ] Aaron Fabbri edited comment on HADOOP-11572 at 5/17/17 9:02 PM: edit:

[jira] [Commented] (HADOOP-11572) s3a delete() operation fails during a concurrent delete of child entries

2017-05-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014765#comment-16014765 ] Aaron Fabbri commented on HADOOP-11572: --- {code} @@ -688,12 +693,32 @@ public boolean rename(Path

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014745#comment-16014745 ] Hadoop QA commented on HADOOP-13786: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Status: Patch Available (was: Open) > Add S3Guard committer for zero-rename commits to

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Attachment: HADOOP-13786-HADOOP-13345-028.patch HADOOP-13786 Patch 028 * fixed up the

[jira] [Commented] (HADOOP-11572) s3a delete() operation fails during a concurrent delete of child entries

2017-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014716#comment-16014716 ] Mingliang Liu commented on HADOOP-11572: Steve this patch looks good to me. One quick question:

[jira] [Commented] (HADOOP-14350) Relative path for Kerberos keytab is not working on IBM JDK

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014717#comment-16014717 ] Steve Loughran commented on HADOOP-14350: - OK, I understand. # spark should be setting the

[jira] [Commented] (HADOOP-14350) Relative path for Kerberos keytab is not working on IBM JDK

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014713#comment-16014713 ] Steve Loughran commented on HADOOP-14350: - Stack trace from example {code} 2017-04-19

[jira] [Updated] (HADOOP-14350) Relative path for Kerberos keytab is not working on IBM JDK

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14350: Description: For the sample code below: {code} public class TestKrb { public static

[jira] [Updated] (HADOOP-14427) Avoid reloading of Configuration in ViewFileSystem creation.

2017-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14427: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014702#comment-16014702 ] Steve Loughran commented on HADOOP-13345: - Think I may have hit my first inconsistency BTW, in a

[jira] [Commented] (HADOOP-14180) FileSystem contract tests to replace JUnit 3 with 4

2017-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014692#comment-16014692 ] Mingliang Liu commented on HADOOP-14180: Thanks [~ajisakaa]. [~xiaobingo], would you post a new

[jira] [Commented] (HADOOP-14415) Use java.lang.AssertionError instead of junit.framework.AssertionFailedError

2017-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014689#comment-16014689 ] Hudson commented on HADOOP-14415: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11744 (See

[jira] [Commented] (HADOOP-14180) FileSystem contract tests to replace JUnit 3 with 4

2017-05-17 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014672#comment-16014672 ] Akira Ajisaka commented on HADOOP-14180: Since HADOOP-14415 was fixed, the above second comment

[jira] [Updated] (HADOOP-14415) Use java.lang.AssertionError instead of junit.framework.AssertionFailedError

2017-05-17 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14415: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-14415) Use java.lang.AssertionError instead of junit.framework.AssertionFailedError

2017-05-17 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014666#comment-16014666 ] Akira Ajisaka commented on HADOOP-14415: +1, checking this in. > Use java.lang.AssertionError

[jira] [Commented] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014635#comment-16014635 ] Yongjun Zhang commented on HADOOP-14407: I triggered the jenkins test manually at

[jira] [Commented] (HADOOP-14303) Review retry logic on all S3 SDK calls, implement where needed

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014601#comment-16014601 ] Steve Loughran commented on HADOOP-14303: - + S3aInputStream retries on some non-recoverable

[jira] [Updated] (HADOOP-14395) Provide Builder pattern for DistributedFileSystem.append

2017-05-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-14395: --- Attachment: HADOOP-14395.00-trunk.patch > Provide Builder pattern for

[jira] [Updated] (HADOOP-14395) Provide Builder pattern for DistributedFileSystem.append

2017-05-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-14395: --- Attachment: HADOOP-14395.00-trunk.patch > Provide Builder pattern for

[jira] [Updated] (HADOOP-14395) Provide Builder pattern for DistributedFileSystem.append

2017-05-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-14395: --- Attachment: (was: HADOOP-14395.00-trunk.patch) > Provide Builder pattern for

[jira] [Updated] (HADOOP-14395) Provide Builder pattern for DistributedFileSystem.append

2017-05-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-14395: --- Attachment: HADOOP-14395.00.patch > Provide Builder pattern for

[jira] [Commented] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014519#comment-16014519 ] Yongjun Zhang commented on HADOOP-14407: Thanks [~steve_l]. {quote} .that's something whoever

[jira] [Created] (HADOOP-14433) ITestS3GuardConcurrentOps.testConcurrentTableCreations failing on local dynamo

2017-05-17 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14433: --- Summary: ITestS3GuardConcurrentOps.testConcurrentTableCreations failing on local dynamo Key: HADOOP-14433 URL: https://issues.apache.org/jira/browse/HADOOP-14433

[jira] [Commented] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Omkar Aradhya K S (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014375#comment-16014375 ] Omkar Aradhya K S commented on HADOOP-14407: {quote} Also, we will do more investigations

[jira] [Updated] (HADOOP-14407) DistCp - Introduce a configurable copy buffer size

2017-05-17 Thread Omkar Aradhya K S (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Aradhya K S updated HADOOP-14407: --- Attachment: TotalTime-vs-CopyBufferSize.jpg > DistCp - Introduce a configurable

[jira] [Commented] (HADOOP-14303) Review retry logic on all S3 SDK calls, implement where needed

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014225#comment-16014225 ] Steve Loughran commented on HADOOP-14303: - Transient failure, seen on the s3guard+committer

[jira] [Commented] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014184#comment-16014184 ] Hadoop QA commented on HADOOP-14431: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014122#comment-16014122 ] Steve Loughran edited comment on HADOOP-13345 at 5/17/17 2:33 PM: --

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014122#comment-16014122 ] Steve Loughran commented on HADOOP-13345: - HADOOP-14432 adds tests and robustness for

[jira] [Commented] (HADOOP-14432) S3A copyFromLocalFile to be robust, tested

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014118#comment-16014118 ] Hadoop QA commented on HADOOP-14432: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-05-17 Thread Igor Mazur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014114#comment-16014114 ] Igor Mazur commented on HADOOP-13887: - In S3 I see two kinds of "custom" properties - tags and

[jira] [Commented] (HADOOP-14430) the accessTime of FileStatus got by SFTPFileSystem's getFileStatus method is always 0

2017-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014100#comment-16014100 ] Hadoop QA commented on HADOOP-14430: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-14430) the accessTime of FileStatus got by SFTPFileSystem's getFileStatus method is always 0

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013988#comment-16013988 ] Hongyuan Li edited comment on HADOOP-14430 at 5/17/17 2:09 PM: --- add junit

[jira] [Updated] (HADOOP-14430) the accessTime of FileStatus got by SFTPFileSystem's getFileStatus method is always 0

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14430: - Description: the accessTime of FileStatus got by SFTPFileSystem's getFileStatus method is

[jira] [Updated] (HADOOP-14432) S3A copyFromLocalFile to be robust, tested

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14432: Target Version/s: 3.0.0-alpha2 Status: Patch Available (was: Open) > S3A

[jira] [Updated] (HADOOP-14432) S3A copyFromLocalFile to be robust, tested

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14432: Attachment: HADOOP-14432-001.patch Patch 001 Tests the various failure states of the

[jira] [Updated] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14431: - Priority: Major (was: Trivial) > the modifyTime of FileStatus got by SFTPFileSystem's

[jira] [Updated] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14431: - Status: Patch Available (was: Open) modify getFileStatus method > the modifyTime of

[jira] [Updated] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14431: - Description: {{getFileStatus(ChannelSftp channel, LsEntry sftpFile, Path parentPath)}} get

[jira] [Updated] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14431: - Description: get FileStatus as code below: {code} private FileStatus

[jira] [Updated] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14431: - Description: {{getFileStatus(ChannelSftp channel, LsEntry sftpFile, Path parentPath)}} get

[jira] [Updated] (HADOOP-14431) the modifyTime of FileStatus got by SFTPFileSystem's getFileStatus method is wrong

2017-05-17 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14431: - Attachment: HADOOP-14431-001.patch modify the modifytime got method > the modifyTime of

[jira] [Commented] (HADOOP-14428) s3a: mkdir appears to be broken

2017-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014055#comment-16014055 ] Steve Loughran commented on HADOOP-14428: - maybe its the special case of a trailing "/" at the

[jira] [Created] (HADOOP-14432) S3A copyFromLocalFile to be robust, tested

2017-05-17 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14432: --- Summary: S3A copyFromLocalFile to be robust, tested Key: HADOOP-14432 URL: https://issues.apache.org/jira/browse/HADOOP-14432 Project: Hadoop Common

  1   2   >