[jira] [Commented] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319836#comment-16319836 ] genericqa commented on HADOOP-15158: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15158: - Fix Version/s: 2.9.1 > AliyunOSS: Supports role based credential >

[jira] [Commented] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319790#comment-16319790 ] wujinhu commented on HADOOP-15158: -- Attach patch! I add a test to cover those changed code lines. >

[jira] [Updated] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15158: - Attachment: HADOOP-15158.003.patch > AliyunOSS: Supports role based credential >

[jira] [Commented] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319774#comment-16319774 ] genericqa commented on HADOOP-15158: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15027) AliyunOSS: Support multi-thread pre-read to improve read from Hadoop to Aliyun OSS performance

2018-01-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HADOOP-15027: --- Target Version/s: 3.1.0, 2.9.1, 3.0.1 > AliyunOSS: Support multi-thread pre-read to improve read

[jira] [Assigned] (HADOOP-15140) S3guard mistakes root URI without / as non-absolute path

2018-01-09 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abraham Fine reassigned HADOOP-15140: - Assignee: Abraham Fine > S3guard mistakes root URI without / as non-absolute path >

[jira] [Updated] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15158: - Attachment: HADOOP-15158.002.patch > AliyunOSS: Supports role based credential >

[jira] [Updated] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15158: - Fix Version/s: 3.0.1 Status: Patch Available (was: In Progress) > AliyunOSS: Supports role

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-01-09 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319594#comment-16319594 ] genericqa commented on HADOOP-14445: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319502#comment-16319502 ] Aaron Fabbri commented on HADOOP-15141: --- Javac are deprecation warnings on AWS API. Checkstyle

[jira] [Commented] (HADOOP-15140) S3guard mistakes root URI without / as non-absolute path

2018-01-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319489#comment-16319489 ] Aaron Fabbri commented on HADOOP-15140: --- I believe [~abrahamfine] was looking for noob JIRAs to

[jira] [Updated] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-01-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HADOOP-14445: Attachment: HADOOP-14445.003.patch > Delegation tokens are not shared between KMS

[jira] [Commented] (HADOOP-15060) TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky

2018-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319465#comment-16319465 ] Yufei Gu commented on HADOOP-15060: --- [~miklos.szeg...@cloudera.com], Thanks for working on this. +1

[jira] [Commented] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319057#comment-16319057 ] genericqa commented on HADOOP-15141: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15160) Confusing text in http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html

2018-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318994#comment-16318994 ] Daniel Templeton commented on HADOOP-15160: --- Thanks for the heads up, [~steve_l]. I agree

[jira] [Commented] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318972#comment-16318972 ] Hudson commented on HADOOP-15161: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13471 (See

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2018-01-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318949#comment-16318949 ] ASF GitHub Bot commented on HADOOP-15033: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2018-01-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318947#comment-16318947 ] ASF GitHub Bot commented on HADOOP-15033: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2018-01-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318942#comment-16318942 ] ASF GitHub Bot commented on HADOOP-15033: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2018-01-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318936#comment-16318936 ] ASF GitHub Bot commented on HADOOP-15033: - Github user steveloughran commented on a diff in the

[jira] [Updated] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15161: Issue Type: Sub-task (was: Bug) Parent: HADOOP-14831 > s3a: Stream and common

[jira] [Updated] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15161: Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-15160) Confusing text in http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318904#comment-16318904 ] Steve Loughran commented on HADOOP-15160: - [~dan...@cloudera.com] will have some opinions here

[jira] [Commented] (HADOOP-15158) AliyunOSS: Supports role based credential

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318900#comment-16318900 ] Steve Loughran commented on HADOOP-15158: - Changing the constructor is the simplest change for

[jira] [Commented] (HADOOP-15153) [branch-2.8] Increase heap memory to avoid the OOM in pre-commit

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318885#comment-16318885 ] Steve Loughran commented on HADOOP-15153: - bq. branch-2's version of surefire doesn't kill timed

[jira] [Commented] (HADOOP-15148) Improve DataOutputByteBuffer

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318882#comment-16318882 ] Steve Loughran commented on HADOOP-15148: - I'd go for purging it, unless there's clear evidence

[jira] [Commented] (HADOOP-15146) Remove DataOutputByteBuffer

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318878#comment-16318878 ] Steve Loughran commented on HADOOP-15146: - LGTM, something obsoleted by java.nio # Are we

[jira] [Commented] (HADOOP-15142) Register FTP and SFTP as FS services

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318868#comment-16318868 ] Steve Loughran commented on HADOOP-15142: - 1. I think where were going with ftp/sftp is retire

[jira] [Updated] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15141: Attachment: HADOOP-15141-004.patch Patch 004; wrap up all the tests that I can think of.

[jira] [Updated] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15141: Status: Patch Available (was: Open) > Support IAM Assumed roles in S3A >

[jira] [Commented] (HADOOP-9747) Reduce unnecessary UGI synchronization

2018-01-09 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318847#comment-16318847 ] Bharat Viswanadham commented on HADOOP-9747: [~daryn] Thank you for the update. My intention

[jira] [Commented] (HADOOP-15162) UserGroupInformation.createRemoteUser hardcode authentication method to SIMPLE

2018-01-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318749#comment-16318749 ] Eric Yang commented on HADOOP-15162: [~daryn] {quote} Are you writing your own custom http server

[jira] [Commented] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318649#comment-16318649 ] Steve Loughran commented on HADOOP-15141: - HADOOP-15141 patch 003 * Fix up doc duplication *

[jira] [Updated] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15141: Attachment: HADOOP-15141-003.patch > Support IAM Assumed roles in S3A >

[jira] [Updated] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15141: Status: Open (was: Patch Available) > Support IAM Assumed roles in S3A >

[jira] [Commented] (HADOOP-9747) Reduce unnecessary UGI synchronization

2018-01-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318602#comment-16318602 ] Daryn Sharp commented on HADOOP-9747: - I understand this patch is critical to you but please stop

[jira] [Commented] (HADOOP-15162) UserGroupInformation.createRemoteUser hardcode authentication method to SIMPLE

2018-01-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318599#comment-16318599 ] Daryn Sharp commented on HADOOP-15162: -- bq. Proxy user credential should be verified if it can

[jira] [Commented] (HADOOP-14852) Intermittent failure of S3Guard TestConsistencyListFiles

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318595#comment-16318595 ] Steve Loughran commented on HADOOP-14852: - Notable that it's happening in the (2, 2, 1, false)

[jira] [Commented] (HADOOP-14852) Intermittent failure of S3Guard TestConsistencyListFiles

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318590#comment-16318590 ] Steve Loughran commented on HADOOP-14852: - I think we could handle a failure here better by *

[jira] [Commented] (HADOOP-14852) Intermittent failure of S3Guard TestConsistencyListFiles

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318588#comment-16318588 ] Steve Loughran commented on HADOOP-14852: - Seen this again {code} [INFO] Tests run: 7, Failures:

[jira] [Updated] (HADOOP-15079) ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15079: Issue Type: Sub-task (was: Bug) Parent: HADOOP-14831 >

[jira] [Commented] (HADOOP-15141) Support IAM Assumed roles in S3A

2018-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318247#comment-16318247 ] Steve Loughran commented on HADOOP-15141: - I'd completely forgotten about the assumed_roles.md