[jira] [Commented] (HADOOP-15370) S3A log message on rm s3a://bucket/ not intuitive

2018-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701367#comment-16701367 ] Sean Mackrory commented on HADOOP-15370: So my bucket and DDB table are both in us-west-2,

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile()

2018-11-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701357#comment-16701357 ] Aaron Fabbri commented on HADOOP-15229: --- Hey [~ste...@apache.org] been on vacation but will try

[jira] [Commented] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701328#comment-16701328 ] wujinhu commented on HADOOP-15953: -- Testing result(set fs.oss.credentials.provider = 

[jira] [Commented] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701324#comment-16701324 ] Hadoop QA commented on HADOOP-15953: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701331#comment-16701331 ] wujinhu commented on HADOOP-15953: -- [~cheersyang] This is a minor improvement for hadoop aliyun

[jira] [Comment Edited] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701328#comment-16701328 ] wujinhu edited comment on HADOOP-15953 at 11/28/18 2:47 AM: *Testing

[jira] [Commented] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701330#comment-16701330 ] wujinhu commented on HADOOP-15953: -- *Testing result(not set fs.oss.credentials.provider)* [INFO]

[jira] [Updated] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Attachment: HADOOP-15953.002.patch > AliyunOSS: make AliyunCredentialsProvider compatible with the

[jira] [Updated] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Description: Hadoop aliyun module uses AliyunCredentialsProvider as default  CredentialsProvider if

[jira] [Commented] (HADOOP-14556) S3A to support Delegation Tokens

2018-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701269#comment-16701269 ] Hadoop QA commented on HADOOP-14556: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Description: Hadoop aliyun module uses AliyunCredentialsProvider as default  CredentialsProvider if

[jira] [Updated] (HADOOP-15953) AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Summary: AliyunOSS: make AliyunCredentialsProvider compatible with the required constructor (was:

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if set fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Description: Hadoop aliyun module uses AliyunCredentialsProvider as default  CredentialsProvider if

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if set fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Issue Type: Improvement (was: Bug) > AliyunOSS: exception will be thrown if set

[jira] [Updated] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-11-27 Thread junhua gu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] junhua gu updated HADOOP-15954: --- Description: Add support for overwriting owner and group in set/get operations to be the service

[jira] [Updated] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-11-27 Thread junhua gu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] junhua gu updated HADOOP-15954: --- Description: Add support for overwriting owner and group in set/get operations to be the service

[jira] [Updated] (HADOOP-14556) S3A to support Delegation Tokens

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14556: Status: Patch Available (was: Open) patch 022; try to address all of Íñigo's comments +

[jira] [Updated] (HADOOP-14556) S3A to support Delegation Tokens

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14556: Status: Open (was: Patch Available) > S3A to support Delegation Tokens >

[jira] [Updated] (HADOOP-14556) S3A to support Delegation Tokens

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14556: Attachment: HADOOP-14556-022.patch > S3A to support Delegation Tokens >

[jira] [Updated] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-11-27 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Da Zhou updated HADOOP-15954: - Component/s: fs/azure > ABFS: Enable owner and group conversion for MSI and login user using OAuth >

[jira] [Updated] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-11-27 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Da Zhou updated HADOOP-15954: - Affects Version/s: 3.2.0 > ABFS: Enable owner and group conversion for MSI and login user using OAuth

[jira] [Created] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-11-27 Thread junhua gu (JIRA)
junhua gu created HADOOP-15954: -- Summary: ABFS: Enable owner and group conversion for MSI and login user using OAuth Key: HADOOP-15954 URL: https://issues.apache.org/jira/browse/HADOOP-15954 Project:

[jira] [Commented] (HADOOP-15932) Oozie unable to create sharelib in s3a filesystem

2018-11-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701028#comment-16701028 ] Hudson commented on HADOOP-15932: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15511 (See

[jira] [Updated] (HADOOP-15932) Oozie unable to create sharelib in s3a filesystem

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15932: Resolution: Fixed Fix Version/s: 3.2.1 3.1.2

[jira] [Commented] (HADOOP-15952) Secure Key Handling Option with TPM2

2018-11-27 Thread Ben Jonas Herbertz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701007#comment-16701007 ] Ben Jonas Herbertz commented on HADOOP-15952: - Thank you for the comment. TPM 2 API

[jira] [Updated] (HADOOP-15952) Secure Key Handling Option with TPM2

2018-11-27 Thread Ben Jonas Herbertz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Jonas Herbertz updated HADOOP-15952: Description: Implement the option to use a TPM 2 as a KeyStoreProvider as

[jira] [Commented] (HADOOP-15932) Oozie unable to create sharelib in s3a filesystem

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700985#comment-16700985 ] Steve Loughran commented on HADOOP-15932: - no, sorry for breaking it in the first place. My bad

[jira] [Commented] (HADOOP-15952) Secure Key Handling Option with TPM2

2018-11-27 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700965#comment-16700965 ] Larry McCay commented on HADOOP-15952: -- [~ste...@apache.org] - I saw this. Thanks for pointing it

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-11-27 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700891#comment-16700891 ] Adam Antal commented on HADOOP-15819: - Also tests were run in eu-ireland (eu-west-1). > S3A

[jira] [Commented] (HADOOP-15950) Failover for LdapGroupsMapping

2018-11-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700888#comment-16700888 ] Wei-Chiu Chuang commented on HADOOP-15950: -- Had a quick first pass. The change looks

[jira] [Commented] (HADOOP-15932) Oozie unable to create sharelib in s3a filesystem

2018-11-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700859#comment-16700859 ] Anu Engineer commented on HADOOP-15932: --- +1, Thanks for taking care of this. > Oozie unable to

[jira] [Commented] (HADOOP-15940) ABFS: For HNS account, avoid unnecessary get call when doing Rename

2018-11-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700843#comment-16700843 ] Hudson commented on HADOOP-15940: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15510 (See

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile()

2018-11-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700839#comment-16700839 ] Owen O'Malley commented on HADOOP-15229: Sorry for coming into this late and for bike shedding.

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-11-27 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700823#comment-16700823 ] Adam Antal commented on HADOOP-15819: - I looked through the affected tests, and maybe this

[jira] [Updated] (HADOOP-15940) ABFS: For HNS account, avoid unnecessary get call when doing Rename

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15940: Resolution: Fixed Fix Version/s: 3.2.1 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-15952) Secure Key Handling Option with TPM2

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700820#comment-16700820 ] Steve Loughran commented on HADOOP-15952: - +[~lmccay] > Secure Key Handling Option with TPM2 >

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile()

2018-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700733#comment-16700733 ] Hadoop QA commented on HADOOP-15229: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14556) S3A to support Delegation Tokens

2018-11-27 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700677#comment-16700677 ] Larry McCay commented on HADOOP-14556: -- [~ste...@apache.org] - thanks for considering that! In

[jira] [Commented] (HADOOP-15953) AliyunOSS: exception will be thrown if set fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700668#comment-16700668 ] Hadoop QA commented on HADOOP-15953: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14556) S3A to support Delegation Tokens

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700653#comment-16700653 ] Steve Loughran commented on HADOOP-14556: - Hi [~elgoiri]: thanks for this review; not had a

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if set fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Summary: AliyunOSS: exception will be thrown if set fs.oss.credentials.provider to

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if configure fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Affects Version/s: 3.0.3 > AliyunOSS: exception will be thrown if configure

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if configure fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Description: Hadoop aliyun module uses AliyunCredentialsProvider as default  CredentialsProvider if

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if configure fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Attachment: HADOOP-15953.001.patch Status: Patch Available (was: Open) > AliyunOSS: exception

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile()

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Status: Patch Available (was: Open) HADOOP-15229 patch 006 everything * fix broken

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile()

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Attachment: HADOOP-15229-006.patch > Add FileSystem builder-based openFile() API to

[jira] [Commented] (HADOOP-15364) Add support for S3 Select to S3A

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700539#comment-16700539 ] Steve Loughran commented on HADOOP-15364: - A descendant of patch is now part of HADOOP-15229.

[jira] [Updated] (HADOOP-15953) AliyunOSS: exception will be thrown if configure fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15953: - Description: Hadoop aliyun module uses AliyunCredentialsProvider as default  CredentialsProvider if

[jira] [Created] (HADOOP-15953) AliyunOSS: exception will be thrown if configure fs.oss.credentials.provider to AliyunCredentialsProvider

2018-11-27 Thread wujinhu (JIRA)
wujinhu created HADOOP-15953: Summary: AliyunOSS: exception will be thrown if configure fs.oss.credentials.provider to AliyunCredentialsProvider Key: HADOOP-15953 URL:

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile()

2018-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Status: Open (was: Patch Available) > Add FileSystem builder-based openFile() API to

[jira] [Commented] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-11-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700370#comment-16700370 ] Gabor Bota commented on HADOOP-15819: - fyi [~adam.antal] I've created an issue for the problems

[jira] [Created] (HADOOP-15952) Secure Key Handling Option with TPM2

2018-11-27 Thread Ben Jonas Herbertz (JIRA)
Ben Jonas Herbertz created HADOOP-15952: --- Summary: Secure Key Handling Option with TPM2 Key: HADOOP-15952 URL: https://issues.apache.org/jira/browse/HADOOP-15952 Project: Hadoop Common

[GitHub] hadoop pull request #442: YARN-9065.App's diags is too long,written zk error

2018-11-27 Thread hunshenshi
GitHub user hunshenshi opened a pull request: https://github.com/apache/hadoop/pull/442 YARN-9065.App's diags is too long,written zk error When use ZKRMStateStore to store app info, App's diags is too long, written zk error. The zk error log: `2018-11-27

[jira] [Commented] (HADOOP-15370) S3A log message on rm s3a://bucket/ not intuitive

2018-11-27 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700093#comment-16700093 ] Gabor Bota commented on HADOOP-15370: - Usually, these tests are failing if the location I run tests