[jira] [Commented] (HADOOP-15642) Update to latest/recent version of aws-sdk for Hadoop 3.2

[ https://issues.apache.org/jira/browse/HADOOP-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567314#comment-16567314 ] Steve Loughran commented on HADOOP-15642: - with this SDK, the new test in HADOOP-15583 for

[jira] [Comment Edited] (HADOOP-14445) Delegation tokens are not shared between KMS instances

[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566084#comment-16566084 ] Ajay Kumar edited comment on HADOOP-14445 at 8/2/18 6:29 PM: - [~xiaochen]

[jira] [Updated] (HADOOP-15552) Move logging APIs over to slf4j in hadoop-tools - Part2

[ https://issues.apache.org/jira/browse/HADOOP-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Pickering updated HADOOP-15552: --- Attachment: HADOOP-15552.v5.patch > Move logging APIs over to slf4j in hadoop-tools -

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566921#comment-16566921 ] Adam Antal commented on HADOOP-14212: - As I see the InterfaceAudience annotation is changed in 

[jira] [Commented] (HADOOP-15576) S3A Multipart Uploader to work with S3Guard and encryption

[ https://issues.apache.org/jira/browse/HADOOP-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567086#comment-16567086 ] Steve Loughran commented on HADOOP-15576: - Failing tests all look unrelated; if they involved

[jira] [Commented] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567527#comment-16567527 ] genericqa commented on HADOOP-14154: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14154: Attachment: HADOOP-14154.002.patch > Persist isAuthoritative bit in DynamoDBMetaStore

[jira] [Commented] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567473#comment-16567473 ] Gabor Bota commented on HADOOP-14154: - The patch still does not include the docs. I'll upload

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567454#comment-16567454 ] Xiao Chen commented on HADOOP-14445: Thanks again Wei-Chiu and Ajay. I agree more testing is a good

[jira] [Commented] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567469#comment-16567469 ] Gabor Bota commented on HADOOP-14154: - Thanks for the review [~fabbri], and for the idea of

[jira] [Resolved] (HADOOP-15470) S3A staging committers to not log FNFEs on job abort listings

[ https://issues.apache.org/jira/browse/HADOOP-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15470. - Resolution: Duplicate > S3A staging committers to not log FNFEs on job abort listings

[jira] [Updated] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Status: Patch Available (was: Open) rebase/merge to trunk, final quick review. Testing

[jira] [Commented] (HADOOP-15626) FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.

[ https://issues.apache.org/jira/browse/HADOOP-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567776#comment-16567776 ] Aaron Fabbri commented on HADOOP-15626: --- +1 LTGM thanks for fixing this. >

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Status: Open (was: Patch Available) > Stabilize S3A Assumed Role support >

[jira] [Updated] (HADOOP-15627) S3A ITestS3GuardWriteBack failing if bucket explicitly set to s3guard+DDB

[ https://issues.apache.org/jira/browse/HADOOP-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15627: Summary: S3A ITestS3GuardWriteBack failing if bucket explicitly set to s3guard+DDB

[jira] [Updated] (HADOOP-15552) Move logging APIs over to slf4j in hadoop-tools - Part2

[ https://issues.apache.org/jira/browse/HADOOP-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Pickering updated HADOOP-15552: --- Attachment: HADOOP-15552.v6.patch > Move logging APIs over to slf4j in hadoop-tools -

[jira] [Commented] (HADOOP-14936) S3Guard: remove "experimental" from documentation

[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567602#comment-16567602 ] Steve Loughran commented on HADOOP-14936: - +review those S3guard constants tagged as @Unstable

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15625: Parent Issue: HADOOP-15220 (was: HADOOP-15620) > S3A input stream to use etags to

[jira] [Commented] (HADOOP-14154) Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567775#comment-16567775 ] Aaron Fabbri commented on HADOOP-14154: --- Thanks for the v2 patch.  The DDBPathMetadata stuff

[jira] [Commented] (HADOOP-15552) Move logging APIs over to slf4j in hadoop-tools - Part2

[ https://issues.apache.org/jira/browse/HADOOP-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567807#comment-16567807 ] genericqa commented on HADOOP-15552: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14943: Parent Issue: HADOOP-15620 (was: HADOOP-15220) > Add common getFileBlockLocations()

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Status: Patch Available (was: Open) * do best to shut up findbugs * assumed role range

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Status: Patch Available (was: Open) > Stabilize S3A Assumed Role support >

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Status: Open (was: Patch Available) > Stabilize S3A Assumed Role support >

[jira] [Assigned] (HADOOP-15625) S3A input stream to use etags to detect changed source files

[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15625: --- Assignee: Brahma Reddy Battula > S3A input stream to use etags to detect changed

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Attachment: HADOOP-15583-005.patch > Stabilize S3A Assumed Role support >

[jira] [Commented] (HADOOP-15552) Move logging APIs over to slf4j in hadoop-tools - Part2

[ https://issues.apache.org/jira/browse/HADOOP-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567598#comment-16567598 ] genericqa commented on HADOOP-15552: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-15650) Add custom InstanceProfileCredentialsProvider with more resilience to throttling

Steve Loughran created HADOOP-15650: --- Summary: Add custom InstanceProfileCredentialsProvider with more resilience to throttling Key: HADOOP-15650 URL: https://issues.apache.org/jira/browse/HADOOP-15650

[jira] [Updated] (HADOOP-15626) FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.

[ https://issues.apache.org/jira/browse/HADOOP-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15626: Assignee: Steve Loughran Status: Patch Available (was: Open) HADOOP-15626 patch

[jira] [Updated] (HADOOP-15626) FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.

[ https://issues.apache.org/jira/browse/HADOOP-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15626: Attachment: HADOOP-15626-001.patch >

[jira] [Commented] (HADOOP-15603) S3A to support configuring various AWS S3 client extended options

[ https://issues.apache.org/jira/browse/HADOOP-15603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567612#comment-16567612 ] Steve Loughran commented on HADOOP-15603: - This config also need to be passed to all clients of

[jira] [Commented] (HADOOP-15642) Update to latest/recent version of aws-sdk for Hadoop 3.2

[ https://issues.apache.org/jira/browse/HADOOP-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567633#comment-16567633 ] Steve Loughran commented on HADOOP-15642: - Patch 005 of HADOOP-15583 works with this SDK as

[jira] [Commented] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567639#comment-16567639 ] genericqa commented on HADOOP-15107: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15107) Stabilize/tune S3A committers; review correctness & docs

[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Summary: Stabilize/tune S3A committers; review correctness & docs (was: Prove the

[jira] [Updated] (HADOOP-15645) ITestS3GuardToolLocal.testDiffCommand fails if bucket has per-bucket binding to DDB

[ https://issues.apache.org/jira/browse/HADOOP-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15645: Priority: Blocker (was: Major) > ITestS3GuardToolLocal.testDiffCommand fails if bucket

[jira] [Commented] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567606#comment-16567606 ] genericqa commented on HADOOP-14943: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14237) S3A Support Shared Instance Profile Credentials Across All Hadoop Nodes

[ https://issues.apache.org/jira/browse/HADOOP-14237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14237: Parent Issue: HADOOP-15620 (was: HADOOP-15220) > S3A Support Shared Instance Profile

[jira] [Commented] (HADOOP-14237) S3A Support Shared Instance Profile Credentials Across All Hadoop Nodes

[ https://issues.apache.org/jira/browse/HADOOP-14237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567625#comment-16567625 ] Steve Loughran commented on HADOOP-14237: - I'm looking at this again, going to move to 3.3

[jira] [Updated] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Status: Open (was: Patch Available) > Prove the correctness of the new committers, or

[jira] [Updated] (HADOOP-15107) Prove the correctness of the new committers, or fix where they are not correct

[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15107: Attachment: HADOOP-15107-003.patch > Prove the correctness of the new committers, or fix

[jira] [Comment Edited] (HADOOP-15626) FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.

[ https://issues.apache.org/jira/browse/HADOOP-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567694#comment-16567694 ] Steve Loughran edited comment on HADOOP-15626 at 8/3/18 2:38 AM: -

[jira] [Commented] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567698#comment-16567698 ] genericqa commented on HADOOP-15583: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15626) FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.

[ https://issues.apache.org/jira/browse/HADOOP-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567732#comment-16567732 ] genericqa commented on HADOOP-15626: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13637) improve setting of max connections in AWS client

[ https://issues.apache.org/jira/browse/HADOOP-13637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13637: Parent Issue: HADOOP-15620 (was: HADOOP-15220) > improve setting of max connections in

[jira] [Commented] (HADOOP-15107) Stabilize/tune S3A committers; review correctness & docs

[ https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567754#comment-16567754 ] genericqa commented on HADOOP-15107: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-11794) Enable distcp to copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566294#comment-16566294 ] smarthan edited comment on HADOOP-11794 at 8/2/18 7:42 AM: --- Hi [~yzhangal], I

[jira] [Commented] (HADOOP-15576) S3A Multipart Uploader to work with S3Guard and encryption

[ https://issues.apache.org/jira/browse/HADOOP-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566593#comment-16566593 ] genericqa commented on HADOOP-15576: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-9069) FileSystem.get leads to stack overflow if default FS is not configured with a scheme

[ https://issues.apache.org/jira/browse/HADOOP-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-9069. - Resolution: Duplicate > FileSystem.get leads to stack overflow if default FS is not

[jira] [Commented] (HADOOP-15607) AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream

[ https://issues.apache.org/jira/browse/HADOOP-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566638#comment-16566638 ] wujinhu commented on HADOOP-15607: -- Thanks [~Sammi] > AliyunOSS: fix duplicated partNumber issue in

[jira] [Created] (HADOOP-15649) The Resource Estimator Service cannot parse the default resourcemanager log

tangshangwen created HADOOP-15649: - Summary: The Resource Estimator Service cannot parse the default resourcemanager log Key: HADOOP-15649 URL: https://issues.apache.org/jira/browse/HADOOP-15649

[jira] [Commented] (HADOOP-15649) The Resource Estimator Service cannot parse the default resourcemanager log

[ https://issues.apache.org/jira/browse/HADOOP-15649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566706#comment-16566706 ] tangshangwen commented on HADOOP-15649: --- I think we should support parsing the default log format

[jira] [Issue Comment Deleted] (HADOOP-15649) The Resource Estimator Service cannot parse the default resourcemanager log

[ https://issues.apache.org/jira/browse/HADOOP-15649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated HADOOP-15649: -- Comment: was deleted (was: 我认为我们应该支持解析默认的日志格式) > The Resource Estimator Service cannot

[jira] [Commented] (HADOOP-15649) The Resource Estimator Service cannot parse the default resourcemanager log

[ https://issues.apache.org/jira/browse/HADOOP-15649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566705#comment-16566705 ] tangshangwen commented on HADOOP-15649: --- 我认为我们应该支持解析默认的日志格式 > The Resource Estimator Service