[GitHub] [hadoop] jojochuang commented on issue #1945: HDFS-15269. NameNode should check the authorization API version only …

2020-04-08 Thread GitBox
jojochuang commented on issue #1945: HDFS-15269. NameNode should check the authorization API version only … URL: https://github.com/apache/hadoop/pull/1945#issuecomment-611339873 TestHAAppend doesn't reproduce locally. TestUnderReplicatedBlocks and TestBPOfferService are failing

[jira] [Commented] (HADOOP-16964) Modify constant for AbstractFileSystem

2020-04-08 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078901#comment-17078901 ] bianqi commented on HADOOP-16964: - Change hard coding to constant  > Modify constant for

[jira] [Updated] (HADOOP-16964) Modify constant for AbstractFileSystem

2020-04-08 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-16964: Attachment: HADOOP-16964-001.patch > Modify constant for AbstractFileSystem >

[jira] [Created] (HADOOP-16964) Modify constant for AbstractFileSystem

2020-04-08 Thread bianqi (Jira)
bianqi created HADOOP-16964: --- Summary: Modify constant for AbstractFileSystem Key: HADOOP-16964 URL: https://issues.apache.org/jira/browse/HADOOP-16964 Project: Hadoop Common Issue Type:

[GitHub] [hadoop] hadoop-yetus commented on issue #1861: HADOOP-13230. Optionally retain directory markers

2020-04-08 Thread GitBox
hadoop-yetus commented on issue #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#issuecomment-611249845 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16960) Enable setting clientId and tenantId for ADL MsiTokenProvider

2020-04-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078801#comment-17078801 ] Hadoop QA commented on HADOOP-16960: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-16960) Enable setting clientId and tenantId for ADL MsiTokenProvider

2020-04-08 Thread Vasil Vasilev (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasil Vasilev updated HADOOP-16960: --- Attachment: HADOOP-16960.004.patch Status: Patch Available (was: Open) > Enable

[jira] [Updated] (HADOOP-16960) Enable setting clientId and tenantId for ADL MsiTokenProvider

2020-04-08 Thread Vasil Vasilev (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasil Vasilev updated HADOOP-16960: --- Status: Open (was: Patch Available) > Enable setting clientId and tenantId for ADL

[GitHub] [hadoop] hadoop-yetus commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-08 Thread GitBox
hadoop-yetus commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS URL: https://github.com/apache/hadoop/pull/1899#issuecomment-611144249 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Created] (HADOOP-16963) HADOOP-16582 changed mkdirs() behavior

2020-04-08 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-16963: Summary: HADOOP-16582 changed mkdirs() behavior Key: HADOOP-16963 URL: https://issues.apache.org/jira/browse/HADOOP-16963 Project: Hadoop Common

[jira] [Commented] (HADOOP-16962) Making `getBoolean` log warning message for unrecognized value

2020-04-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078541#comment-17078541 ] Hadoop QA commented on HADOOP-16962: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-16877) S3A FS deleteOnExit to skip the exists check

2020-04-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16877. - Resolution: Duplicate > S3A FS deleteOnExit to skip the exists check >

[jira] [Resolved] (HADOOP-14619) S3A authenticators to log origin of .secret.key options

2020-04-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14619. - Resolution: Won't Fix cloudstore storediag does this > S3A authenticators to log

[jira] [Updated] (HADOOP-16962) Making `getBoolean` log warning message for unrecognized value

2020-04-08 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HADOOP-16962: --- Description: *Problem:* In `Configuration.java`, the `getBoolean` can accept any valueString and return

[jira] [Commented] (HADOOP-14836) Upgrade maven-clean-plugin to 3.1.0

2020-04-08 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078490#comment-17078490 ] Hudson commented on HADOOP-14836: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18128 (See

[GitHub] [hadoop] hadoop-yetus commented on issue #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream

2020-04-08 Thread GitBox
hadoop-yetus commented on issue #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream URL: https://github.com/apache/hadoop/pull/1946#issuecomment-611074398 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-14836) Upgrade maven-clean-plugin to 3.1.0

2020-04-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14836: --- Summary: Upgrade maven-clean-plugin to 3.1.0 (was: multiple versions of

[jira] [Updated] (HADOOP-14836) multiple versions of maven-clean-plugin in use

2020-04-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14836: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Commented] (HADOOP-14836) multiple versions of maven-clean-plugin in use

2020-04-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078481#comment-17078481 ] Akira Ajisaka commented on HADOOP-14836: Merged the PR into trunk. > multiple versions of

[GitHub] [hadoop] aajisaka commented on issue #1933: HADOOP-14836. Upgrade maven-clean-plugin to 3.1.0

2020-04-08 Thread GitBox
aajisaka commented on issue #1933: HADOOP-14836. Upgrade maven-clean-plugin to 3.1.0 URL: https://github.com/apache/hadoop/pull/1933#issuecomment-611068686 Thank you, @steveloughran This is an automated message from the

[GitHub] [hadoop] aajisaka merged pull request #1933: HADOOP-14836. Upgrade maven-clean-plugin to 3.1.0

2020-04-08 Thread GitBox
aajisaka merged pull request #1933: HADOOP-14836. Upgrade maven-clean-plugin to 3.1.0 URL: https://github.com/apache/hadoop/pull/1933 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-08 Thread GitBox
ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#issuecomment-611067734 Result Summary PUBLIC ENDPOINT, SOUTH CENTRAL US

[GitHub] [hadoop] ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-08 Thread GitBox
ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#issuecomment-611065637 summary: PUBLIC ENDPOINT, SOUTH CENTRAL US

[GitHub] [hadoop] ishaniahuja removed a comment on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-08 Thread GitBox
ishaniahuja removed a comment on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#issuecomment-611065637 summary: PUBLIC ENDPOINT, SOUTH CENTRAL US

[GitHub] [hadoop] ishaniahuja removed a comment on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-08 Thread GitBox
ishaniahuja removed a comment on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#issuecomment-611065303 Here is the Result Summary: summary: PUBLIC ENDPOINT,

[GitHub] [hadoop] ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-08 Thread GitBox
ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls. URL: https://github.com/apache/hadoop/pull/1937#issuecomment-611065303 Here is the Result Summary: summary: PUBLIC ENDPOINT, SOUTH

[jira] [Updated] (HADOOP-16962) Making `getBoolean` log warning message for unrecognized value

2020-04-08 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HADOOP-16962: --- Attachment: HADOOP-16962.001.patch Status: Patch Available (was: Open) > Making `getBoolean` log

[jira] [Created] (HADOOP-16962) Making `getBoolean` log warning message for unrecognized value

2020-04-08 Thread Ctest (Jira)
Ctest created HADOOP-16962: -- Summary: Making `getBoolean` log warning message for unrecognized value Key: HADOOP-16962 URL: https://issues.apache.org/jira/browse/HADOOP-16962 Project: Hadoop Common

[GitHub] [hadoop] steveloughran commented on a change in pull request #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream

2020-04-08 Thread GitBox
steveloughran commented on a change in pull request #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream URL: https://github.com/apache/hadoop/pull/1946#discussion_r405635427 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on issue #1945: HDFS-15269. NameNode should check the authorization API version only …

2020-04-08 Thread GitBox
hadoop-yetus commented on issue #1945: HDFS-15269. NameNode should check the authorization API version only … URL: https://github.com/apache/hadoop/pull/1945#issuecomment-611039899 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features

2020-04-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078386#comment-17078386 ] Hadoop QA commented on HADOOP-16955: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16961: Description: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) can improve the

[GitHub] [hadoop] bgaborg opened a new pull request #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream

2020-04-08 Thread GitBox
bgaborg opened a new pull request #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream URL: https://github.com/apache/hadoop/pull/1946 Change-Id: I034b771533b8314364a3762034439e323758ee09 This is an automated

[jira] [Created] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

2020-04-08 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16961: --- Summary: ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) Key: HADOOP-16961 URL: https://issues.apache.org/jira/browse/HADOOP-16961 Project: Hadoop

[jira] [Assigned] (HADOOP-16426) S3Guard fsck: Implement fixing mechanism for inconsistencies between S3 and MetadataStore

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16426: --- Assignee: (was: Gabor Bota) > S3Guard fsck: Implement fixing mechanism for

[jira] [Assigned] (HADOOP-14109) improvements to S3GuardTool destroy command

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14109: --- Assignee: (was: Gabor Bota) > improvements to S3GuardTool destroy command >

[jira] [Assigned] (HADOOP-14425) Add more s3guard metrics

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14425: --- Assignee: (was: Gabor Bota) > Add more s3guard metrics > > >

[jira] [Assigned] (HADOOP-15779) S3guard: add inconsistency detection metrics

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15779: --- Assignee: (was: Gabor Bota) > S3guard: add inconsistency detection metrics >

[jira] [Assigned] (HADOOP-16425) S3Guard fsck: Export MetadataStore and S3 bucket hierarchy

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16425: --- Assignee: (was: Gabor Bota) > S3Guard fsck: Export MetadataStore and S3 bucket

[jira] [Commented] (HADOOP-8143) Change distcp to have -pb on by default

2020-04-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078365#comment-17078365 ] Steve Loughran commented on HADOOP-8143: bq. it surprises me that block-size preservation isn't

[GitHub] [hadoop] bgaborg commented on issue #1919: HADOOP-16941. ITestS3GuardOutOfBandOperations.testListingDelete failing on versioned bucket

2020-04-08 Thread GitBox
bgaborg commented on issue #1919: HADOOP-16941. ITestS3GuardOutOfBandOperations.testListingDelete failing on versioned bucket URL: https://github.com/apache/hadoop/pull/1919#issuecomment-611004708 Tested against Ireland in Total time: 59:36 min. That total starts to creep up too much

[GitHub] [hadoop] steveloughran commented on issue #1944: HADOOP-16900. Very large files can be truncated when written through S3AFileSystem

2020-04-08 Thread GitBox
steveloughran commented on issue #1944: HADOOP-16900. Very large files can be truncated when written through S3AFileSystem URL: https://github.com/apache/hadoop/pull/1944#issuecomment-611004194 ```

[GitHub] [hadoop] steveloughran commented on issue #1943: Hadoop 16465 listlocatedstatus optimisation

2020-04-08 Thread GitBox
steveloughran commented on issue #1943: Hadoop 16465 listlocatedstatus optimisation URL: https://github.com/apache/hadoop/pull/1943#issuecomment-61099 1. those failures happening when guarded or unguarded? 2. check what options you are passing down to the test runner in the IDE; it

[jira] [Commented] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features

2020-04-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078302#comment-17078302 ] Hadoop QA commented on HADOOP-16955: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features

2020-04-08 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955.001.patch > Hadoop-cos: Fix some bugs and add some important features >

[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features

2020-04-08 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: (was: HADOOP-16955.001.patch) > Hadoop-cos: Fix some bugs and add some important features

[GitHub] [hadoop] jojochuang commented on issue #1945: HDFS-15269. NameNode should check the authorization API version only …

2020-04-08 Thread GitBox
jojochuang commented on issue #1945: HDFS-15269. NameNode should check the authorization API version only … URL: https://github.com/apache/hadoop/pull/1945#issuecomment-610953798 Updated PR to include a nullity check inside setINodeAttributeProvider() which caused

[jira] [Work logged] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features

2020-04-08 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?focusedWorklogId=418468=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-418468 ] YangY logged work on HADOOP-16955: -- Author: YangY Created on:

[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features

2020-04-08 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955.001.patch Release Note: bugfix: - resolve the dependency conflict;

[jira] [Commented] (HADOOP-16958) NullPointerException(NPE) when hadoop.security.authorization is enabled but the input PolicyProvider for ZKFCRpcServer is NULL

2020-04-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077941#comment-17077941 ] Hadoop QA commented on HADOOP-16958: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16959) resolve hadoop-cos dependency conflict

2020-04-08 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077923#comment-17077923 ] YangY commented on HADOOP-16959: Thanks for your attention. I want to use the shaded plugin to package

[jira] [Commented] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist

2020-04-08 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077910#comment-17077910 ] YangY commented on HADOOP-16956: [~ste...@apache.org] Thanks for your comments.   I want to use the

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1923: Hadoop 16857: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-08 Thread GitBox
DadanielZ commented on a change in pull request #1923: Hadoop 16857: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy URL: https://github.com/apache/hadoop/pull/1923#discussion_r405284480 ## File path:

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1923: Hadoop 16857: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-08 Thread GitBox
DadanielZ commented on a change in pull request #1923: Hadoop 16857: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy URL: https://github.com/apache/hadoop/pull/1923#discussion_r405289808 ## File path: