[jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=478501=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478501 ] ASF GitHub Bot logged work on HADOOP-17158: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17158: Labels: pull-request-available (was: ) > Test timeout for

[jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=478548=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478548 ] ASF GitHub Bot logged work on HADOOP-17158: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-686493179 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=478588=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478588 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=478620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478620 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet opened a new pull request #2272: HADOOP-17158. Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread GitBox
mehakmeet opened a new pull request #2272: URL: https://github.com/apache/hadoop/pull/2272 Tested by: mvn -T 1C -Dparallel-tests=abfs clean verify Region: East US. ``` [INFO] Results: [INFO] [INFO] Tests run: 87, Failures: 0, Errors: 0, Skipped: 0 ``` ``` [INFO]

[GitHub] [hadoop] hadoop-yetus commented on pull request #2272: HADOOP-17158. Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2272: URL: https://github.com/apache/hadoop/pull/2272#issuecomment-686478523 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=478558=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478558 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-686543578 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-03 Thread GitBox
hadoop-yetus removed a comment on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-682802215 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (HADOOP-17241) s3a: bucket names which aren't parseable hostnames unsupported

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190092#comment-17190092 ] Steve Loughran commented on HADOOP-17241: - bq. As a result, I have just sent out an internal

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=478519=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478519 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17228) Backport HADOOP-13230 listing changes for preserved directory markers to 3.1.x

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17228. - Fix Version/s: 3.1.5 Release Note: This release of Hadoop 3.1 can safely interact

[jira] [Created] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17242: --- Summary: S3A (async) ObjectListingIterator to block in hasNext() for results Key: HADOOP-17242 URL: https://issues.apache.org/jira/browse/HADOOP-17242 Project:

[GitHub] [hadoop] bgaborg commented on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-03 Thread GitBox
bgaborg commented on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-686516851 Nice improvement Steve, LGTM, +1 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190251#comment-17190251 ] Steve Loughran commented on HADOOP-17242: - this isn't actually a real bug as you never get a

[jira] [Updated] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17242: Priority: Minor (was: Major) > S3A (async) ObjectListingIterator to block in hasNext()

[GitHub] [hadoop] steveloughran opened a new pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread GitBox
steveloughran opened a new pull request #2273: URL: https://github.com/apache/hadoop/pull/2273 I was worried there was a bug here, but not. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-03 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r483125623 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[GitHub] [hadoop] steveloughran commented on a change in pull request #2272: HADOOP-17158. Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread GitBox
steveloughran commented on a change in pull request #2272: URL: https://github.com/apache/hadoop/pull/2272#discussion_r483148755 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -503,6 +507,28 @@ public

[jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=478717=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478717 ] ASF GitHub Bot logged work on HADOOP-17158: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2260: HADOOP-17028. ViewFS should initialize mounted target filesystems lazily

2020-09-03 Thread GitBox
steveloughran commented on a change in pull request #2260: URL: https://github.com/apache/hadoop/pull/2260#discussion_r483151165 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/InodeTree.java ## @@ -284,7 +290,15 @@ boolean

[jira] [Work logged] (HADOOP-17028) ViewFS should initialize target filesystems lazily

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17028?focusedWorklogId=478721=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478721 ] ASF GitHub Bot logged work on HADOOP-17028: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao commented on pull request #2234: HDFS-15529: getChildFilesystems should include fallback fs as well

2020-09-03 Thread GitBox
umamaheswararao commented on pull request #2234: URL: https://github.com/apache/hadoop/pull/2234#issuecomment-686660352 Thanks @ayushtkn for the review. This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] umamaheswararao merged pull request #2234: HDFS-15529: getChildFilesystems should include fallback fs as well

2020-09-03 Thread GitBox
umamaheswararao merged pull request #2234: URL: https://github.com/apache/hadoop/pull/2234 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=478757=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478757 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=478790=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478790 ] ASF GitHub Bot logged work on HADOOP-17158: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2272: HADOOP-17158. Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2272: URL: https://github.com/apache/hadoop/pull/2272#issuecomment-686722826 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Updated] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17242: Labels: pull-request-available (was: ) > S3A (async) ObjectListingIterator to block in

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=478668=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478668 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#issuecomment-686638971 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran commented on pull request #2187: HADOOP-17167 Skipping ITestS3AEncryptionWithDefaultS3Settings.testEncryptionOverRename

2020-09-03 Thread GitBox
steveloughran commented on pull request #2187: URL: https://github.com/apache/hadoop/pull/2187#issuecomment-686679691 merged, let's leave JIRA open until all is good This is an automated message from the Apache Git Service.

[GitHub] [hadoop] steveloughran merged pull request #2187: HADOOP-17167 Skipping ITestS3AEncryptionWithDefaultS3Settings.testEncryptionOverRename

2020-09-03 Thread GitBox
steveloughran merged pull request #2187: URL: https://github.com/apache/hadoop/pull/2187 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] NickyYe opened a new pull request #2274: HDFS-15557 Log the reason why a file can't be deleted

2020-09-03 Thread GitBox
NickyYe opened a new pull request #2274: URL: https://github.com/apache/hadoop/pull/2274 https://issues.apache.org/jira/browse/HDFS-15557 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=478707=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478707 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=478706=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478706 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2269: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport to branch-2

2020-09-03 Thread GitBox
steveloughran commented on pull request #2269: URL: https://github.com/apache/hadoop/pull/2269#issuecomment-686638484 ok, all as good as it gets. Will apply the patch filtering out whitespace. This is an automated message

[jira] [Work logged] (HADOOP-17167) ITestS3AEncryptionWithDefaultS3Settings fails if default bucket encryption != KMS

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17167?focusedWorklogId=478754=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478754 ] ASF GitHub Bot logged work on HADOOP-17167: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17167) ITestS3AEncryptionWithDefaultS3Settings fails if default bucket encryption != KMS

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17167?focusedWorklogId=478753=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478753 ] ASF GitHub Bot logged work on HADOOP-17167: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-686690075 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 41m

[GitHub] [hadoop] liuml07 commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-03 Thread GitBox
liuml07 commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r483194125 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-03 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r483125623 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2254: HADOOP-17227. Marker Tool tuning

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2254: URL: https://github.com/apache/hadoop/pull/2254#issuecomment-686692132 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17227) improve s3guard markers command line tool

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?focusedWorklogId=478761=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478761 ] ASF GitHub Bot logged work on HADOOP-17227: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17199: Fix Version/s: 3.1.5 2.10.1 > Backport HADOOP-13230

[jira] [Updated] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17199: Summary: Backport HADOOP-13230 list/getFileStatus changes for preserved directory

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=478710=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478710 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #2269: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport to branch-2

2020-09-03 Thread GitBox
steveloughran closed pull request #2269: URL: https://github.com/apache/hadoop/pull/2269 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] steveloughran commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-03 Thread GitBox
steveloughran commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-686653695 This is better. These are the only two responses which constitute success, right? This is an automated

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=478722=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478722 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17167) ITestS3AEncryptionWithDefaultS3Settings fails if default bucket encryption != KMS

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17167: Labels: pull-request-available (was: ) > ITestS3AEncryptionWithDefaultS3Settings fails

[jira] [Work logged] (HADOOP-17167) ITestS3AEncryptionWithDefaultS3Settings fails if default bucket encryption != KMS

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17167?focusedWorklogId=478752=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478752 ] ASF GitHub Bot logged work on HADOOP-17167: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17038) Support positional read in AbfsInputStream

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17038: Labels: HBase abfsactive pull-request-available (was: HBase abfsactive) > Support

[GitHub] [hadoop] steveloughran commented on pull request #2206: HADOOP-17038 Support positional read in AbfsInputStream

2020-09-03 Thread GitBox
steveloughran commented on pull request #2206: URL: https://github.com/apache/hadoop/pull/2206#issuecomment-686672349 > The Keys for the FSBuilder APIs needs to be generic. Any pointer where we need to add this? May be already we have a place for this with sample keys .. Wanted to see

[jira] [Work logged] (HADOOP-17038) Support positional read in AbfsInputStream

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17038?focusedWorklogId=478751=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478751 ] ASF GitHub Bot logged work on HADOOP-17038: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2187: HADOOP-17167 Skipping ITestS3AEncryptionWithDefaultS3Settings.testEncryptionOverRename

2020-09-03 Thread GitBox
steveloughran commented on pull request #2187: URL: https://github.com/apache/hadoop/pull/2187#issuecomment-686675116 I'm +1-ing the patch, but I'm still not 100% sure it will solve things...it's a complex setup. Let's see

[GitHub] [hadoop] fengnanli commented on a change in pull request #2266: [RBF] HDFS-15554 Force router check file existence in destinations before adding/updating mount points

2020-09-03 Thread GitBox
fengnanli commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r483126174 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterAdminServer.java ## @@ -562,11

[GitHub] [hadoop] fengnanli commented on a change in pull request #2266: [RBF] HDFS-15554 Force router check file existence in destinations before adding/updating mount points

2020-09-03 Thread GitBox
fengnanli commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r483126174 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterAdminServer.java ## @@ -562,11

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=478731=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478731 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-03 Thread GitBox
mehakmeet commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-686656727 It'd be from 200 to 206, so 7 in total. While testing I saw 206 was the code when there were some bytes returned. Not so sure about the other 2XX codes, but 200 and 202 were

[GitHub] [hadoop] hadoop-yetus commented on pull request #2274: HDFS-15557. Log the reason why a file can't be deleted

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2274: URL: https://github.com/apache/hadoop/pull/2274#issuecomment-686789909 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2274: HDFS-15557. Log the reason why a storage log file can't be deleted

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2274: URL: https://github.com/apache/hadoop/pull/2274#issuecomment-686852824 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 28m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2168: HADOOP-16202. Enhance openFile()

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-686773658 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-16202) Enhance S3A openFile()

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=478814=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478814 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-16202) Enhance S3A openFile()

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-16202: Labels: pull-request-available (was: ) > Enhance S3A openFile() >

[GitHub] [hadoop] leosunli commented on a change in pull request #2265: HDFS-15551. Tiny Improve for DeadNode detector

2020-09-03 Thread GitBox
leosunli commented on a change in pull request #2265: URL: https://github.com/apache/hadoop/pull/2265#discussion_r483382751 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DeadNodeDetector.java ## @@ -475,6 +475,7 @@ public

[jira] [Created] (HADOOP-17243) Add FileContext based Regex Mountpoint implementation.

2020-09-03 Thread zhenzhao wang (Jira)
zhenzhao wang created HADOOP-17243: -- Summary: Add FileContext based Regex Mountpoint implementation. Key: HADOOP-17243 URL: https://issues.apache.org/jira/browse/HADOOP-17243 Project: Hadoop Common

[jira] [Updated] (HADOOP-17243) Add FileContext based Regex Mountpoint implementation.

2020-09-03 Thread zhenzhao wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhenzhao wang updated HADOOP-17243: --- Parent: HADOOP-15891 Issue Type: Sub-task (was: Task) > Add FileContext based

[GitHub] [hadoop] hadoop-yetus commented on pull request #2274: HDFS-15557. Log the reason why a storage log file can't be deleted

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2274: URL: https://github.com/apache/hadoop/pull/2274#issuecomment-686880097 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] liuml07 commented on a change in pull request #2274: HDFS-15557. Log the reason why a storage log file can't be deleted

2020-09-03 Thread GitBox
liuml07 commented on a change in pull request #2274: URL: https://github.com/apache/hadoop/pull/2274#discussion_r483377105 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/AtomicFileOutputStream.java ## @@ -75,8 +76,13 @@ public void

[GitHub] [hadoop] fengnanli commented on a change in pull request #2266: [RBF] HDFS-15554 Force router check file existence in destinations before adding/updating mount points

2020-09-03 Thread GitBox
fengnanli commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r483399376 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterAdminServer.java ## @@ -562,11

[GitHub] [hadoop] steveloughran commented on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-03 Thread GitBox
steveloughran commented on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-686411091 LGTM, +1 *pending you make clear in the option names and docs that this is experimental* > These configs are tested on prod environments. > The same can

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478473=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478473 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub Bot

[jira] [Issue Comment Deleted] (HADOOP-17214) Allow file system caching to be disabled for all file systems

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17214: Comment: was deleted (was: +[~weichu]) > Allow file system caching to be disabled for

[jira] [Commented] (HADOOP-17214) Allow file system caching to be disabled for all file systems

2020-09-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190052#comment-17190052 ] Steve Loughran commented on HADOOP-17214: - +[~weichu] > Allow file system caching to be

[GitHub] [hadoop] hadoop-yetus commented on pull request #2269: HADOOP-17199. S3A Directory Marker HADOOP-13230 backport to branch-2

2020-09-03 Thread GitBox
hadoop-yetus commented on pull request #2269: URL: https://github.com/apache/hadoop/pull/2269#issuecomment-686418335 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?focusedWorklogId=478484=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478484 ] ASF GitHub Bot logged work on HADOOP-17199: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #2271: YARN-10419. Javadoc error in hadoop-yarn-server-common module.

2020-09-03 Thread GitBox
iwasakims commented on pull request #2271: URL: https://github.com/apache/hadoop/pull/2271#issuecomment-686304999 Thanks, @aajisaka. I merged this. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] iwasakims merged pull request #2271: YARN-10419. Javadoc error in hadoop-yarn-server-common module.

2020-09-03 Thread GitBox
iwasakims merged pull request #2271: URL: https://github.com/apache/hadoop/pull/2271 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] aajisaka commented on a change in pull request #2267: HDFS-15555. RBF: Refresh cacheNS when SocketException occurs.

2020-09-03 Thread GitBox
aajisaka commented on a change in pull request #2267: URL: https://github.com/apache/hadoop/pull/2267#discussion_r482766610 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcClient.java ## @@ -582,9 +583,9

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-03 Thread GitBox
hadoop-yetus removed a comment on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-666927562 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-03 Thread GitBox
hadoop-yetus removed a comment on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-676079455 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478433=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478433 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-03 Thread GitBox
hadoop-yetus removed a comment on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-675395752 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478435=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478435 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=478434=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478434 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub Bot