[jira] [Work logged] (HADOOP-17246) Fix build the hadoop-build Docker image failed

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17246?focusedWorklogId=484971=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484971 ] ASF GitHub Bot logged work on HADOOP-17246: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka merged pull request #2277: HADOOP-17246. Fix build the hadoop-build Docker image failed

2020-09-16 Thread GitBox
aajisaka merged pull request #2277: URL: https://github.com/apache/hadoop/pull/2277 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-09-16 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196743#comment-17196743 ] Yongjun Zhang commented on HADOOP-14596: Thanks a lot [~ste...@apache.org]! Sorry did not see

[jira] [Updated] (HADOOP-17246) Fix build the hadoop-build Docker image failed

2020-09-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17246: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop] hadoop-yetus commented on pull request #2306: HDFS-15237 Get checksum of EC file failed, when some block is missing…

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2306: URL: https://github.com/apache/hadoop/pull/2306#issuecomment-693240497 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17238) Add ViewFileSystem/InodeTree Mount points Resolution Cache

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17238?focusedWorklogId=485000=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485000 ] ASF GitHub Bot logged work on HADOOP-17238: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2308: HADOOP-17238. Add mount point path resolution cache for viewfs.

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2308: URL: https://github.com/apache/hadoop/pull/2308#issuecomment-693251151 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m

[jira] [Updated] (HADOOP-17246) Fix build the hadoop-build Docker image failed

2020-09-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17246: --- Fix Version/s: 3.4.0 > Fix build the hadoop-build Docker image failed >

[jira] [Updated] (HADOOP-17246) Fix build the hadoop-build Docker image failed

2020-09-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17246: --- Fix Version/s: 3.3.1 > Fix build the hadoop-build Docker image failed >

[GitHub] [hadoop] abhishekdas99 edited a comment on pull request #2225: HDFS-15329. Provide FileContext based ViewFSOverloadScheme implementation

2020-09-16 Thread GitBox
abhishekdas99 edited a comment on pull request #2225: URL: https://github.com/apache/hadoop/pull/2225#issuecomment-693078970 > The latest patch looks good to me. There is one findbug popped up. Could you please take a look at it. Otherwise I am +1 The findbug issue is not part of

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
umamaheswararao commented on a change in pull request #2305: URL: https://github.com/apache/hadoop/pull/2305#discussion_r489262731 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystemWithMountLinks.java ## @@ -61,4

[jira] [Commented] (HADOOP-16795) Java 11 compile support

2020-09-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196854#comment-17196854 ] Akira Ajisaka commented on HADOOP-16795: Hi [~DavinC], please see this wiki first:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-693868067 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 29m

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485532=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485532 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17265) ABFS: Support for Client Correlation ID

2020-09-16 Thread Sumangala Patki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumangala Patki updated HADOOP-17265: - Labels: abfsactive (was: ) > ABFS: Support for Client Correlation ID >

[GitHub] [hadoop] hadoop-yetus commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-693863169 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 29m

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485533=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485533 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao commented on pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
umamaheswararao commented on pull request #2305: URL: https://github.com/apache/hadoop/pull/2305#issuecomment-693910587 Thanks @ayushtkn for the reviews. This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] umamaheswararao merged pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
umamaheswararao merged pull request #2305: URL: https://github.com/apache/hadoop/pull/2305 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HADOOP-17266) Sudo in hadoop-functions.sh should preserve environment variables

2020-09-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197404#comment-17197404 ] Hadoop QA commented on HADOOP-17266: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] aajisaka opened a new pull request #2309: HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-09-16 Thread GitBox
aajisaka opened a new pull request #2309: URL: https://github.com/apache/hadoop/pull/2309 JIRA: https://issues.apache.org/jira/browse/HDFS-15580 In Java 12 or upper, we cannot use reflection to update a final variable. - Make DataNode layout version non-final - Create

[GitHub] [hadoop] aajisaka edited a comment on pull request #2309: HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-09-16 Thread GitBox
aajisaka edited a comment on pull request #2309: URL: https://github.com/apache/hadoop/pull/2309#issuecomment-693340337 Manually ran the test which calls `DFSTestUtil#addDataNodeLayoutVersion` : ``` [INFO] --- [INFO] T E S T S

[GitHub] [hadoop] aajisaka commented on pull request #2309: HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-09-16 Thread GitBox
aajisaka commented on pull request #2309: URL: https://github.com/apache/hadoop/pull/2309#issuecomment-693340337 Manually run the test which calls `DFSTestUtil#addDataNodeLayoutVersion` : ``` [INFO] --- [INFO] T E S T S [INFO]

[jira] [Commented] (HADOOP-17226) Failure of ITestAssumeRole.testRestrictedCommitActions

2020-09-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196946#comment-17196946 ] Steve Loughran commented on HADOOP-17226: - seen in a run of

[jira] [Created] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
Richard created HADOOP-17264: Summary: Access Controlled HTTPFS Proxy Key: HADOOP-17264 URL: https://issues.apache.org/jira/browse/HADOOP-17264 Project: Hadoop Common Issue Type: New Feature

[jira] [Updated] (HADOOP-17226) Failure of ITestAssumeRole.testRestrictedCommitActions

2020-09-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17226: Affects Version/s: 3.3.1 > Failure of ITestAssumeRole.testRestrictedCommitActions >

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2303: HADOOP-17261. s3a rename() needs s3:deleteObjectVersion permission

2020-09-16 Thread GitBox
hadoop-yetus removed a comment on pull request #2303: URL: https://github.com/apache/hadoop/pull/2303#issuecomment-692830480 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-16202) Enhance S3A openFile()

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=485113=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485113 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2303: HADOOP-17261. s3a rename() needs s3:deleteObjectVersion permission

2020-09-16 Thread GitBox
steveloughran commented on pull request #2303: URL: https://github.com/apache/hadoop/pull/2303#issuecomment-693406274 Test with - mvit -Dparallel-tests -DtestsThreadCount=6 -Dmarkers=keep -Ds3guard -Ddynamo -Dfs.s3a.directory.marker.audit=true -Dscale

[GitHub] [hadoop] hadoop-yetus commented on pull request #2309: HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2309: URL: https://github.com/apache/hadoop/pull/2309#issuecomment-693478745 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=485139=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485139 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=485138=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485138 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #2294: HADOOP-17195. ABFS Store thread pool for stream IO.

2020-09-16 Thread GitBox
steveloughran closed pull request #2294: URL: https://github.com/apache/hadoop/pull/2294 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] steveloughran commented on pull request #2294: HADOOP-17195. ABFS Store thread pool for stream IO.

2020-09-16 Thread GitBox
steveloughran commented on pull request #2294: URL: https://github.com/apache/hadoop/pull/2294#issuecomment-693400920 Closing this, but leaving up as the PoC to say "we should have a shared thread pool for lower startup costs"; it would be a switch to buffering on which will the way to

[jira] [Work logged] (HADOOP-17123) remove guava Preconditions from Hadoop-common module

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17123?focusedWorklogId=485198=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485198 ] ASF GitHub Bot logged work on HADOOP-17123: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2091: test PR

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2091: URL: https://github.com/apache/hadoop/pull/2091#issuecomment-693471669 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2134: HADOOP-17123. remove guava Preconditions from Hadoop-common module

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2134: URL: https://github.com/apache/hadoop/pull/2134#issuecomment-693471620 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2117: YARN-10332: RESOURCE_UPDATE event was repeatedly registered in DECOMM…

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2117: URL: https://github.com/apache/hadoop/pull/2117#issuecomment-693471611 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2309: HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2309: URL: https://github.com/apache/hadoop/pull/2309#issuecomment-693507916 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 39m

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485126=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485126 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17123) remove guava Preconditions from Hadoop-common module

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17123: Labels: pull-request-available (was: ) > remove guava Preconditions from Hadoop-common

[jira] [Work logged] (HADOOP-17261) s3a rename() now requires s3:deleteObjectVersion permission

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17261?focusedWorklogId=485147=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485147 ] ASF GitHub Bot logged work on HADOOP-17261: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17250) ABFS: Allow random read sizes to be of buffer size

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?focusedWorklogId=485168=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485168 ] ASF GitHub Bot logged work on HADOOP-17250: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=485125=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485125 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
hadoop-yetus removed a comment on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-692976368 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] steveloughran commented on pull request #2159: HADOOP-17124. Support LZO Codec using aircompressor

2020-09-16 Thread GitBox
steveloughran commented on pull request #2159: URL: https://github.com/apache/hadoop/pull/2159#issuecomment-693384994 hadoop-compression would be cleanest. I was looking @ hadoop-extras as it is already bundled everywhere, so if a project declares a dependency on it, it will still build

[GitHub] [hadoop] hadoop-yetus commented on pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2305: URL: https://github.com/apache/hadoop/pull/2305#issuecomment-693404616 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 4m

[jira] [Created] (HADOOP-17263) transient ITestS3AFileContextStatistics failure -read buffer not filled

2020-09-16 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17263: --- Summary: transient ITestS3AFileContextStatistics failure -read buffer not filled Key: HADOOP-17263 URL: https://issues.apache.org/jira/browse/HADOOP-17263

[jira] [Commented] (HADOOP-17263) transient ITestS3AFileContextStatistics failure -read buffer not filled

2020-09-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196973#comment-17196973 ] Steve Loughran commented on HADOOP-17263: - {code} [INFO] Running

[GitHub] [hadoop] snvijaya commented on a change in pull request #2307: HADOOP-17250 Lot of short reads can be merged with readahead.

2020-09-16 Thread GitBox
snvijaya commented on a change in pull request #2307: URL: https://github.com/apache/hadoop/pull/2307#discussion_r489461371 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -180,9 +205,13 @@ private int

[jira] [Work logged] (HADOOP-17261) s3a rename() now requires s3:deleteObjectVersion permission

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17261?focusedWorklogId=485115=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485115 ] ASF GitHub Bot logged work on HADOOP-17261: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17261) s3a rename() now requires s3:deleteObjectVersion permission

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17261?focusedWorklogId=485116=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485116 ] ASF GitHub Bot logged work on HADOOP-17261: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2303: HADOOP-17261. s3a rename() needs s3:deleteObjectVersion permission

2020-09-16 Thread GitBox
steveloughran commented on pull request #2303: URL: https://github.com/apache/hadoop/pull/2303#issuecomment-693379615 testing in progress: S3 london This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] steveloughran commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
steveloughran commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r489422661 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/snappy/SnappyDecompressor.java ## @@ -276,13 +258,29

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485137=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485137 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2303: HADOOP-17261. s3a rename() needs s3:deleteObjectVersion permission

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2303: URL: https://github.com/apache/hadoop/pull/2303#issuecomment-693428054 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 4m

[jira] [Work logged] (HADOOP-17261) s3a rename() now requires s3:deleteObjectVersion permission

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17261?focusedWorklogId=485164=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485164 ] ASF GitHub Bot logged work on HADOOP-17261: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2246: Hadoop-17215. ABFS: Disable default create overwrite

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#issuecomment-693437512 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 34m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2309: HDFS-15580. [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2309: URL: https://github.com/apache/hadoop/pull/2309#issuecomment-693487130 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 5m

[GitHub] [hadoop] steveloughran commented on pull request #2168: HADOOP-16202. Enhance/Stabilize openFile()

2020-09-16 Thread GitBox
steveloughran commented on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-693377950 + plan to switch copyToLocal & distcp to openFile with sequential read policy. This ensures that on clusters where the default policy has been set to random will not see

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485129=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485129 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
hadoop-yetus removed a comment on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-693125895 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Updated] (HADOOP-17126) implement non-guava Precondition checkNotNull

2020-09-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17126: --- Attachment: HADOOP-17126.002.patch > implement non-guava Precondition checkNotNull >

[GitHub] [hadoop] ThomasMarquardt commented on a change in pull request #2246: Hadoop-17215. ABFS: Disable default create overwrite

2020-09-16 Thread GitBox
ThomasMarquardt commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r489647598 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -263,10 +265,102 @@ public

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485313=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485313 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #2082: HDFS-15419. RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-09-16 Thread GitBox
goiri commented on a change in pull request #2082: URL: https://github.com/apache/hadoop/pull/2082#discussion_r489728490 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java ## @@ -250,6 +250,11 @@

[jira] [Updated] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard updated HADOOP-17264: - Attachment: HADOOP-17244.001.patch Status: Patch Available (was: Open) > Access Controlled

[jira] [Updated] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard updated HADOOP-17264: - Attachment: (was: HADOOP-17244.001.patch) > Access Controlled HTTPFS Proxy >

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
ayushtkn commented on a change in pull request #2305: URL: https://github.com/apache/hadoop/pull/2305#discussion_r489589949 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystemWithMountLinks.java ## @@ -61,4 +64,55

[jira] [Updated] (HADOOP-17088) Failed to load Xinclude files with relative path in case of loading conf via URI

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17088: Labels: pull-request-available (was: ) > Failed to load Xinclude files with relative

[GitHub] [hadoop] hadoop-yetus commented on pull request #2097: HADOOP-17088. Failed to load Xinclude files with relative path in cas…

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2097: URL: https://github.com/apache/hadoop/pull/2097#issuecomment-693562391 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17088) Failed to load Xinclude files with relative path in case of loading conf via URI

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17088?focusedWorklogId=485281=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485281 ] ASF GitHub Bot logged work on HADOOP-17088: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ThomasMarquardt commented on a change in pull request #2246: Hadoop-17215. ABFS: Disable default create overwrite

2020-09-16 Thread GitBox
ThomasMarquardt commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r489616399 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -263,10 +265,102 @@ public

[jira] [Created] (HADOOP-17265) ABFS: Support for Client Correlation ID

2020-09-16 Thread Sumangala Patki (Jira)
Sumangala Patki created HADOOP-17265: Summary: ABFS: Support for Client Correlation ID Key: HADOOP-17265 URL: https://issues.apache.org/jira/browse/HADOOP-17265 Project: Hadoop Common

[jira] [Updated] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard updated HADOOP-17264: - Attachment: HADOOP-17244.001.patch > Access Controlled HTTPFS Proxy > -- >

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #2259: HADOOP-17208. LoadBalanceKMSClientProvider#deleteKey should invalidat…

2020-09-16 Thread GitBox
xiaoyuyao commented on a change in pull request #2259: URL: https://github.com/apache/hadoop/pull/2259#discussion_r489599636 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/ValueQueue.java ## @@ -299,19 +299,18 @@ public E

[GitHub] [hadoop] hadoop-yetus commented on pull request #2082: HDFS-15419. RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2082: URL: https://github.com/apache/hadoop/pull/2082#issuecomment-693585191 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 4m

[GitHub] [hadoop] dbtsai commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
dbtsai commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r489663248 ## File path: hadoop-common-project/hadoop-common/pom.xml ## @@ -363,6 +363,10 @@ wildfly-openssl-java provided + +

[GitHub] [hadoop] ThomasMarquardt commented on a change in pull request #2246: Hadoop-17215. ABFS: Disable default create overwrite

2020-09-16 Thread GitBox
ThomasMarquardt commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r489708814 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/exceptions/ConcurrentWriteOperationDetectedException.java

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
ayushtkn commented on a change in pull request #2305: URL: https://github.com/apache/hadoop/pull/2305#discussion_r489589949 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystemWithMountLinks.java ## @@ -61,4 +64,55

[jira] [Work logged] (HADOOP-17208) LoadBalanceKMSClientProvider#deleteKey should invalidateCache via all KMSClientProvider instances

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17208?focusedWorklogId=485262=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485262 ] ASF GitHub Bot logged work on HADOOP-17208: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2128: HDFS-15452.Dynamically initialize the capacity of BlocksMap.

2020-09-16 Thread GitBox
hadoop-yetus commented on pull request #2128: URL: https://github.com/apache/hadoop/pull/2128#issuecomment-693597343 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Commented] (HADOOP-17215) ABFS: Excessive Create Overwrites leads to race conditions

2020-09-16 Thread Thomas Marqardt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197204#comment-17197204 ] Thomas Marqardt commented on HADOOP-17215: -- Seems we should be doing something like

[jira] [Commented] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197108#comment-17197108 ] Richard commented on HADOOP-17264: -- Please review code > Access Controlled HTTPFS Proxy >

[jira] [Updated] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard updated HADOOP-17264: - Attachment: (was: HADOOP-17244.001.patch) > Access Controlled HTTPFS Proxy >

[jira] [Updated] (HADOOP-17264) Access Controlled HTTPFS Proxy

2020-09-16 Thread Richard (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard updated HADOOP-17264: - Attachment: HADOOP-17244.001.patch > Access Controlled HTTPFS Proxy > -- >

[GitHub] [hadoop] ThomasMarquardt commented on a change in pull request #2246: Hadoop-17215. ABFS: Disable default create overwrite

2020-09-16 Thread GitBox
ThomasMarquardt commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r489701120 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/exceptions/ConcurrentWriteOperationDetectedException.java

[GitHub] [hadoop] steveloughran opened a new pull request #2310: S3A directory delete tombstones dir markers prematurely

2020-09-16 Thread GitBox
steveloughran opened a new pull request #2310: URL: https://github.com/apache/hadoop/pull/2310 Successor to #2280, which as well as handling the rename() failure problem does the same for delete _and_ for multipart failure handling. that failure handling is the most complex as

[jira] [Commented] (HADOOP-17126) implement non-guava Precondition checkNotNull

2020-09-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197231#comment-17197231 ] Hadoop QA commented on HADOOP-17126: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] dbtsai edited a comment on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
dbtsai edited a comment on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-693683581 cc @jlowe @liuml07 @tgravescs who recently worked on compression codecs for more feedback. This is an

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485414=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485414 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2305: HDFS-15578: Fix the rename issues with fallback fs enabled

2020-09-16 Thread GitBox
umamaheswararao commented on a change in pull request #2305: URL: https://github.com/apache/hadoop/pull/2305#discussion_r489780767 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystemWithMountLinks.java ## @@ -61,4

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485476=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485476 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r489829411 ## File path: hadoop-project-dist/pom.xml ## @@ -341,7 +340,6 @@ --openssllib=${openssl.lib}

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=485487=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485487 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-16 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r489858089 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/snappy/SnappyDecompressor.java ## @@ -276,13 +258,29 @@

[jira] [Updated] (HADOOP-17266) Sudo in hadoop-functions.sh should preserve environment variables

2020-09-16 Thread Chengbing Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HADOOP-17266: --- Attachment: HADOOP-17266.001.patch > Sudo in hadoop-functions.sh should preserve

[jira] [Updated] (HADOOP-17266) Sudo in hadoop-functions.sh should preserve environment variables

2020-09-16 Thread Chengbing Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HADOOP-17266: --- Status: Patch Available (was: Open) Attached patch 001: use {{sudo -E}} to preserve

[jira] [Commented] (HADOOP-16948) ABFS: Support single writer dirs

2020-09-16 Thread Billie Rinaldi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197288#comment-17197288 ] Billie Rinaldi commented on HADOOP-16948: - Thanks for following up, [~tmarquardt]. I had

[jira] [Commented] (HADOOP-17266) Sudo in hadoop-functions.sh should preserve environment variables

2020-09-16 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197364#comment-17197364 ] Akira Ajisaka commented on HADOOP-17266: I don't think we should preserve environment variables

  1   2   >