[GitHub] [hadoop] imbajin commented on a change in pull request #2265: HDFS-15551. Tiny Improve for DeadNode detector

imbajin commented on a change in pull request #2265: URL: https://github.com/apache/hadoop/pull/2265#discussion_r484620762 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DeadNodeDetector.java ## @@ -396,13 +395,13 @@ private void

[GitHub] [hadoop] leosunli commented on pull request #2265: HDFS-15551. Tiny Improve for DeadNode detector

leosunli commented on pull request #2265: URL: https://github.com/apache/hadoop/pull/2265#issuecomment-688575038 +1 LGFM. This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] jiwq commented on pull request #2277: HADOOP-17246. Fix build the hadoop-build Docker image failed

jiwq commented on pull request #2277: URL: https://github.com/apache/hadoop/pull/2277#issuecomment-688566323 @aajisaka Could you help to review? This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-17246) Fix build the hadoop-build Docker image failed

[ https://issues.apache.org/jira/browse/HADOOP-17246?focusedWorklogId=479818=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479818 ] ASF GitHub Bot logged work on HADOOP-17246: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2266: [RBF] HDFS-15554 Force router check file existence in destinations before adding/updating mount points

hadoop-yetus commented on pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#issuecomment-688553113 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 63m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

hadoop-yetus commented on pull request #2280: URL: https://github.com/apache/hadoop/pull/2280#issuecomment-688527384 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 28m

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=479805=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479805 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[GitHub] [hadoop] fengnanli commented on a change in pull request #2266: [RBF] HDFS-15554 Force router check file existence in destinations before adding/updating mount points

fengnanli commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r484569373 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterAdminServer.java ## @@ -562,11

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=479758=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479758 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-688480976 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran commented on pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

steveloughran commented on pull request #2280: URL: https://github.com/apache/hadoop/pull/2280#issuecomment-688475543 Tests in progress This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17244: Labels: pull-request-available (was: ) > HADOOP-17244. S3A directory delete tombstones

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=479755=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479755 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=479754=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479754 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

steveloughran opened a new pull request #2280: URL: https://github.com/apache/hadoop/pull/2280 This changes directory tree deletion so that only files are incrementally deleted from S3Guard after the objects are deleted; the directories are left alone until

[jira] [Updated] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17244: Summary: HADOOP-17244. S3A directory delete tombstones dir markers prematurely. (was:

[jira] [Commented] (HADOOP-17244) ITestS3AFileContextMainOperations#testRenameDirectoryAsNonExistentDirectory test failure on -Dauth

[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191840#comment-17191840 ] Steve Loughran commented on HADOOP-17244: - This bug is is in

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=479749=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479749 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-688472439 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] umamaheswararao merged pull request #2275: HDFS-15558: ViewDistributedFileSystem#recoverLease should call super.recoverLease when there are no mounts configured

umamaheswararao merged pull request #2275: URL: https://github.com/apache/hadoop/pull/2275 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=479744=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479744 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-688466988 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=479727=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479727 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[GitHub] [hadoop] liuml07 commented on pull request #2241: HADOOP-17222. Create socket address combined with cache

liuml07 commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-688451138 I'm now on vacation. I will merge it this week. This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-13230) S3A to optionally retain directory markers

[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191816#comment-17191816 ] Steve Loughran commented on HADOOP-13230: - First followup JIRA to this. HADOOP-17244 > S3A to

[jira] [Commented] (HADOOP-17244) ITestS3AFileContextMainOperations#testRenameDirectoryAsNonExistentDirectory test failure on -Dauth

[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191814#comment-17191814 ] Steve Loughran commented on HADOOP-17244: - Working hypothesis The presence of a marker with

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API; S3A to support

[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=479637=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479637 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-688323653 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=479630=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479630 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

hadoop-yetus commented on pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#issuecomment-688314591 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 33m

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=479620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479620 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

mukund-thakur commented on pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#issuecomment-688290398 CC @mukund-thakur. Just to get subscribed. I will review as well. This is an automated message from the

[jira] [Commented] (HADOOP-17244) ITestS3AFileContextMainOperations#testRenameDirectoryAsNonExistentDirectory test failure on -Dauth

[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191674#comment-17191674 ] Steve Loughran commented on HADOOP-17244: - It's actually in the probe for an empty dir; just so

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-688262400 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=479594=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479594 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16202) Enhance S3A openFile()

[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=479568=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479568 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2168: HADOOP-16202. Enhance openFile()

steveloughran commented on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-688229908 tests ``` [ERROR] Errors: [ERROR] TestLocalFSContractOpen>AbstractContractOpenTest.testOpenFileNullStatus:358 ? IllegalArgument [ERROR]

[GitHub] [hadoop] steveloughran commented on pull request #2168: HADOOP-16202. Enhance openFile()

steveloughran commented on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-688229627 ``` ./hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/OpenFileOptions.java:31:@InterfaceAudience.Public:1: Utility classes should not have a

[jira] [Work logged] (HADOOP-16202) Enhance S3A openFile()

[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=479567=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479567 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16202) Enhance S3A openFile()

[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=479566=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479566 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2168: HADOOP-16202. Enhance openFile()

hadoop-yetus removed a comment on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-669933296 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2168: HADOOP-16202. Enhance openFile()

hadoop-yetus removed a comment on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-663534484 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Work logged] (HADOOP-16202) Enhance S3A openFile()

[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=479565=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479565 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[jira] [Work started] (HADOOP-17244) ITestS3AFileContextMainOperations#testRenameDirectoryAsNonExistentDirectory test failure on -Dauth

[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17244 started by Steve Loughran. --- >

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=479564=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479564 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

steveloughran commented on pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#issuecomment-688225319 ``` Unread field: org.apache.hadoop.fs.s3a.Listing$ObjectListingIterator.firstListing --   | Bug type URF_UNREAD_FIELD (click for details)In class

[jira] [Commented] (HADOOP-17247) Support Non-Path Based FileSystem API in Regex Mount Points

[ https://issues.apache.org/jira/browse/HADOOP-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191612#comment-17191612 ] Steve Loughran commented on HADOOP-17247: - usual request: tag with affects version, components,

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=479535=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479535 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17222: Labels: pull-request-available (was: ) > Create socket address combined with cache to

[GitHub] [hadoop] 1996fanrui commented on pull request #2241: HADOOP-17222. Create socket address combined with cache

1996fanrui commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-688160009 Hi @liuml07 ,Could you have time to help merge it? Thank you. This is an automated message from the Apache

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

mukund-thakur commented on a change in pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#discussion_r484259633 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AFileOperationCost.java ## @@ -176,6 +176,77 @@ public void

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=479517=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479517 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot