[GitHub] [hadoop] aajisaka commented on pull request #2500: MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter

aajisaka commented on pull request #2500: URL: https://github.com/apache/hadoop/pull/2500#issuecomment-909881265 Merged. Thank you @lzx404243 for stabilizing tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] aajisaka merged pull request #2500: MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter

aajisaka merged pull request #2500: URL: https://github.com/apache/hadoop/pull/2500 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3365: YARN-10931.Remove some invalid characters in NMClientAsyncImpl#ContainerState.

hadoop-yetus commented on pull request #3365: URL: https://github.com/apache/hadoop/pull/3365#issuecomment-909853786 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu opened a new pull request #3365: YARN-10931.Remove some invalid characters in NMClientAsyncImpl#ContainerState.

jianghuazhu opened a new pull request #3365: URL: https://github.com/apache/hadoop/pull/3365 …nerState. ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA

[GitHub] [hadoop] hadoop-yetus commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

hadoop-yetus commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909806663 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3364: HDFS-16200: Improve NameNode failover

hadoop-yetus commented on pull request #3364: URL: https://github.com/apache/hadoop/pull/3364#issuecomment-909799030 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r699774160 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113,47

[GitHub] [hadoop] hadoop-yetus commented on pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

hadoop-yetus commented on pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#issuecomment-909762383 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut closed pull request #3288: HDFS-16158. Discover datanodes with unbalanced volume usage by the st…

tomscut closed pull request #3288: URL: https://github.com/apache/hadoop/pull/3288 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3288: HDFS-16158. Discover datanodes with unbalanced volume usage by the st…

tomscut commented on pull request #3288: URL: https://github.com/apache/hadoop/pull/3288#issuecomment-909761516 Hi @jojochuang , this PR has a lot of changes, which can make rolling updates difficult. I re-implemented this feature and will submit another PR later. Thank you for your

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=644688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644688 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

hadoop-yetus commented on pull request #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-909755280 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aihuaxu opened a new pull request #3364: HDFS-16200: Improve NameNode failover

aihuaxu opened a new pull request #3364: URL: https://github.com/apache/hadoop/pull/3364 This patch adds a configuration to skip resolving the topology for the client hosts, e.g., YARN hosts. Such topology info is useful in colocated environment but not in non-colocated env.

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=644682=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644682 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

hadoop-yetus commented on pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#issuecomment-909731884 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] amahussein edited a comment on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readloc

amahussein edited a comment on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909634740 After rebasing, it looks like there are javac checks added to the build that failed it. Although this is a part of the original code, I decided to address it so

[GitHub] [hadoop] amahussein commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

amahussein commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909634740 After rebasing, it looks like there are javac checks added to the build that failed it. Although this is a part of the original code, I decided to address it so that we

[jira] [Work logged] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13

[ https://issues.apache.org/jira/browse/HADOOP-17223?focusedWorklogId=644623=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644623 ] ASF GitHub Bot logged work on HADOOP-17223: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3363: HADOOP-17223. backport to branch-2.10 bumping httpclient and httpcore

hadoop-yetus commented on pull request #3363: URL: https://github.com/apache/hadoop/pull/3363#issuecomment-909614265 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 13m

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=644622=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644622 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

viirya commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r699650509 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,172 @@ public void

[jira] [Commented] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13

[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407628#comment-17407628 ] Ahmed Hussein commented on HADOOP-17223: I have backported the changes to branch-2.10 in

[jira] [Work logged] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13

[ https://issues.apache.org/jira/browse/HADOOP-17223?focusedWorklogId=644601=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644601 ] ASF GitHub Bot logged work on HADOOP-17223: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein opened a new pull request #3363: HADOOP-17223. backport to branch-2.10 bumping httpclient and httpcore

amahussein opened a new pull request #3363: URL: https://github.com/apache/hadoop/pull/3363 [HADOOP-17223](https://issues.apache.org/jira/browse/HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13 There is CVE-2020-13956 moderate severity

[GitHub] [hadoop] hadoop-yetus commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

hadoop-yetus commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909552788 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

hadoop-yetus commented on pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#issuecomment-909552073 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3361: YARN-10929. Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

hadoop-yetus commented on pull request #3361: URL: https://github.com/apache/hadoop/pull/3361#issuecomment-909528233 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3362: HDFS-16199. Resolve log placeholders in NamenodeBeanMetrics

hadoop-yetus commented on pull request #3362: URL: https://github.com/apache/hadoop/pull/3362#issuecomment-909521290 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3360: YARN-10909. AbstractCSQueue: add @VisibleForTesting annotation for test code

hadoop-yetus commented on pull request #3360: URL: https://github.com/apache/hadoop/pull/3360#issuecomment-909482331 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=644531=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644531 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

sunchao commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r699512553 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,172 @@ public void

[GitHub] [hadoop] virajjasani opened a new pull request #3362: HDFS-16199. Resolve log placeholders in NamenodeBeanMetrics

virajjasani opened a new pull request #3362: URL: https://github.com/apache/hadoop/pull/3362 ### Description of PR NamenodeBeanMetrics has some missing placeholders in logs. This patch attempts to add them. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on pull request #3339: YARN-10646. Fix TestCapacitySchedulerWeightMode.getCSConfWithLabelsPa…

hadoop-yetus commented on pull request #3339: URL: https://github.com/apache/hadoop/pull/3339#issuecomment-909400312 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] virajjasani commented on a change in pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

virajjasani commented on a change in pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#discussion_r699484858 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithShortCircuitRead.java ##

[GitHub] [hadoop] JackWangCS opened a new pull request #3361: YARN-10929. Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

JackWangCS opened a new pull request #3361: URL: https://github.com/apache/hadoop/pull/3361 ### Description of PR Refrain from creating new Configuration object and remove the unneccessary configuration sorting in AbstractManagedParentQueue#initializeLeafQueueConfigs. ### How

[GitHub] [hadoop] jojochuang commented on a change in pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

jojochuang commented on a change in pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#discussion_r699469267 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithShortCircuitRead.java ##

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #3349: HADOOP-17880. build 2.10.x with docker only.

GauthamBanasandra commented on a change in pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#discussion_r699431551 ## File path: dev-support/docker/Dockerfile ## @@ -18,234 +17,80 @@ # Dockerfile for installing the necessary dependencies for building Hadoop.

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=644465=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644465 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2724: HDFS-15862. Rename file back to original in TestViewfsWithNfs3.testNfsRenameSingleNN()

hadoop-yetus commented on pull request #2724: URL: https://github.com/apache/hadoop/pull/2724#issuecomment-908942305 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] sunchao commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

sunchao commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r698693663 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,173 @@ public void

[jira] [Work logged] (HADOOP-17880) build hadoop 2.10.0 with docker machine failed

[ https://issues.apache.org/jira/browse/HADOOP-17880?focusedWorklogId=644477=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644477 ] ASF GitHub Bot logged work on HADOOP-17880: --- Author: ASF GitHub Bot

[GitHub] [hadoop] JackWangCS opened a new pull request #3360: YARN-10909. AbstractCSQueue: add @VisibleForTesting annotation for test code

JackWangCS opened a new pull request #3360: URL: https://github.com/apache/hadoop/pull/3360 ### Description of PR AbstractCSQueue: some methods added for test code but not annotated with VisibleForTesting. ### How was this patch tested? Just code style fix, no new tests needed

[jira] [Work logged] (HADOOP-17863) ABFS: Fix compiler deprecation warning in TextFileBasedIdentityHandler

[ https://issues.apache.org/jira/browse/HADOOP-17863?focusedWorklogId=644410=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644410 ] ASF GitHub Bot logged work on HADOOP-17863: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=644360=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644360 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

umamaheswararao commented on a change in pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#discussion_r698559465 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystem.java ## @@ -89,4 +91,30 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3357: HDFS-16197.Simplify getting NNStorage in FSNamesystem.

hadoop-yetus commented on pull request #3357: URL: https://github.com/apache/hadoop/pull/3357#issuecomment-909077338 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r698849492 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113,47

[GitHub] [hadoop] hadoop-yetus commented on pull request #3358: YARN-10930. Introduce universal capacity resource vector

hadoop-yetus commented on pull request #3358: URL: https://github.com/apache/hadoop/pull/3358#issuecomment-909173124 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=644397=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644397 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on a change in pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

jojochuang commented on a change in pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#discussion_r698896805 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystem.java ## @@ -89,4 +91,30 @@ public

[GitHub] [hadoop] hadoop-yetus commented on pull request #3332: HADOOP-17863. ABFS: Fix compiler deprecation warning in TextFileBasedIdentityHandler

hadoop-yetus commented on pull request #3332: URL: https://github.com/apache/hadoop/pull/3332#issuecomment-909039236 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] steveloughran commented on pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

steveloughran commented on pull request #3338: URL: https://github.com/apache/hadoop/pull/3338#issuecomment-908553090 @yellowflash -before I merge, how do you want to be credited.? do you want: ``` Contributed by yellowflash ``` Or is there any other name you'd like

[GitHub] [hadoop] yellowflash commented on pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

yellowflash commented on pull request #3338: URL: https://github.com/apache/hadoop/pull/3338#issuecomment-908602841 > @yellowflash -before I merge, how do you want to be credited.? > > do you want: > > ``` > Contributed by yellowflash > ``` > > Or is there any

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=644388=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644388 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17863) ABFS: Fix compiler deprecation warning in TextFileBasedIdentityHandler

[ https://issues.apache.org/jira/browse/HADOOP-17863?focusedWorklogId=644382=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644382 ] ASF GitHub Bot logged work on HADOOP-17863: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3332: HADOOP-17863. ABFS: Fix compiler deprecation warning in TextFileBasedIdentityHandler

sumangala-patki commented on a change in pull request #3332: URL: https://github.com/apache/hadoop/pull/3332#discussion_r699053384 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/utils/TextFileBasedIdentityHandler.java ## @@ -172,9 +172,7

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=644363=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644363 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

steveloughran merged pull request #3338: URL: https://github.com/apache/hadoop/pull/3338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17862) ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

[ https://issues.apache.org/jira/browse/HADOOP-17862?focusedWorklogId=644368=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644368 ] ASF GitHub Bot logged work on HADOOP-17862: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

viirya commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r698731273 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,173 @@ public void

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=644351=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644351 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

hadoop-yetus commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909105949 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] bilaharith commented on a change in pull request #3331: HADOOP-17862. ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

bilaharith commented on a change in pull request #3331: URL: https://github.com/apache/hadoop/pull/3331#discussion_r699008293 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsListStatusRemoteIterator.java ## @@ -23,15 +23,18 @@

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=644357=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644357 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] lzx404243 commented on pull request #2724: HDFS-15862. Rename file back to original in TestViewfsWithNfs3.testNfsRenameSingleNN()

lzx404243 commented on pull request #2724: URL: https://github.com/apache/hadoop/pull/2724#issuecomment-908901777 @aajisaka Thanks for the feedback! I've made the corresponding changes following your suggestion. Please let me know what you think. Thanks! -- This is an

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3289: HADOOP-17833. Improve Magic Committer performance

hadoop-yetus removed a comment on pull request #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-905027585 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] steveloughran commented on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

steveloughran commented on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-908572186 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] jojochuang merged pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

jojochuang merged pull request #3353: URL: https://github.com/apache/hadoop/pull/3353 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17862) ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

[ https://issues.apache.org/jira/browse/HADOOP-17862?focusedWorklogId=644306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644306 ] ASF GitHub Bot logged work on HADOOP-17862: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3331: HADOOP-17862. ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

hadoop-yetus commented on pull request #3331: URL: https://github.com/apache/hadoop/pull/3331#issuecomment-909151536 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] GauthamBanasandra commented on pull request #3349: build 2.10.x with docker only.

GauthamBanasandra commented on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908895674 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-17878) Add config for Aliyun OSS cnam support

[ https://issues.apache.org/jira/browse/HADOOP-17878?focusedWorklogId=644289=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644289 ] ASF GitHub Bot logged work on HADOOP-17878: --- Author: ASF GitHub Bot

[GitHub] [hadoop] stczwd commented on pull request #3345: HDFS-16189: add config for aliyun oss cname support

stczwd commented on pull request #3345: URL: https://github.com/apache/hadoop/pull/3345#issuecomment-909068132 cc @steveloughran @jianghuazhu @ferhui -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2128: HDFS-15452.Dynamically initialize the capacity of BlocksMap.

hadoop-yetus commented on pull request #2128: URL: https://github.com/apache/hadoop/pull/2128#issuecomment-908618472 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

[ https://issues.apache.org/jira/browse/HADOOP-17869?focusedWorklogId=644284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644284 ] ASF GitHub Bot logged work on HADOOP-17869: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dongjoon-hyun commented on pull request #3337: HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than `fs.s3a.threads.max`

dongjoon-hyun commented on pull request #3337: URL: https://github.com/apache/hadoop/pull/3337#issuecomment-908629251 Thank you so much, @steveloughran and @sunchao ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=644249=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644249 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

sumangala-patki commented on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-909067436 Regarding the streamStats test pom fix: statistics is a static member of filesystem class and so common for tests. Checked by printing hashcodes of the instance

[jira] [Work logged] (HADOOP-17880) build hadoop 2.10.0 with docker machine failed

[ https://issues.apache.org/jira/browse/HADOOP-17880?focusedWorklogId=644257=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644257 ] ASF GitHub Bot logged work on HADOOP-17880: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ZhendongBai commented on a change in pull request #3349: HADOOP-17880. build 2.10.x with docker only.

ZhendongBai commented on a change in pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#discussion_r699245810 ## File path: dev-support/docker/Dockerfile ## @@ -18,234 +17,80 @@ # Dockerfile for installing the necessary dependencies for building Hadoop. #

[GitHub] [hadoop] goiri commented on pull request #3349: build 2.10.x with docker only.

goiri commented on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908583468 @GauthamBanasandra can you take a look at this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] lzx404243 commented on pull request #2500: MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter

lzx404243 commented on pull request #2500: URL: https://github.com/apache/hadoop/pull/2500#issuecomment-908911221 > If the test case fails before L327, the statistics is not cleared. Would you create an `@After` method and clear the statistics there? That way the statistics is alway

[jira] [Work logged] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

[ https://issues.apache.org/jira/browse/HADOOP-17869?focusedWorklogId=644234=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644234 ] ASF GitHub Bot logged work on HADOOP-17869: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ZhendongBai edited a comment on pull request #3349: build 2.10.x with docker only.

ZhendongBai edited a comment on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908915018 > @ZhendongBai could you please mention the HADOOP JIRA in the title of this PR? @GauthamBanasandra thanks a lot for your review, and just now I create a

[GitHub] [hadoop] steveloughran merged pull request #3337: HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than `fs.s3a.threads.max`

steveloughran merged pull request #3337: URL: https://github.com/apache/hadoop/pull/3337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=644203=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644203 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

steveloughran commented on pull request #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-908567988 This is at a point where it's ready for some review and any benchmarking people can do. I've cut out a lot of HTTP IO per file create and load @mukund-thakur

[GitHub] [hadoop] amahussein commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

amahussein commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909234801 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=644209=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644209 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] brumi1024 commented on pull request #3355: YARN-10901. Fix permission checking error on an existing directory in…

brumi1024 commented on pull request #3355: URL: https://github.com/apache/hadoop/pull/3355#issuecomment-908461551 Thanks @tomicooler for working on this. The commit LGTM, +1 from my side, once you fix the checkstyle issues. :) -- This is an automated message from the Apache Git

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

sumangala-patki commented on a change in pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#discussion_r699147190 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsRestOperationException.java ## @@ -120,9 +123,9 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2500: MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter

hadoop-yetus commented on pull request #2500: URL: https://github.com/apache/hadoop/pull/2500#issuecomment-908962240 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3355: YARN-10901. Fix permission checking error on an existing directory in…

hadoop-yetus commented on pull request #3355: URL: https://github.com/apache/hadoop/pull/3355#issuecomment-908951225 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=644183=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644183 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

hadoop-yetus removed a comment on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-906626627 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] hadoop-yetus commented on pull request #3333: YARN-10576. Update Capacity Scheduler documentation about JSON-based …

hadoop-yetus commented on pull request #: URL: https://github.com/apache/hadoop/pull/#issuecomment-908517290 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

brumi1024 commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698465402 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -681,6 +689,55 @@ list of current

[GitHub] [hadoop] hadoop-yetus commented on pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

hadoop-yetus commented on pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#issuecomment-908748422 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17878) Add config for Aliyun OSS cnam support

[ https://issues.apache.org/jira/browse/HADOOP-17878?focusedWorklogId=644164=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644164 ] ASF GitHub Bot logged work on HADOOP-17878: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=644160=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-644160 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub Bot

  1   2   >