[GitHub] [hadoop] virajjasani commented on pull request #4108: HDFS-16522. Set Http and Ipc ports for Datanodes in MiniDFSCluster

2022-04-05 Thread GitBox
virajjasani commented on PR #4108: URL: https://github.com/apache/hadoop/pull/4108#issuecomment-1089891678 Is this good for merging? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Work logged] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=753207&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753207 ] ASF GitHub Bot logged work on HADOOP-18188: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani commented on a diff in pull request #4135: HADOOP-18188. Support touch command for directory

2022-04-05 Thread GitBox
virajjasani commented on code in PR #4135: URL: https://github.com/apache/hadoop/pull/4135#discussion_r843508971 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellTouch.java: ## @@ -200,6 +200,72 @@ public void testTouch() throws Exception {

[GitHub] [hadoop] hadoop-yetus commented on pull request #4142: HDFS-16530. setReplication debug log creates a new string even if debug is disabled

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4142: URL: https://github.com/apache/hadoop/pull/4142#issuecomment-1089853507 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] aajisaka commented on pull request #4129: HDFS-16527. Add global timeout rule for TestRouterDistCpProcedure

2022-04-05 Thread GitBox
aajisaka commented on PR #4129: URL: https://github.com/apache/hadoop/pull/4129#issuecomment-1089838712 Merged. Thank you @tomscut @goiri @ayushtkn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop] aajisaka merged pull request #4129: HDFS-16527. Add global timeout rule for TestRouterDistCpProcedure

2022-04-05 Thread GitBox
aajisaka merged PR #4129: URL: https://github.com/apache/hadoop/pull/4129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[jira] [Work logged] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=753190&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753190 ] ASF GitHub Bot logged work on HADOOP-18188: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka commented on a diff in pull request #4135: HADOOP-18188. Support touch command for directory

2022-04-05 Thread GitBox
aajisaka commented on code in PR #4135: URL: https://github.com/apache/hadoop/pull/4135#discussion_r843470319 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellTouch.java: ## @@ -200,6 +200,72 @@ public void testTouch() throws Exception {

[jira] [Updated] (HADOOP-18192) Fix multiple_bindings warning about slf4j-reload4j

2022-04-05 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-18192: -- Fix Version/s: 3.2.4 Hadoop Flags: Reviewed Resolution: Fixed S

[jira] [Work logged] (HADOOP-18192) Fix multiple_bindings warning about slf4j-reload4j

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18192?focusedWorklogId=753189&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753189 ] ASF GitHub Bot logged work on HADOOP-18192: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-18192) Fix multiple_bindings warning about slf4j-reload4j

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18192?focusedWorklogId=753188&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753188 ] ASF GitHub Bot logged work on HADOOP-18192: --- Author: ASF GitHub B

[GitHub] [hadoop] iwasakims commented on pull request #4136: HADOOP-18192. Fix multiple_bindings warning about slf4j-reload4j.

2022-04-05 Thread GitBox
iwasakims commented on PR #4136: URL: https://github.com/apache/hadoop/pull/4136#issuecomment-1089828449 I merged this. Thanks, @aajisaka. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [hadoop] iwasakims merged pull request #4136: HADOOP-18192. Fix multiple_bindings warning about slf4j-reload4j.

2022-04-05 Thread GitBox
iwasakims merged PR #4136: URL: https://github.com/apache/hadoop/pull/4136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

[jira] [Updated] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-18188: --- Release Note: Before this improvement, "hadoop fs -touch" command threw PathIsDirectoryExce

[jira] [Commented] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517828#comment-17517828 ] Akira Ajisaka commented on HADOOP-18188: {quote}I mean if some application expe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4134: cherrypick hadoop 3.2.4 changes to branch 3.3.2

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4134: URL: https://github.com/apache/hadoop/pull/4134#issuecomment-1089763538 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18178) upgrade jackson-databind to 2.13.2.1 due to cve

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18178?focusedWorklogId=753181&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753181 ] ASF GitHub Bot logged work on HADOOP-18178: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4111: [HADOOP-18178] upgrade jackson due to cve

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4111: URL: https://github.com/apache/hadoop/pull/4111#issuecomment-1089722759 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] liubingxing commented on pull request #4032: HDFS-16484. [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2022-04-05 Thread GitBox
liubingxing commented on PR #4032: URL: https://github.com/apache/hadoop/pull/4032#issuecomment-1089698101 @tasanuma Could you please take a look at this. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [hadoop] singer-bin commented on a diff in pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-04-05 Thread GitBox
singer-bin commented on code in PR #4069: URL: https://github.com/apache/hadoop/pull/4069#discussion_r843403737 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java: ## @@ -891,13 +896,25 @@ private String reconfDfsUsageParameters

[GitHub] [hadoop] tasanuma commented on a diff in pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-04-05 Thread GitBox
tasanuma commented on code in PR #4069: URL: https://github.com/apache/hadoop/pull/4069#discussion_r843391276 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java: ## @@ -891,13 +896,25 @@ private String reconfDfsUsageParameters(S

[GitHub] [hadoop] tomscut commented on pull request #3960: HDFS-16446. Consider ioutils of disk when choosing volume

2022-04-05 Thread GitBox
tomscut commented on PR #3960: URL: https://github.com/apache/hadoop/pull/3960#issuecomment-1089636879 Hi @jojochuang @ayushtkn @tasanuma , I added a [document](https://docs.google.com/document/d/1Ko1J7shz8hVLnNACT6PKVQ_leIHf_YaIFA2s3yJMZHQ/edit?usp=sharing) for this. Could you please take

[GitHub] [hadoop] hadoop-yetus commented on pull request #4138: HDFS-16479. EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4138: URL: https://github.com/apache/hadoop/pull/4138#issuecomment-1089635411 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] tomscut commented on pull request #4087: HDFS-16513. [SBN read] Observer Namenode should not trigger the edits rolling of active Namenode

2022-04-05 Thread GitBox
tomscut commented on PR #4087: URL: https://github.com/apache/hadoop/pull/4087#issuecomment-1089631143 Hi @xkrogen, could you please also take a look? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop] hadoop-yetus commented on pull request #4143: Hadoop 16612 branch 2.10

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4143: URL: https://github.com/apache/hadoop/pull/4143#issuecomment-1089614692 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=753156&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753156 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2584: HADOOP-16202. Enhance openFile() for better read performance against object stores

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-1089573035 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] goiri commented on a diff in pull request #4127: HDFS-13522. RBF: Support observer node from Router-Based Federation

2022-04-05 Thread GitBox
goiri commented on code in PR #4127: URL: https://github.com/apache/hadoop/pull/4127#discussion_r843349699 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/NameNodeProxiesClient.java: ## @@ -349,6 +349,18 @@ public static ClientProtocol createProxy

[GitHub] [hadoop] hadoop-yetus commented on pull request #4143: Hadoop 16612 branch 2.10

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4143: URL: https://github.com/apache/hadoop/pull/4143#issuecomment-1089506856 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] arjun4084346 opened a new pull request, #4143: Hadoop 16612 branch 2.10

2022-04-05 Thread GitBox
arjun4084346 opened a new pull request, #4143: URL: https://github.com/apache/hadoop/pull/4143 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HA

[GitHub] [hadoop] hadoop-yetus commented on pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4069: URL: https://github.com/apache/hadoop/pull/4069#issuecomment-1089445520 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] sodonnel opened a new pull request, #4142: HDFS-16530. setReplication debug log creates a new string even if debug is disabled

2022-04-05 Thread GitBox
sodonnel opened a new pull request, #4142: URL: https://github.com/apache/hadoop/pull/4142 ### Description of PR In FSDirAttrOp, [HDFS-14521](https://issues.apache.org/jira/browse/HDFS-14521) made a good change to move a noisy logger to debug: ``` if (oldBR > targetRe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4141: HDFS-15382. Split one FsDatasetImpl lock to volume grain locks.

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4141: URL: https://github.com/apache/hadoop/pull/4141#issuecomment-1089355317 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-13294) Test hadoop fs shell against s3a; fix problems

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13294?focusedWorklogId=753092&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753092 ] ASF GitHub Bot logged work on HADOOP-13294: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4006: HADOOP-13294. Test hadoop fs shell against s3a

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4006: URL: https://github.com/apache/hadoop/pull/4006#issuecomment-1089305623 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18088) Replace log4j 1.x with reload4j

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=753088&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753088 ] ASF GitHub Bot logged work on HADOOP-18088: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4052: HADOOP-18088. Replace log4j 1.x with reload4j.

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4052: URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1089289734 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=753072&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753072 ] ASF GitHub Bot logged work on HADOOP-18188: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4135: HADOOP-18188. Support touch command for directory

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4135: URL: https://github.com/apache/hadoop/pull/4135#issuecomment-1089249207 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?focusedWorklogId=753064&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753064 ] ASF GitHub Bot logged work on HADOOP-18188: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4135: HADOOP-18188. Support touch command for directory

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4135: URL: https://github.com/apache/hadoop/pull/4135#issuecomment-1089235898 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] tasanuma commented on a diff in pull request #4138: HDFS-16479. EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2022-04-05 Thread GitBox
tasanuma commented on code in PR #4138: URL: https://github.com/apache/hadoop/pull/4138#discussion_r843121675 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java: ## @@ -2163,6 +2163,15 @@ BlockReconstructionWork sched

[jira] [Commented] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517616#comment-17517616 ] Daniel Carl Jones commented on HADOOP-18168: That makes sense, I will look

[GitHub] [hadoop] GauthamBanasandra merged pull request #4130: HDFS-16472. Make HDFS setrep tool cross platform

2022-04-05 Thread GitBox
GauthamBanasandra merged PR #4130: URL: https://github.com/apache/hadoop/pull/4130 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubsc

[jira] [Commented] (HADOOP-18159) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517566#comment-17517566 ] Steve Loughran commented on HADOOP-18159: - so we've come across something reall

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2022-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517548#comment-17517548 ] Steve Loughran commented on HADOOP-14837: - implementing getBlocklocations with

[jira] [Created] (HADOOP-18193) Support nested mount points in INodeTree

2022-04-05 Thread Lei Yang (Jira)
Lei Yang created HADOOP-18193: - Summary: Support nested mount points in INodeTree Key: HADOOP-18193 URL: https://issues.apache.org/jira/browse/HADOOP-18193 Project: Hadoop Common Issue Type: Impr

[jira] [Updated] (HADOOP-18193) Support nested mount points in INodeTree

2022-04-05 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HADOOP-18193: -- Description: Defining following client mount table config is not supported in  INodeTree and will th

[jira] [Commented] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517547#comment-17517547 ] Steve Loughran commented on HADOOP-18168: - it'll have to be requestor pays; i t

[GitHub] [hadoop] hadoop-yetus commented on pull request #4139: HDFS-16524. Add configuration to control blocks deletion asynchronous…

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4139: URL: https://github.com/apache/hadoop/pull/4139#issuecomment-1088935963 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?focusedWorklogId=752939&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752939 ] ASF GitHub Bot logged work on HADOOP-15327: --- Author: ASF GitHub B

[GitHub] [hadoop] 9uapaw commented on a diff in pull request #3259: HADOOP-15327. Upgrade MR ShuffleHandler to use Netty4

2022-04-05 Thread GitBox
9uapaw commented on code in PR #3259: URL: https://github.com/apache/hadoop/pull/3259#discussion_r842824343 ## hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java: ## @@ -1081,6 +1200,9 @@ pu

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=752932&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752932 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4140: HADOOP-18168. Fix S3A ITestMarkerTool dependency on purged public bucket

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-1088814822 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Comment Edited] (HADOOP-14837) Handle S3A "glacier" data

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516689#comment-17516689 ] Daniel Carl Jones edited comment on HADOOP-14837 at 4/5/22 2:07 PM: -

[GitHub] [hadoop] MingXiangLi opened a new pull request, #4141: HDFS-15382. Split one FsDatasetImpl lock to volume grain locks.

2022-04-05 Thread GitBox
MingXiangLi opened a new pull request, #4141: URL: https://github.com/apache/hadoop/pull/4141 https://issues.apache.org/jira/browse/HDFS-15382 have split lock to block pool grain and do some prepare.This pr is the last part of volume lock. -- This is an automated message from the Apache G

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #4138: HDFS-16479. EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2022-04-05 Thread GitBox
ayushtkn commented on code in PR #4138: URL: https://github.com/apache/hadoop/pull/4138#discussion_r842732623 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java: ## @@ -2163,6 +2163,15 @@ BlockReconstructionWork sched

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #4138: HDFS-16479. EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2022-04-05 Thread GitBox
ayushtkn commented on code in PR #4138: URL: https://github.com/apache/hadoop/pull/4138#discussion_r842732623 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java: ## @@ -2163,6 +2163,15 @@ BlockReconstructionWork sched

[jira] [Work logged] (HADOOP-18088) Replace log4j 1.x with reload4j

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=752834&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752834 ] ASF GitHub Bot logged work on HADOOP-18088: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4052: HADOOP-18088. Replace log4j 1.x with reload4j.

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4052: URL: https://github.com/apache/hadoop/pull/4052#issuecomment-1088642428 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=752827&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752827 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub B

[GitHub] [hadoop] dannycjones commented on a diff in pull request #4140: HADOOP-18168. Fix ITestMarkerTool dependency on purged public bucket

2022-04-05 Thread GitBox
dannycjones commented on code in PR #4140: URL: https://github.com/apache/hadoop/pull/4140#discussion_r842719171 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/tools/ITestMarkerTool.java: ## @@ -307,22 +309,25 @@ public void testRunLimitedAudit() throws Throwa

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=752818&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752818 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub B

[GitHub] [hadoop] monthonk commented on a diff in pull request #4140: HADOOP-18168. Fix ITestMarkerTool dependency on purged public bucket

2022-04-05 Thread GitBox
monthonk commented on code in PR #4140: URL: https://github.com/apache/hadoop/pull/4140#discussion_r842712497 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/tools/ITestMarkerTool.java: ## @@ -307,22 +309,25 @@ public void testRunLimitedAudit() throws Throwable

[jira] [Work started] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-18188 started by Viraj Jasani. - > Support touch command for directory > ---

[jira] [Updated] (HADOOP-18188) Support touch command for directory

2022-04-05 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18188: -- Status: Patch Available (was: In Progress) > Support touch command for directory > -

[GitHub] [hadoop] virajjasani commented on pull request #4108: HDFS-16522. Set Http and Ipc ports for Datanodes in MiniDFSCluster

2022-04-05 Thread GitBox
virajjasani commented on PR #4108: URL: https://github.com/apache/hadoop/pull/4108#issuecomment-1088608439 Thank you @aajisaka for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4138: HDFS-16479. EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4138: URL: https://github.com/apache/hadoop/pull/4138#issuecomment-1088580271 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=752756&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752756 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4140: HADOOP-18168. Fix ITestMarkerTool dependency on purged public bucket

2022-04-05 Thread GitBox
hadoop-yetus commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-1088579574 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18191) Log retry count while handling exceptions in RetryInvocationHandler

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18191?focusedWorklogId=752753&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752753 ] ASF GitHub Bot logged work on HADOOP-18191: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani commented on pull request #4133: HADOOP-18191. Log retry count while handling exceptions in RetryInvocationHandler

2022-04-05 Thread GitBox
virajjasani commented on PR #4133: URL: https://github.com/apache/hadoop/pull/4133#issuecomment-1088570118 @tasanuma @Hexiaoqiao Could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] (HADOOP-17784) hadoop-aws landsat-pds test bucket will be deleted after Jul 1, 2021

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17784 ] Daniel Carl Jones deleted comment on HADOOP-17784: was (Author: JIRAUSER284792): ITestMarkerTool depended on landast-pds containing many objects. > hadoop-aws landsat-pds test bucke

[jira] [Commented] (HADOOP-17784) hadoop-aws landsat-pds test bucket will be deleted after Jul 1, 2021

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517374#comment-17517374 ] Daniel Carl Jones commented on HADOOP-17784: ITestMarkerTool depended on la

[jira] [Commented] (HADOOP-17784) hadoop-aws landsat-pds test bucket will be deleted after Jul 1, 2021

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517372#comment-17517372 ] Daniel Carl Jones commented on HADOOP-17784: Current status is that the buc

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=752738&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752738 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub B

[GitHub] [hadoop] dannycjones commented on pull request #4140: HADOOP-18168. Fix ITestMarkerTool dependency on purged public bucket

2022-04-05 Thread GitBox
dannycjones commented on PR #4140: URL: https://github.com/apache/hadoop/pull/4140#issuecomment-1088532872 Integration tests passing against `eu-west-1` bucket and EC2 instance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517351#comment-17517351 ] Daniel Carl Jones commented on HADOOP-18168: [~ste...@apache.org] I'm think

[jira] [Work logged] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?focusedWorklogId=752731&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752731 ] ASF GitHub Bot logged work on HADOOP-18168: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18168: Labels: pull-request-available (was: ) > ITestMarkerTool.testRunLimitedLandsatAudit fail

[GitHub] [hadoop] dannycjones opened a new pull request, #4140: HADOOP-18168. Fix ITestMarkerTool dependency on purged public bucket

2022-04-05 Thread GitBox
dannycjones opened a new pull request, #4140: URL: https://github.com/apache/hadoop/pull/4140 ### Description of PR Addressing HADOOP-18168, this change replaces the use of `landsat-pds` with [commoncrawl](https://registry.opendata.aws/commoncrawl/), another public dataset. `landsat-

[jira] [Assigned] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-04-05 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones reassigned HADOOP-18168: -- Assignee: Daniel Carl Jones > ITestMarkerTool.testRunLimitedLandsatAudit fai

[GitHub] [hadoop] tomscut commented on pull request #4129: HDFS-16527. Add global timeout rule for TestRouterDistCpProcedure

2022-04-05 Thread GitBox
tomscut commented on PR #4129: URL: https://github.com/apache/hadoop/pull/4129#issuecomment-1088428181 Thanks @aajisaka for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [hadoop] aajisaka commented on a diff in pull request #4132: HDFS-16384. Upgrade Netty to 4.1.72.Final

2022-04-05 Thread GitBox
aajisaka commented on code in PR #4132: URL: https://github.com/apache/hadoop/pull/4132#discussion_r842501521 ## LICENSE-binary: ## @@ -261,7 +261,7 @@ io.grpc:grpc-protobuf:1.26.0 io.grpc:grpc-protobuf-lite:1.26.0 io.grpc:grpc-stub:1.26.0 io.netty:netty:3.10.6.Final -io.nett

[GitHub] [hadoop] ted12138 opened a new pull request, #4139: HDFS-16524. Add configuration to control blocks deletion asynchronous…

2022-04-05 Thread GitBox
ted12138 opened a new pull request, #4139: URL: https://github.com/apache/hadoop/pull/4139 … or synchronous ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA

[GitHub] [hadoop] tomscut commented on pull request #4035: HDFS-16488. [SPS]: Expose metrics to JMX for external SPS

2022-04-05 Thread GitBox
tomscut commented on PR #4035: URL: https://github.com/apache/hadoop/pull/4035#issuecomment-1088356041 Hi @umamaheswararao @ayushtkn @tasanuma @ferhui , could you please take a look? Thank you very much. -- This is an automated message from the Apache Git Service. To respond to th