[jira] [Created] (HADOOP-18298) Hadoop AWS | Staging committer Multipartupload not implemented properly

2022-06-16 Thread Ayush Goyal (Jira)
Ayush Goyal created HADOOP-18298: Summary: Hadoop AWS | Staging committer Multipartupload not implemented properly Key: HADOOP-18298 URL: https://issues.apache.org/jira/browse/HADOOP-18298 Project:

[jira] [Closed] (HADOOP-12446) Undeprecate createNonRecursive()

2022-06-16 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell closed HADOOP-12446. > Undeprecate createNonRecursive() > > >

[GitHub] [hadoop] slfan1989 commented on pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

2022-06-16 Thread GitBox
slfan1989 commented on PR #4435: URL: https://github.com/apache/hadoop/pull/4435#issuecomment-1158503105 @LennonChin LGTM. Thanks for your contribution, it looks like it's working well, let's wait for other buddies' suggestions. -- This is an automated message from the Apache Git

[GitHub] [hadoop] LennonChin commented on pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

2022-06-16 Thread GitBox
LennonChin commented on PR #4435: URL: https://github.com/apache/hadoop/pull/4435#issuecomment-1158471384 > > @slfan1989 @dineshchitlangia @brumi1024 @9uapaw @ashutoshcipher Could you please to help review the code? > > I understand your change, and it seems feasible, can we give the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4127: HDFS-13522. RBF: Support observer node from Router-Based Federation

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4127: URL: https://github.com/apache/hadoop/pull/4127#issuecomment-1158450996 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782233=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782233 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4433: URL: https://github.com/apache/hadoop/pull/4433#issuecomment-1158442052 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #4422: HADOOP-18284. Remove Unnecessary semicolon ';'

2022-06-16 Thread GitBox
slfan1989 commented on PR #4422: URL: https://github.com/apache/hadoop/pull/4422#issuecomment-1158438583 @ayushtkn please help me to review this pr, thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-18284) Remove Unnecessary semicolon ';'

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18284?focusedWorklogId=782230=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782230 ] ASF GitHub Bot logged work on HADOOP-18284: --- Author: ASF GitHub Bot

[GitHub] [hadoop] lfxy closed pull request #4391: HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks

2022-06-16 Thread GitBox
lfxy closed pull request #4391: HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks URL: https://github.com/apache/hadoop/pull/4391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] lfxy commented on pull request #4398: HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks

2022-06-16 Thread GitBox
lfxy commented on PR #4398: URL: https://github.com/apache/hadoop/pull/4398#issuecomment-1158429085 @hi-adachi OK, I see, thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Work logged] (HADOOP-18106) Handle memory fragmentation in S3 Vectored IO implementation.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18106?focusedWorklogId=782221=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782221 ] ASF GitHub Bot logged work on HADOOP-18106: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4445: HADOOP-18106: Handle memory fragmentation in S3A Vectored IO.

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4445: URL: https://github.com/apache/hadoop/pull/4445#issuecomment-1158395112 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #4440: MAPREDUCE-7389. Fix typo in description of property

2022-06-16 Thread GitBox
slfan1989 commented on PR #4440: URL: https://github.com/apache/hadoop/pull/4440#issuecomment-1158394168 @ayushtkn Please help review this pr, thank you very much! ayushtkn is a very good mentor. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HADOOP-18277) Remove org.apache.hadoop.test#Whitebox Deprecated Annotation

2022-06-16 Thread fanshilun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555349#comment-17555349 ] fanshilun commented on HADOOP-18277: [~weichiu] Thank you very much for helping to review the code,

[GitHub] [hadoop] slfan1989 commented on pull request #4354: YARN-6539. Create SecureLogin inside Router.

2022-06-16 Thread GitBox
slfan1989 commented on PR #4354: URL: https://github.com/apache/hadoop/pull/4354#issuecomment-1158381593 LGTM +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] slfan1989 commented on pull request #4437: YARN-11179. Show more detailed info when container token is expired

2022-06-16 Thread GitBox
slfan1989 commented on PR #4437: URL: https://github.com/apache/hadoop/pull/4437#issuecomment-1158380856 @zuston It seems that the plan is reasonable, can we also put the user information contained in the token in the messageBuilder? -- This is an automated message from the Apache Git

[GitHub] [hadoop] slfan1989 commented on pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

2022-06-16 Thread GitBox
slfan1989 commented on PR #4435: URL: https://github.com/apache/hadoop/pull/4435#issuecomment-1158379831 > @slfan1989 @dineshchitlangia @brumi1024 @9uapaw @ashutoshcipher Could you please to help review the code? I understand your change, and it seems feasible, can we give the data

[jira] [Work logged] (HADOOP-18297) Upgrade dependency-check-maven to 7.1.1

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18297?focusedWorklogId=782208=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782208 ] ASF GitHub Bot logged work on HADOOP-18297: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18297) Upgrade dependency-check-maven to 7.1.1

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18297: Labels: pull-request-available (was: ) > Upgrade dependency-check-maven to 7.1.1 >

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4449: HADOOP-18297. Upgrade dependency-check-maven to 7.1.1

2022-06-16 Thread GitBox
ashutoshcipher opened a new pull request, #4449: URL: https://github.com/apache/hadoop/pull/4449 ### Description of PR Upgrade dependency-check-maven to 7.1.1 The OWASP dependency-check-maven Plugin version has corrected various false positives in 7.1.1. We can upgrade to it.

[GitHub] [hadoop] slfan1989 commented on pull request #4435: YARN-11178. Avoid CPU busy idling and resource wasting in DelegationTokenRenewerPoolTracker thread

2022-06-16 Thread GitBox
slfan1989 commented on PR #4435: URL: https://github.com/apache/hadoop/pull/4435#issuecomment-1158378152 > @slfan1989 @dineshchitlangia @brumi1024 @9uapaw @ashutoshcipher Could you please to help review the code? I have understood your changes, but can the token also add some user

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782206=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782206 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18297) Upgrade dependency-check-maven to 7.1.1

2022-06-16 Thread Ashutosh Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Gupta updated HADOOP-18297: Description: The OWASP dependency-check-maven Plugin version has corrected various false

[GitHub] [hadoop] slfan1989 commented on pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
slfan1989 commented on PR #4433: URL: https://github.com/apache/hadoop/pull/4433#issuecomment-1158377242 @jojochuang Thank you very much for your help reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Created] (HADOOP-18297) Upgrade dependency-check-maven to 7.1.1

2022-06-16 Thread Ashutosh Gupta (Jira)
Ashutosh Gupta created HADOOP-18297: --- Summary: Upgrade dependency-check-maven to 7.1.1 Key: HADOOP-18297 URL: https://issues.apache.org/jira/browse/HADOOP-18297 Project: Hadoop Common

[jira] [Commented] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread fanshilun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555341#comment-17555341 ] fanshilun commented on HADOOP-18289: [~weichiu] Thank you very much for your help reviewing the

[jira] [Resolved] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18289. -- Fix Version/s: 3.4.0 Resolution: Fixed Done. Thanks [~slfan1989] > Remove

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782201=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782201 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782202=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782202 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani opened a new pull request, #4448: HDFS-16634. Dynamically adjust slow peer report size on JMX metrics

2022-06-16 Thread GitBox
virajjasani opened a new pull request, #4448: URL: https://github.com/apache/hadoop/pull/4448 ### Description of PR On a busy cluster, sometimes it takes bit of time for deleted node(from the cluster)'s "slow node report" to get removed from slow peer json report on Namenode JMX

[GitHub] [hadoop] jojochuang commented on pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
jojochuang commented on PR #4433: URL: https://github.com/apache/hadoop/pull/4433#issuecomment-1158366547 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] jojochuang merged pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
jojochuang merged PR #4433: URL: https://github.com/apache/hadoop/pull/4433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4311: URL: https://github.com/apache/hadoop/pull/4311#issuecomment-1158361679 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hi-adachi commented on pull request #4398: HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks

2022-06-16 Thread GitBox
hi-adachi commented on PR #4398: URL: https://github.com/apache/hadoop/pull/4398#issuecomment-1158359483 @lfxy The PR was merged, this is just FYI, the contribution guide says as follows. Thank you for your contribution. >

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782189=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782189 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
slfan1989 commented on code in PR #4433: URL: https://github.com/apache/hadoop/pull/4433#discussion_r899644835 ## hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java: ## @@ -40,6 +41,7 @@ import org.junit.Rule; import

[GitHub] [hadoop] slfan1989 commented on pull request #4426: YARN-10883. [Router] Router Audit Log Add Client IP Address.

2022-06-16 Thread GitBox
slfan1989 commented on PR #4426: URL: https://github.com/apache/hadoop/pull/4426#issuecomment-1158271661 @goiri Please help me to review the code again, Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782185=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782185 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on a diff in pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
jojochuang commented on code in PR #4433: URL: https://github.com/apache/hadoop/pull/4433#discussion_r899633528 ## hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java: ## @@ -40,6 +41,7 @@ import org.junit.Rule; import

[jira] [Work logged] (HADOOP-18294) Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18294?focusedWorklogId=782184=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782184 ] ASF GitHub Bot logged work on HADOOP-18294: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4446: HADOOP-18294.Ensure build folder exists before writing checksum file.…

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4446: URL: https://github.com/apache/hadoop/pull/4446#issuecomment-1158246105 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] jojochuang commented on a diff in pull request #4252: HDFS-16566 Erasure Coding: Recovery may causes excess replicas when busy DN exsits

2022-06-16 Thread GitBox
jojochuang commented on code in PR #4252: URL: https://github.com/apache/hadoop/pull/4252#discussion_r899627843 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java: ## @@ -1040,11 +1040,16 @@ public static BlockECReconstructionInfo

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782182=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782182 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[GitHub] [hadoop] slfan1989 commented on pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
slfan1989 commented on PR #4433: URL: https://github.com/apache/hadoop/pull/4433#issuecomment-1158239124 @jojochuang Please help me to review the code again, thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18258) Merging of S3A Audit Logs

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18258?focusedWorklogId=782178=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782178 ] ASF GitHub Bot logged work on HADOOP-18258: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4383: HADOOP-18258. Merging of S3A Audit Logs

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4383: URL: https://github.com/apache/hadoop/pull/4383#issuecomment-1158185507 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18295) Add S3A configuration property for `no_proxy` hosts

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555317#comment-17555317 ] Mukund Thakur commented on HADOOP-18295: I don't understand the use case for this. Could you

[GitHub] [hadoop] hadoop-yetus commented on pull request #4447: HDFS-16591. Setup JaasConfiguration in ZKCuratorManager when SASL is …

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4447: URL: https://github.com/apache/hadoop/pull/4447#issuecomment-1158170997 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4410: HDFS-16064. Determine when to invalidate corrupt replicas based on number of usable replicas

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4410: URL: https://github.com/apache/hadoop/pull/4410#issuecomment-1158158938 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ashutoshcipher commented on pull request #4377: YARN-11115. Add configuration to globally disable AM preemption for capacity scheduler

2022-06-16 Thread GitBox
ashutoshcipher commented on PR #4377: URL: https://github.com/apache/hadoop/pull/4377#issuecomment-1158140767 @aajisaka - Can you please review this PR and can I add a test case as part of a separate JIRA? Thanks. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] ashutoshcipher commented on pull request #4377: YARN-11115. Add configuration to disable AM preemption for capacity scheduler

2022-06-16 Thread GitBox
ashutoshcipher commented on PR #4377: URL: https://github.com/apache/hadoop/pull/4377#issuecomment-1158139739 I tried running failed test `TestClientRMTokens` multiple times in my local - working fine. Test failure can be ignored. ``` [INFO] T E S T S [INFO]

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555298#comment-17555298 ] Mukund Thakur commented on HADOOP-18296: Fixing this is challenging as checksum matching code

[jira] [Updated] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18296: --- Labels: fs (was: ) > Memory fragmentation in ChecksumFileSystem Vectored IO

[jira] [Created] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2022-06-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18296: -- Summary: Memory fragmentation in ChecksumFileSystem Vectored IO implementation. Key: HADOOP-18296 URL: https://issues.apache.org/jira/browse/HADOOP-18296

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=782154=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782154 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2022-06-16 Thread GitBox
mukund-thakur commented on PR #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-1158095301 LGTM +1 Thanks @steveloughran, there are 3 pending checkstyle issue though. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HADOOP-18227) Add IOstats and auditing for vectored IO api.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18227: --- Summary: Add IOstats and auditing for vectored IO api. (was: Add IOstats for vectored IO

[jira] [Resolved] (HADOOP-18105) Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18105. Resolution: Fixed Merged in feature branch 

[jira] [Resolved] (HADOOP-18107) Vectored IO support for large S3 files.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18107. Resolution: Fixed Merged in feature branch 

[jira] [Work started] (HADOOP-18103) High performance vectored read API in Hadoop

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-18103 started by Mukund Thakur. -- > High performance vectored read API in Hadoop >

[jira] [Work logged] (HADOOP-18289) Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18289?focusedWorklogId=782149=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782149 ] ASF GitHub Bot logged work on HADOOP-18289: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4433: HADOOP-18289. Remove WhiteBox in hadoop-kms module.

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4433: URL: https://github.com/apache/hadoop/pull/4433#issuecomment-1158054642 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] jojochuang merged pull request #4398: HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks

2022-06-16 Thread GitBox
jojochuang merged PR #4398: URL: https://github.com/apache/hadoop/pull/4398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4439: YARN-11182. Refactor TestAggregatedLogDeletionService: 2nd phase

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4439: URL: https://github.com/apache/hadoop/pull/4439#issuecomment-1157965886 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hchaverri opened a new pull request, #4447: HDFS-16591. Setup JaasConfiguration in ZKCuratorManager when SASL is …

2022-06-16 Thread GitBox
hchaverri opened a new pull request, #4447: URL: https://github.com/apache/hadoop/pull/4447 …enabled ### Description of PR Setting up the JaasConfiguration when creating a new ZKCuratorManager, to allow ZK connections via SASL. Also removing duplicated classes of

[GitHub] [hadoop] hadoop-yetus commented on pull request #4377: YARN-11115. Add configuration to disable AM preemption for capacity scheduler

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4377: URL: https://github.com/apache/hadoop/pull/4377#issuecomment-1157923214 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18258) Merging of S3A Audit Logs

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18258?focusedWorklogId=782102=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782102 ] ASF GitHub Bot logged work on HADOOP-18258: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4383: HADOOP-18258. Merging of S3A Audit Logs

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4383: URL: https://github.com/apache/hadoop/pull/4383#issuecomment-1157867827 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #4375: HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle.

2022-06-16 Thread GitBox
slfan1989 commented on PR #4375: URL: https://github.com/apache/hadoop/pull/4375#issuecomment-1157862822 @goiri Can you help me merge this pr to trunk branch? Thanks for helping me review the code! -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] slfan1989 commented on pull request #4421: YARN-10122. Support signalToContainer API for Federation.

2022-06-16 Thread GitBox
slfan1989 commented on PR #4421: URL: https://github.com/apache/hadoop/pull/4421#issuecomment-1157860955 @goiri Can you help me merge this pr to trunk branch? thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] szilard-nemeth commented on pull request #4439: YARN-11182. Refactor TestAggregatedLogDeletionService: 2nd phase

2022-06-16 Thread GitBox
szilard-nemeth commented on PR #4439: URL: https://github.com/apache/hadoop/pull/4439#issuecomment-1157840884 Will wait for Jenkins to check how many Checkstyle and other issues remained after refactoring the builder vs. the actual testcase logic. -- This is an automated message from the

[GitHub] [hadoop] simbadzina commented on pull request #4441: HDFS-13522. IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
simbadzina commented on PR #4441: URL: https://github.com/apache/hadoop/pull/4441#issuecomment-1157792454 @ZanderXu is https://github.com/apache/hadoop/pull/4127 I have configurations on both the router and client side. Consistency is also guaranteed because the router always does an

[jira] [Work logged] (HADOOP-18294) Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18294?focusedWorklogId=782074=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782074 ] ASF GitHub Bot logged work on HADOOP-18294: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4446: HADOOP-18294.Ensure build folder exists before writing checksum file.…

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4446: URL: https://github.com/apache/hadoop/pull/4446#issuecomment-1157784882 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] simbadzina commented on pull request #4441: HDFS-13522. IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
simbadzina commented on PR #4441: URL: https://github.com/apache/hadoop/pull/4441#issuecomment-1157784867 > Thanks @zhengchenyu and @simbadzina . > > > I think config in client side may be more flexible. > > This is a very meaningful topic. If only the client controls whether

[GitHub] [hadoop] ZanderXu commented on pull request #4441: HDFS-13522. IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
ZanderXu commented on PR #4441: URL: https://github.com/apache/hadoop/pull/4441#issuecomment-1157696846 > We know observer can not guarantee strong consistency, maybe some use have high demand, they wanna disable observe read, though few user have this demand. Only a very small

[jira] [Created] (HADOOP-18295) Add S3A configuration property for `no_proxy` hosts

2022-06-16 Thread Sam Kramer (Jira)
Sam Kramer created HADOOP-18295: --- Summary: Add S3A configuration property for `no_proxy` hosts Key: HADOOP-18295 URL: https://issues.apache.org/jira/browse/HADOOP-18295 Project: Hadoop Common

[GitHub] [hadoop] zhengchenyu commented on pull request #4441: HDFS-13522. IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
zhengchenyu commented on PR #4441: URL: https://github.com/apache/hadoop/pull/4441#issuecomment-1157672472 > Thanks @zhengchenyu and @simbadzina . > > > I think config in client side may be more flexible. > > This is a very meaningful topic. If only the client controls whether

[jira] [Updated] (HADOOP-18294) Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18294: Labels: pull-request-available (was: ) > Ensure build folder exists before writing

[jira] [Work logged] (HADOOP-18294) Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18294?focusedWorklogId=782048=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782048 ] ASF GitHub Bot logged work on HADOOP-18294: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4446: HADOOP-18294.Ensure build folder exists before writing checksum file.…

2022-06-16 Thread GitBox
ashutoshcipher opened a new pull request, #4446: URL: https://github.com/apache/hadoop/pull/4446 ### Description of PR Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums * JIRA: HADOOP-18294 - [x] Does the title or this PR starts with the

[jira] [Created] (HADOOP-18294) Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums

2022-06-16 Thread Ashutosh Gupta (Jira)
Ashutosh Gupta created HADOOP-18294: --- Summary: Ensure build folder exists before writing checksum file.ProtocRunner#writeChecksums Key: HADOOP-18294 URL: https://issues.apache.org/jira/browse/HADOOP-18294

[GitHub] [hadoop] KevinWikant commented on pull request #4410: HDFS-16064. Determine when to invalidate corrupt replicas based on number of usable replicas

2022-06-16 Thread GitBox
KevinWikant commented on PR #4410: URL: https://github.com/apache/hadoop/pull/4410#issuecomment-1157654335 @ashutoshcipher @aajisaka @ZanderXu really appreciate the reviews on this PR, thank you! @aajisaka I have removed the unused imports, please let me know if you have any other

[jira] [Work logged] (HADOOP-18288) Total requests and total requests per sec served by RPC servers

2022-06-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18288?focusedWorklogId=782037=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782037 ] ASF GitHub Bot logged work on HADOOP-18288: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4431: HADOOP-18288. Total requests and total requests per sec served by RPC servers

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4431: URL: https://github.com/apache/hadoop/pull/4431#issuecomment-1157635614 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] tomscut commented on pull request #4321: HDFS-16581. Print node status when executing printTopology

2022-06-16 Thread GitBox
tomscut commented on PR #4321: URL: https://github.com/apache/hadoop/pull/4321#issuecomment-1157563468 Thanks @jianghuazhu for your contribution. Thanks @virajjasani for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] tomscut merged pull request #4321: HDFS-16581. Print node status when executing printTopology

2022-06-16 Thread GitBox
tomscut merged PR #4321: URL: https://github.com/apache/hadoop/pull/4321 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] ZanderXu commented on pull request #4441: HDFS-13522. IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
ZanderXu commented on PR #4441: URL: https://github.com/apache/hadoop/pull/4441#issuecomment-1157530100 As in my draft PR above, RBF always updates lastSeenTxid from Active and saves. When an NS enable ObserverRead, RBF will set the stored lastSeenTxid of this NS to the RPC header and

[GitHub] [hadoop] ZanderXu commented on pull request #4441: HDFS-13522. IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
ZanderXu commented on PR #4441: URL: https://github.com/apache/hadoop/pull/4441#issuecomment-1157525096 Thanks @zhengchenyu and @simbadzina . > I think config in client side may be more flexible. This is a very meaningful topic. If only the client controls whether or not to

[GitHub] [hadoop] hadoop-yetus commented on pull request #4127: HDFS-13522. RBF: Support observer node from Router-Based Federation

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4127: URL: https://github.com/apache/hadoop/pull/4127#issuecomment-1157494963 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4367: HDFS-16600. Fix deadlock on DataNode side.

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4367: URL: https://github.com/apache/hadoop/pull/4367#issuecomment-1157483601 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18293) Release Hadoop 3.3.4 critical fix update

2022-06-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18293: Description: Create a new release off the branch-3.3.3 line with a few more changes *

[jira] [Commented] (HADOOP-18293) Release Hadoop 3.3.4 critical fix update

2022-06-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554997#comment-17554997 ] Steve Loughran commented on HADOOP-18293: - follow on to HADOOP-18198 > Release Hadoop 3.3.4

[jira] [Created] (HADOOP-18293) Release Hadoop 3.3.4 critical fix update

2022-06-16 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18293: --- Summary: Release Hadoop 3.3.4 critical fix update Key: HADOOP-18293 URL: https://issues.apache.org/jira/browse/HADOOP-18293 Project: Hadoop Common

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2022-06-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554991#comment-17554991 ] Steve Loughran commented on HADOOP-18028: - update on this: I can see that some things are going

[GitHub] [hadoop] lfxy commented on pull request #4398: HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks

2022-06-16 Thread GitBox
lfxy commented on PR #4398: URL: https://github.com/apache/hadoop/pull/4398#issuecomment-1157448224 @hi-adachi . Excuse me, what is the next process? Will this PR be merged into the trunk branch? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4311: URL: https://github.com/apache/hadoop/pull/4311#issuecomment-1157387445 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] Samrat002 commented on pull request #4400: HDFS-16616. remove use of org.apache.hadoop.util.Sets

2022-06-16 Thread GitBox
Samrat002 commented on PR #4400: URL: https://github.com/apache/hadoop/pull/4400#issuecomment-1157313860 - hadoop-hdfs in trunk failed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu0.20.04.1. failed for `trunk` and the `patch` - All Test passed . Please review the pr Thanks

[GitHub] [hadoop] hadoop-yetus commented on pull request #4400: HDFS-16616. remove use of org.apache.hadoop.util.Sets

2022-06-16 Thread GitBox
hadoop-yetus commented on PR #4400: URL: https://github.com/apache/hadoop/pull/4400#issuecomment-1157289843 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

  1   2   >