[jira] [Work logged] (HADOOP-17430) Restore ability to set Text to empty byte array

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17430?focusedWorklogId=532936=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532936 ] ASF GitHub Bot logged work on HADOOP-17430: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2575: HADOOP-16080. hadoop-aws does not work with hadoop-client-api

2021-01-08 Thread GitBox
steveloughran commented on pull request #2575: URL: https://github.com/apache/hadoop/pull/2575#issuecomment-756757565 Ignoring the s3guard/ddb ones (we're clearly still trying to run some when those tests aren't enabled), you are going to be seeing the failures covered in

[jira] [Work logged] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?focusedWorklogId=533011=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533011 ] ASF GitHub Bot logged work on HADOOP-16080: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17347) ABFS: Optimise read for small files/tails of files

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=533015=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533015 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2583: HDFS-15549. Improve DISK/ARCHIVE movement if they are on same filesystem

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2583: URL: https://github.com/apache/hadoop/pull/2583#issuecomment-756766090 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=532904=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532904 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith opened a new pull request #2607: DRAFT PR HADOOP-17459. ADLS Gen1: Fixes for rename contract tests

2021-01-08 Thread GitBox
bilaharith opened a new pull request #2607: URL: https://github.com/apache/hadoop/pull/2607 Fix the following test case failures which are failing after the contract test update in hadoop-common [ERROR] Failures: [ERROR]

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-08 Thread GitBox
vinaysbadami commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r553852099 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,107 @@ +/**

[jira] [Updated] (HADOOP-17459) Fix the test case failures which are failing after the contract test update in hadoop-common

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17459: Labels: pull-request-available (was: ) > Fix the test case failures which are failing

[jira] [Work logged] (HADOOP-17459) Fix the test case failures which are failing after the contract test update in hadoop-common

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17459?focusedWorklogId=532921=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532921 ] ASF GitHub Bot logged work on HADOOP-17459: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17459) Fix the test case failures which are failing after the contract test update in hadoop-common

2021-01-08 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-17459: -- Summary: Fix the test case failures which are failing after the contract test update in

[GitHub] [hadoop] bgaborg commented on a change in pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-08 Thread GitBox
bgaborg commented on a change in pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#discussion_r553870733 ## File path: hadoop-common-project/hadoop-common/src/main/resources/core-default.xml ## @@ -1873,11 +1873,9 @@ fs.s3a.committer.magic.enabled -

[GitHub] [hadoop] hadoop-yetus commented on pull request #2607: DRAFT PR HADOOP-17459. ADLS Gen1: Fixes for rename contract tests

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2607: URL: https://github.com/apache/hadoop/pull/2607#issuecomment-756702912 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17460) s3guard tool dumpStorageStatistics to move to IOStatistics

2021-01-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17460: --- Summary: s3guard tool dumpStorageStatistics to move to IOStatistics Key: HADOOP-17460 URL: https://issues.apache.org/jira/browse/HADOOP-17460 Project: Hadoop

[jira] [Created] (HADOOP-17459) Fix the test case failures after the contract test update in hadoop-common

2021-01-08 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-17459: - Summary: Fix the test case failures after the contract test update in hadoop-common Key: HADOOP-17459 URL: https://issues.apache.org/jira/browse/HADOOP-17459

[jira] [Updated] (HADOOP-17347) ABFS: Optimise read for small files/tails of files

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17347: Summary: ABFS: Optimise read for small files/tails of files (was: ABFS: Read

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=532941=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532941 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?focusedWorklogId=533023=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533023 ] ASF GitHub Bot logged work on HADOOP-16080: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2575: HADOOP-16080. hadoop-aws does not work with hadoop-client-api

2021-01-08 Thread GitBox
steveloughran commented on pull request #2575: URL: https://github.com/apache/hadoop/pull/2575#issuecomment-756762795 something went wrong with yetus; try a rebase and forced push This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on pull request #2606: HADOOP-15760: updated to commons-collections4

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2606: URL: https://github.com/apache/hadoop/pull/2606#issuecomment-756726785 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-756772717 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17444) ADLFS: Update SDK version from 2.3.6 to 2.3.9

2021-01-08 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-17444: -- Fix Version/s: (was: 3.4.0) > ADLFS: Update SDK version from 2.3.6 to 2.3.9 >

[jira] [Resolved] (HADOOP-17347) ABFS: Optimise read for small files/tails of files

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17347. - Fix Version/s: 3.4.0 Resolution: Fixed IF this is to target branch-3.3 then

[jira] [Work logged] (HADOOP-17459) Fix the test case failures which are failing after the contract test update in hadoop-common

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17459?focusedWorklogId=532960=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532960 ] ASF GitHub Bot logged work on HADOOP-17459: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-15760) Include Apache Commons Collections4

2021-01-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261270#comment-17261270 ] Hadoop QA commented on HADOOP-15760: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work logged] (HADOOP-15760) Include Apache Commons Collections4

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?focusedWorklogId=532993=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532993 ] ASF GitHub Bot logged work on HADOOP-15760: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17347) ABFS: Optimise read for small files/tails of files

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261211#comment-17261211 ] Steve Loughran commented on HADOOP-17347: - I'm assuming its driven a bit by the read sequence

[GitHub] [hadoop] lujiefsi opened a new pull request #2608: YARN-10555. missing access check before getAppAttempts

2021-01-08 Thread GitBox
lujiefsi opened a new pull request #2608: URL: https://github.com/apache/hadoop/pull/2608 see https://issues.apache.org/jira/browse/YARN-10555 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] steveloughran commented on pull request #2545: HADOOP-17430. Add clear bytes logic for hadoop Text

2021-01-08 Thread GitBox
steveloughran commented on pull request #2545: URL: https://github.com/apache/hadoop/pull/2545#issuecomment-756690095 sorry, was my cherrypick which broke it. reverted This is an automated message from the Apache Git

[GitHub] [hadoop] steveloughran commented on pull request #2464: HADOOP-17347. ABFS: Read optimizations

2021-01-08 Thread GitBox
steveloughran commented on pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#issuecomment-756759257 It's moot now that the PR is merged, but can I remind everyone ## Add a meaningful message to assertTrue/assertFalse asserts Imagine that you are trying to

[GitHub] [hadoop] iwasakims commented on a change in pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-08 Thread GitBox
iwasakims commented on a change in pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#discussion_r553959171 ## File path:

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=532911=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532911 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2470: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2470: URL: https://github.com/apache/hadoop/pull/2470#issuecomment-756653114 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] bibinchundatt commented on pull request #2564: YARN-10538: Add RECOMMISSIONING nodes to the list of updated nodes returned to the AM

2021-01-08 Thread GitBox
bibinchundatt commented on pull request #2564: URL: https://github.com/apache/hadoop/pull/2564#issuecomment-756648023 Committed to trunk and branch-3.3 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-756614368 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] sumangala-patki commented on pull request #2597: HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results

2021-01-08 Thread GitBox
sumangala-patki commented on pull request #2597: URL: https://github.com/apache/hadoop/pull/2597#issuecomment-756625767 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS OAuth [INFO] Tests run: 89, Failures: 0,

[jira] [Commented] (HADOOP-15760) Include Apache Commons Collections4

2021-01-08 Thread Pradyumn Agrawal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261123#comment-17261123 ] Pradyumn Agrawal commented on HADOOP-15760: --- Don't know why, but above build log is pointing

[jira] [Comment Edited] (HADOOP-15760) Include Apache Commons Collections4

2021-01-08 Thread Pradyumn Agrawal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261123#comment-17261123 ] Pradyumn Agrawal edited comment on HADOOP-15760 at 1/8/21, 8:40 AM:

[jira] [Updated] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13551: Summary: Collect AwsSdkMetrics in S3A FileSystem IOStatistics (was: hook up

[jira] [Created] (HADOOP-17461) Add thread-level IOStatistics Context

2021-01-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17461: --- Summary: Add thread-level IOStatistics Context Key: HADOOP-17461 URL: https://issues.apache.org/jira/browse/HADOOP-17461 Project: Hadoop Common Issue

[jira] [Work logged] (HADOOP-17451) intermittent failure of S3A tests which make assertions on statistics/IOStatistics

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17451?focusedWorklogId=533158=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533158 ] ASF GitHub Bot logged work on HADOOP-17451: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?focusedWorklogId=533172=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533172 ] ASF GitHub Bot logged work on HADOOP-17462: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17462: Labels: pull-request-available (was: ) > Hadoop Client getRpcResponse May Return Wrong

[jira] [Work logged] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?focusedWorklogId=533175=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533175 ] ASF GitHub Bot logged work on HADOOP-17408: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17451) intermittent failure of S3A tests which make assertions on statistics/IOStatistics

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17451?focusedWorklogId=533177=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533177 ] ASF GitHub Bot logged work on HADOOP-17451: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261467#comment-17261467 ] Michael Stack commented on HADOOP-16524: Merged to trunk. Put up #2609 backport to branch-3.3.

[jira] [Updated] (HADOOP-13551) hook up AwsSdkMetrics to IOStatistics

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13551: Description: The S3A Connector has the ability to pass statistics collected by the AWS

[GitHub] [hadoop] touchida commented on a change in pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-08 Thread GitBox
touchida commented on a change in pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#discussion_r554059473 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMultipleNNPortQOP.java ## @@ -251,62 +252,48 @@ public void

[jira] [Commented] (HADOOP-17201) Spark job with s3acommitter stuck at the last stage

2021-01-08 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261496#comment-17261496 ] Brandon commented on HADOOP-17201: -- Adding another observation of this issue. My setup is Spark 2.4.4

[GitHub] [hadoop] hadoop-yetus commented on pull request #2594: HADOOP-17451. IOStatistics test failures in S3A code.

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2594: URL: https://github.com/apache/hadoop/pull/2594#issuecomment-756945504 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-16976) Fix code style in JMXJsonServlet

2021-01-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-16976: - Fix Version/s: (was: 3.2.2) > Fix code style in JMXJsonServlet >

[jira] [Updated] (HADOOP-16987) update-method-param for ProtocolSignature

2021-01-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-16987: - Fix Version/s: (was: 3.2.2) > update-method-param for ProtocolSignature >

[jira] [Updated] (HADOOP-16978) Fix typo getLogSupressionMessage to getLogSuppressionMessage

2021-01-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-16978: - Fix Version/s: (was: 3.2.2) > Fix typo getLogSupressionMessage to getLogSuppressionMessage

[jira] [Updated] (HADOOP-16975) Fix typo in JMXJsonServlet.java

2021-01-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-16975: - Fix Version/s: (was: 3.2.2) > Fix typo in JMXJsonServlet.java >

[jira] [Updated] (HADOOP-16974) Add error Message when thread join throw exception

2021-01-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-16974: - Fix Version/s: (was: 3.2.2) > Add error Message when thread join throw exception >

[jira] [Resolved] (HADOOP-14391) s3a: auto-detect region for bucket and use right endpoint

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14391. - Resolution: Cannot Reproduce Latest AWS SDK works this out if you don't set the

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=533129=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533129 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261440#comment-17261440 ] Jim Brennan commented on HADOOP-17408: -- Thanks for your work on this [~ahussein]. I have approved

[GitHub] [hadoop] saintstack merged pull request #2470: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

2021-01-08 Thread GitBox
saintstack merged pull request #2470: URL: https://github.com/apache/hadoop/pull/2470 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=533137=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533137 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-17462: Description: {code:java|Title=Client.java} /** @return the rpc response or, in case of

[jira] [Comment Edited] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261538#comment-17261538 ] David Mollitor edited comment on HADOOP-17462 at 1/8/21, 7:22 PM: --

[GitHub] [hadoop] saintstack opened a new pull request #2609: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode (…

2021-01-08 Thread GitBox
saintstack opened a new pull request #2609: URL: https://github.com/apache/hadoop/pull/2609 …#2470) Co-authored-by: Borislav Iordanov Signed-off-by: stack ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title

[jira] [Commented] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261524#comment-17261524 ] Íñigo Goiri commented on HADOOP-17462: -- Interesting finding. Can you share in what scenario you

[jira] [Commented] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261538#comment-17261538 ] David Mollitor commented on HADOOP-17462: - [~elgoiri] Hello old friend :) Happy new year.

[jira] [Updated] (HADOOP-13551) hook up AwsSdkMetrics to IOStatistics

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13551: Summary: hook up AwsSdkMetrics to IOStatistics (was: hook up AwsSdkMetrics to hadoop

[GitHub] [hadoop] steveloughran commented on pull request #2594: HADOOP-17451. IOStatistics test failures in S3A code.

2021-01-08 Thread GitBox
steveloughran commented on pull request #2594: URL: https://github.com/apache/hadoop/pull/2594#issuecomment-756918476 -checkstyle of unused import; fixing. Ready for review: @bgaborg @mukund-thakur @mehakmeet @sunchao

[jira] [Created] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17462: --- Summary: Hadoop Client getRpcResponse May Return Wrong Result Key: HADOOP-17462 URL: https://issues.apache.org/jira/browse/HADOOP-17462 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #2609: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode (…

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2609: URL: https://github.com/apache/hadoop/pull/2609#issuecomment-756959446 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 24m

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=533195=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533195 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub Bot

[GitHub] [hadoop] touchida commented on a change in pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-08 Thread GitBox
touchida commented on a change in pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#discussion_r554038392 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMultipleNNPortQOP.java ## @@ -251,62 +252,48 @@ public void

[GitHub] [hadoop] touchida commented on a change in pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-08 Thread GitBox
touchida commented on a change in pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#discussion_r554073638 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/sasl/SaslDataTransferClient.java ## @@

[jira] [Work started] (HADOOP-17455) [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17455 started by Steve Loughran. --- > [s3a] Intermittent failure of

[jira] [Work started] (HADOOP-17456) S3A ITestPartialRenamesDeletes.testPartialDirDelete[bulk-delete=true] failure

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17456 started by Steve Loughran. --- > S3A ITestPartialRenamesDeletes.testPartialDirDelete[bulk-delete=true]

[jira] [Work started] (HADOOP-17451) intermittent failure of S3A tests which make assertions on statistics/IOStatistics

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17451 started by Steve Loughran. --- > intermittent failure of S3A tests which make assertions on >

[jira] [Resolved] (HADOOP-15348) S3A Input Stream bytes read counter isn't getting through to StorageStatistics/instrumentation properly

2021-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15348. - Fix Version/s: 3.4.0 Resolution: Fixed Fixed as part of HADOOP-17271 > S3A

[GitHub] [hadoop] amahussein commented on a change in pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-08 Thread GitBox
amahussein commented on a change in pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#discussion_r554026595 ## File path:

[GitHub] [hadoop] touchida commented on a change in pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-08 Thread GitBox
touchida commented on a change in pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#discussion_r554059473 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMultipleNNPortQOP.java ## @@ -251,62 +252,48 @@ public void

[GitHub] [hadoop] hadoop-yetus commented on pull request #2608: YARN-10555. missing access check before getAppAttempts

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2608: URL: https://github.com/apache/hadoop/pull/2608#issuecomment-756790297 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] amahussein commented on a change in pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-08 Thread GitBox
amahussein commented on a change in pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#discussion_r554026595 ## File path:

[jira] [Updated] (HADOOP-16973) Fix typo in ReconfigurationServlet

2021-01-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-16973: - Fix Version/s: (was: 3.2.2) > Fix typo in ReconfigurationServlet >

[GitHub] [hadoop] amahussein commented on a change in pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-08 Thread GitBox
amahussein commented on a change in pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#discussion_r554026595 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2594: HADOOP-17451. IOStatistics test failures in S3A code.

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2594: URL: https://github.com/apache/hadoop/pull/2594#issuecomment-756866385 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17451) intermittent failure of S3A tests which make assertions on statistics/IOStatistics

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17451?focusedWorklogId=533122=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533122 ] ASF GitHub Bot logged work on HADOOP-17451: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein commented on pull request #2601: HADOOP-17408. Optimize NetworkTopology sorting block locations.

2021-01-08 Thread GitBox
amahussein commented on pull request #2601: URL: https://github.com/apache/hadoop/pull/2601#issuecomment-756839310 @jbrennan333 The failing unit test is not related. I will take note and watch for it to file a jira if it shows up in the qbt-report. I have intuition that the

[jira] [Work logged] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?focusedWorklogId=533098=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533098 ] ASF GitHub Bot logged work on HADOOP-17408: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17463) Replace currentTimeMillis with monotonicNow in elapsed time

2021-01-08 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261599#comment-17261599 ] Ahmed Hussein commented on HADOOP-17463: [~kihwal], [~vinayakumarb], [~weichiu]. There was

[GitHub] [hadoop] saintstack merged pull request #2609: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode (…

2021-01-08 Thread GitBox
saintstack merged pull request #2609: URL: https://github.com/apache/hadoop/pull/2609 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=533245=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533245 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261610#comment-17261610 ] Hadoop QA commented on HADOOP-17462: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on pull request #2610: HADOOP-17462: Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2610: URL: https://github.com/apache/hadoop/pull/2610#issuecomment-757015565 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?focusedWorklogId=533252=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533252 ] ASF GitHub Bot logged work on HADOOP-17462: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17408. -- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Thanks for the

[jira] [Commented] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread Sangjin Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261562#comment-17261562 ] Sangjin Lee commented on HADOOP-17462: -- I might be coming in cold here, not having looked at this

[GitHub] [hadoop] jbrennan333 merged pull request #2601: HADOOP-17408. Optimize NetworkTopology sorting block locations.

2021-01-08 Thread GitBox
jbrennan333 merged pull request #2601: URL: https://github.com/apache/hadoop/pull/2601 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] hadoop-yetus commented on pull request #2584: HADOOP-16202. Enhance openFile()

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-757007173 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-08 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HADOOP-16524: --- Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Release

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=533238=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-533238 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[jira] [Created] (HADOOP-17463) Replace currentTimeMillis with monotonicNow in elapsed time

2021-01-08 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17463: -- Summary: Replace currentTimeMillis with monotonicNow in elapsed time Key: HADOOP-17463 URL: https://issues.apache.org/jira/browse/HADOOP-17463 Project: Hadoop

[GitHub] [hadoop] hadoop-yetus commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-08 Thread GitBox
hadoop-yetus commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-757016102 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

  1   2   >