[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=532885=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532885 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2597: HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2597: URL: https://github.com/apache/hadoop/pull/2597#issuecomment-756608457 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 25m

[GitHub] [hadoop] sunchao commented on pull request #2578: HDFS-15754. Add DataNode packet metrics

2021-01-07 Thread GitBox
sunchao commented on pull request #2578: URL: https://github.com/apache/hadoop/pull/2578#issuecomment-756605227 Merged to trunk. Thanks @fengnanli for the contribution and @goiri for the review. This is an automated message

[GitHub] [hadoop] sunchao merged pull request #2578: HDFS-15754. Add DataNode packet metrics

2021-01-07 Thread GitBox
sunchao merged pull request #2578: URL: https://github.com/apache/hadoop/pull/2578 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-15760) Include Apache Commons Collections4

2021-01-07 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261068#comment-17261068 ] Hadoop QA commented on HADOOP-15760: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-07 Thread GitBox
vinaysbadami commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r553781281 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,107 @@ +/**

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-07 Thread GitBox
vinaysbadami commented on a change in pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#discussion_r553775292 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ContentSummaryProcessor.java ## @@ -0,0 +1,107 @@ +/**

[jira] [Work logged] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?focusedWorklogId=532872=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532872 ] ASF GitHub Bot logged work on HADOOP-17408: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2601: HADOOP-17408. Optimize NetworkTopology sorting block locations.

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2601: URL: https://github.com/apache/hadoop/pull/2601#issuecomment-756588519 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17430) Restore ability to set Text to empty byte array

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17430?focusedWorklogId=532867=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532867 ] ASF GitHub Bot logged work on HADOOP-17430: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on pull request #2545: HADOOP-17430. Add clear bytes logic for hadoop Text

2021-01-07 Thread GitBox
ayushtkn commented on pull request #2545: URL: https://github.com/apache/hadoop/pull/2545#issuecomment-756584282 @bibinchundatt I haven't merged it. So not sure, Presently AFK @steveloughran Can you check. Bibin you can revert and proceed as of now

[jira] [Work logged] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?focusedWorklogId=532864=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532864 ] ASF GitHub Bot logged work on HADOOP-17408: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2601: HADOOP-17408. Optimize NetworkTopology sorting block locations.

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2601: URL: https://github.com/apache/hadoop/pull/2601#issuecomment-756579801 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17430) Restore ability to set Text to empty byte array

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17430?focusedWorklogId=532859=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532859 ] ASF GitHub Bot logged work on HADOOP-17430: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bibinchundatt commented on pull request #2545: HADOOP-17430. Add clear bytes logic for hadoop Text

2021-01-07 Thread GitBox
bibinchundatt commented on pull request #2545: URL: https://github.com/apache/hadoop/pull/2545#issuecomment-756577684 @ayushtkn 3.3.1 compilation is broken after the commit. This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=532857=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532857 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub Bot

[GitHub] [hadoop] saintstack commented on pull request #2470: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

2021-01-07 Thread GitBox
saintstack commented on pull request #2470: URL: https://github.com/apache/hadoop/pull/2470#issuecomment-756573808 Rerunning tests to see if failures related (Getting ready to merge) This is an automated message from the

[jira] [Updated] (HADOOP-15760) Include Apache Commons Collections4

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-15760: Labels: pull-request-available (was: ) > Include Apache Commons Collections4 >

[jira] [Work logged] (HADOOP-15760) Include Apache Commons Collections4

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?focusedWorklogId=532856=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532856 ] ASF GitHub Bot logged work on HADOOP-15760: --- Author: ASF GitHub Bot

[GitHub] [hadoop] coderbond007 opened a new pull request #2606: HADOOP-15760: updated to commons-collections4

2021-01-07 Thread GitBox
coderbond007 opened a new pull request #2606: URL: https://github.com/apache/hadoop/pull/2606 JIRA: https://issues.apache.org/jira/browse/HADOOP-15760 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] bibinchundatt merged pull request #2564: YARN-10538: Add RECOMMISSIONING nodes to the list of updated nodes returned to the AM

2021-01-07 Thread GitBox
bibinchundatt merged pull request #2564: URL: https://github.com/apache/hadoop/pull/2564 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] iwasakims commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
iwasakims commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756551454 > It seems that there was an old bug and not introduced by my changes. It is easily surfaced by just running `mvn test` now as a result of the class splitting. This

[GitHub] [hadoop] iwasakims commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
iwasakims commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756537729 Running `mvn test -Dtest=TestDSTimelineV20` alone worked as you said. TestDSTimelineV15 seems to affect the configuration of TestDSTimelineV20.

[GitHub] [hadoop] iwasakims commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
iwasakims commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756536297 My stack trace indicates that TestDSTimelineV20 is configured to use HDFS but there is no running MiniDFSCluster. YARN daemons are failed to start due to this.

[GitHub] [hadoop] amahussein commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
amahussein commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756533357 I did an experiment on the original `TestDistributedShell` if you run ```bash mvn test -Dtest=TestDistributedShell#testDSShellWithoutDomainV1_5; mvn test

[GitHub] [hadoop] amahussein commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
amahussein commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756531850 @iwasakims and @goiri Do you have insights what could the problem be ? When you run TestDSTimelineV10 -> then TestDSTimelineV20. things will be successful. Only

[GitHub] [hadoop] amahussein commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
amahussein commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756530407 > The latest commit seemed to introduce errors. > > ``` > $ mvn test -Dtest='TestDS*' > ... > [ERROR] Errors: > [ERROR]

[jira] [Commented] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2021-01-07 Thread Junping Du (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260967#comment-17260967 ] Junping Du commented on HADOOP-16492: - Looks like steve is busy on something else. [~brahmareddy],

[GitHub] [hadoop] iwasakims commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
iwasakims commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756522630 The latest commit seemed to introduce errors. ``` $ mvn test -Dtest='TestDS*' ... [ERROR] Errors: [ERROR]

[GitHub] [hadoop] hadoop-yetus commented on pull request #2605: HDFS-15423 RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2605: URL: https://github.com/apache/hadoop/pull/2605#issuecomment-756477576 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri commented on a change in pull request #2605: HDFS-15423 RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-01-07 Thread GitBox
goiri commented on a change in pull request #2605: URL: https://github.com/apache/hadoop/pull/2605#discussion_r553675189 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterWebHdfsMethods.java ## @@ -502,6

[GitHub] [hadoop] fengnanli opened a new pull request #2605: HDFS-15423 [RBF] WebHDFS create file in the resolved nameservice

2021-01-07 Thread GitBox
fengnanli opened a new pull request #2605: URL: https://github.com/apache/hadoop/pull/2605 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-756385141 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756343332 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17337) NetworkBinding has a runtime class dependency on a third-party shaded class

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17337?focusedWorklogId=532661=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532661 ] ASF GitHub Bot logged work on HADOOP-17337: --- Author: ASF GitHub Bot

[GitHub] [hadoop] cwensel commented on pull request #2599: HADOOP-17337. NetworkBinding has a runtime dependency on shaded httpclient

2021-01-07 Thread GitBox
cwensel commented on pull request #2599: URL: https://github.com/apache/hadoop/pull/2599#issuecomment-756300986 I fully understand the situation. And appreciate the time and effort put into this issue. This is an automated

[jira] [Work logged] (HADOOP-17337) NetworkBinding has a runtime class dependency on a third-party shaded class

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17337?focusedWorklogId=532659=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532659 ] ASF GitHub Bot logged work on HADOOP-17337: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2599: HADOOP-17337. NetworkBinding has a runtime dependency on shaded httpclient

2021-01-07 Thread GitBox
steveloughran commented on pull request #2599: URL: https://github.com/apache/hadoop/pull/2599#issuecomment-756297053 style ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/NetworkBinding.java:46: private static final String BINDING_CLASSNAME =

[jira] [Work logged] (HADOOP-17337) NetworkBinding has a runtime class dependency on a third-party shaded class

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17337?focusedWorklogId=532657=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532657 ] ASF GitHub Bot logged work on HADOOP-17337: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2599: HADOOP-17337. NetworkBinding has a runtime dependency on shaded httpclient

2021-01-07 Thread GitBox
steveloughran commented on pull request #2599: URL: https://github.com/apache/hadoop/pull/2599#issuecomment-756296069 > is it not possible, if not reasonable, to have both by adding a new class that couples to the unshaded class in tandem to the current proposed class that couples to the

[GitHub] [hadoop] amahussein commented on a change in pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-07 Thread GitBox
amahussein commented on a change in pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#discussion_r553452665 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMultipleNNPortQOP.java ## @@ -251,62 +252,48 @@ public void

[jira] [Work logged] (HADOOP-17337) NetworkBinding has a runtime class dependency on a third-party shaded class

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17337?focusedWorklogId=532633=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532633 ] ASF GitHub Bot logged work on HADOOP-17337: --- Author: ASF GitHub Bot

[GitHub] [hadoop] cwensel commented on pull request #2599: HADOOP-17337. NetworkBinding has a runtime dependency on shaded httpclient

2021-01-07 Thread GitBox
cwensel commented on pull request #2599: URL: https://github.com/apache/hadoop/pull/2599#issuecomment-756248615 this is an unfortunate tradeoff. I'll gladly opt for improved runtime performance vs improved build and deployment performance. is it not possible, if not reasonable, to

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=532595=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532595 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-07 Thread GitBox
steveloughran commented on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-756223044 did squash and rebase down to a single patch; then tested against s3 london with `-Dparallel-tests -DtestsThreadCount=6 -Dscale -Dmarkers=delete -Ds3guard -Ddynamo`

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532532=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532532 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2604: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
mehakmeet commented on a change in pull request #2604: URL: https://github.com/apache/hadoop/pull/2604#discussion_r553377053 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsStatistic.java ## @@ -73,7 +73,35 @@

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532522=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532522 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2604: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
mehakmeet commented on a change in pull request #2604: URL: https://github.com/apache/hadoop/pull/2604#discussion_r553373525 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStreamStatistics.java ## @@ -65,6 +64,12 @@

[jira] [Work logged] (HADOOP-17451) intermittent failure of S3A tests which make assertions on statistics/IOStatistics

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17451?focusedWorklogId=532518=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532518 ] ASF GitHub Bot logged work on HADOOP-17451: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2594: HADOOP-17451. IOStatistics test failures in S3A code.

2021-01-07 Thread GitBox
steveloughran commented on pull request #2594: URL: https://github.com/apache/hadoop/pull/2594#issuecomment-756143689 style ``` ./hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/impl/ITestPartialRenamesDeletes.java:702: bulkDeleteVerbCount.assertDiffEquals("Wrong

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532517=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532517 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2604: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
steveloughran commented on a change in pull request #2604: URL: https://github.com/apache/hadoop/pull/2604#discussion_r553348624 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsStatistic.java ## @@ -73,7 +73,35 @@

[GitHub] [hadoop] amahussein commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
amahussein commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756136730 > Thank for working on this, @amahussein. LGTM overall pending some nits. > > While it is too late here, it is hard to follow which part of the TestDistributedShell is

[GitHub] [hadoop] amahussein commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
amahussein commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756134654 > > * The implementation has lots of code redundancy. > > * It is inefficient in the setup and tearing down. The large percentage of time execution is exhausted by starting

[GitHub] [hadoop] steveloughran commented on pull request #2599: HADOOP-17337. NetworkBinding has a runtime dependency on shaded httpclient

2021-01-07 Thread GitBox
steveloughran commented on pull request #2599: URL: https://github.com/apache/hadoop/pull/2599#issuecomment-756134591 if it's not found you don't get any attempts to patch in the wildfly/openssl library. HTTPS connections may be slower. You will stay with the java https factory. I

[jira] [Work logged] (HADOOP-17337) NetworkBinding has a runtime class dependency on a third-party shaded class

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17337?focusedWorklogId=532505=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532505 ] ASF GitHub Bot logged work on HADOOP-17337: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein commented on pull request #2581: YARN-10553. Refactor TestDistributedShell

2021-01-07 Thread GitBox
amahussein commented on pull request #2581: URL: https://github.com/apache/hadoop/pull/2581#issuecomment-756132738 > Thank for working on this, @amahussein. LGTM overall pending some nits. > > While it is too late here, it is hard to follow which part of the TestDistributedShell is

[jira] [Commented] (HADOOP-17403) S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing directory marker

2021-01-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260510#comment-17260510 ] Steve Loughran commented on HADOOP-17403: - In the log, {code} // end of write operations

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532454=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532454 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2604: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2604: URL: https://github.com/apache/hadoop/pull/2604#issuecomment-756109246 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Comment Edited] (HADOOP-17403) S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing directory marker

2021-01-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260486#comment-17260486 ] Steve Loughran edited comment on HADOOP-17403 at 1/7/21, 1:12 PM: --

[jira] [Commented] (HADOOP-17403) S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing directory marker

2021-01-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260486#comment-17260486 ] Steve Loughran commented on HADOOP-17403: - Seen on a run with {{-Dparallel-tests

[jira] [Updated] (HADOOP-17403) S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing directory marker

2021-01-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17403: Fix Version/s: (was: 3.3.1) > S3A

[jira] [Reopened] (HADOOP-17403) S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing directory marker

2021-01-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-17403: - > S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing > directory

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532418=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532418 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532416=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532416 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17272) ABFS Streams to support IOStatistics API

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17272?focusedWorklogId=532417=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532417 ] ASF GitHub Bot logged work on HADOOP-17272: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on pull request #2353: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
mehakmeet commented on pull request #2353: URL: https://github.com/apache/hadoop/pull/2353#issuecomment-756070951 Closing this one, and opening as #2604. This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] mehakmeet closed pull request #2353: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
mehakmeet closed pull request #2353: URL: https://github.com/apache/hadoop/pull/2353 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] mehakmeet opened a new pull request #2604: HADOOP-17272. ABFS Streams to support IOStatistics API

2021-01-07 Thread GitBox
mehakmeet opened a new pull request #2604: URL: https://github.com/apache/hadoop/pull/2604 Previously #2353, Had to close it due to parent branch closing and pushed in a new PR. Now the IOStatistics has been merged in trunk as 3 PRs(#2577, #2579, #2580). Tested using: mvn -T 1C

[GitHub] [hadoop] touchida edited a comment on pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-07 Thread GitBox
touchida edited a comment on pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#issuecomment-756065456 I have tested this unit test a hundred times in my local docker environment and never failed. ``` for i in `seq 100` ; do echo $i && mvn surefire:test

[GitHub] [hadoop] touchida commented on pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-07 Thread GitBox
touchida commented on pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#issuecomment-756065456 It's ready for review. Could anyone kindly review this PR? This is an automated message from the Apache Git

[GitHub] [hadoop] touchida commented on pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStre…

2021-01-07 Thread GitBox
touchida commented on pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#issuecomment-756042823 The failed unit test is unrelated to this PR and already filed in [HDFS-13975](https://issues.apache.org/jira/browse/HDFS-13975). *

[jira] [Work logged] (HADOOP-17452) Upgrade guice to 4.2.3

2021-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17452?focusedWorklogId=532394=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-532394 ] ASF GitHub Bot logged work on HADOOP-17452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2602: Test PR for HADOOP-17452

2021-01-07 Thread GitBox
hadoop-yetus commented on pull request #2602: URL: https://github.com/apache/hadoop/pull/2602#issuecomment-756031817 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] sunchao commented on pull request #2578: [HDFS-15754] Add DataNode packet metrics

2021-01-07 Thread GitBox
sunchao commented on pull request #2578: URL: https://github.com/apache/hadoop/pull/2578#issuecomment-755961964 Thanks @fengnanli for the update. @goiri let me know if you have more comments on this. Otherwise I'll commit later today.