[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525884=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525884 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747919101 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] qizhu-lucas commented on pull request #2563: YARN-10463: For Federation, we should support getApplicationAttemptRe…

2020-12-17 Thread GitBox
qizhu-lucas commented on pull request #2563: URL: https://github.com/apache/hadoop/pull/2563#issuecomment-747910858 Fix checkstyle. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] qizhu-lucas opened a new pull request #2563: YARN-10463: For Federation, we should support getApplicationAttemptRe…

2020-12-17 Thread GitBox
qizhu-lucas opened a new pull request #2563: URL: https://github.com/apache/hadoop/pull/2563 The PR for : [YARN-10463](https://issues.apache.org/jira/browse/YARN-10463) This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=525868=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525868 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-17 Thread GitBox
tasanuma commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-747874700 @amahussein I didn't consider it. Thanks for trying it on [HADOOP-17438](https://issues.apache.org/jira/browse/HADOOP-17438). Let's see the result. I'm also paying

[GitHub] [hadoop] Cosss7 commented on pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread GitBox
Cosss7 commented on pull request #2559: URL: https://github.com/apache/hadoop/pull/2559#issuecomment-747833201 Unrelated fails. UT can pass locally. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2562: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2562: URL: https://github.com/apache/hadoop/pull/2562#issuecomment-747831900 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 11m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747826604 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525834=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525834 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
aajisaka commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747825118 I asked the infrastructure team how much memory we can use: https://issues.apache.org/jira/browse/INFRA-21207

[jira] [Updated] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17435: --- Fix Version/s: asf-site Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop] NickyYe opened a new pull request #2562: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
NickyYe opened a new pull request #2562: URL: https://github.com/apache/hadoop/pull/2562 https://issues.apache.org/jira/browse/HDFS-15737 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which

[GitHub] [hadoop] hadoop-yetus commented on pull request #2561: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2561: URL: https://github.com/apache/hadoop/pull/2561#issuecomment-747798322 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] NickyYe closed pull request #2561: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
NickyYe closed pull request #2561: URL: https://github.com/apache/hadoop/pull/2561 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=525825=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525825 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dongjoon-hyun commented on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2020-12-17 Thread GitBox
dongjoon-hyun commented on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-747797852 Gentle ping~ This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] NickyYe opened a new pull request #2561: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
NickyYe opened a new pull request #2561: URL: https://github.com/apache/hadoop/pull/2561 https://issues.apache.org/jira/browse/HDFS-15737 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which

[GitHub] [hadoop] goiri merged pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
goiri merged pull request #2554: URL: https://github.com/apache/hadoop/pull/2554 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] jbrennan333 commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
jbrennan333 commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747754051 I think the unit test changes will make them pass, but it seems like those tests will no longer be testing the code in closeImpl() that was added by [HDFS-12612].

[GitHub] [hadoop] amahussein edited a comment on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
amahussein edited a comment on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747750687 @eddyxu , @jbrennan333 Can you please take a look at the Junit fixes? I found that the calls to `close()` in

[GitHub] [hadoop] amahussein commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
amahussein commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747750687 @eddyxu , Can you please take a look at the Junit fixes? I found that the calls to `close()` in `TestDFSStripedOutputStreamWithFailure#testCloseWithExceptionsInStreamer`

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=525794=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525794 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-747727830 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] amahussein commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
amahussein commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747719615 Thanks @jbrennan333 , the failing unit tests expect the exception to be thrown more than once. I will need to go through those test units to fix them.

[GitHub] [hadoop] amahussein commented on pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
amahussein commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747702575 > I don't think we broke the TestDistributedShell with this, did we? No, we didn't. Those two test cases were broken for almost a year See

[GitHub] [hadoop] goiri commented on pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
goiri commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747679024 I don't think we broke the TestDistributedShell with this, did we? This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747676461 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525697=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525697 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525695=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525695 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ericbadger commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
ericbadger commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747663571 It would be nice to know what's tying up all of our memory. Because 20 GB is a lot for us to be using for unit tests

[GitHub] [hadoop] ericbadger commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
ericbadger commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747662919 Jeez, are we really running out of memory in a 20 GB container? That seems insane to me This is an automated

[GitHub] [hadoop] amahussein commented on a change in pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
amahussein commented on a change in pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#discussion_r545314569 ## File path:

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=525667=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525667 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-17 Thread GitBox
steveloughran commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-747600304 Narrator: it was the mock. It just to a long time to debug the fact that durationTracking of deleteObject was triggering an NPE, which, in commit cleanup, was being

[GitHub] [hadoop] jbrennan333 merged pull request #2511: HDFS-15704. Mitigate lease monitor's rapid infinite loop.

2020-12-17 Thread GitBox
jbrennan333 merged pull request #2511: URL: https://github.com/apache/hadoop/pull/2511 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] hadoop-yetus commented on pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2559: URL: https://github.com/apache/hadoop/pull/2559#issuecomment-747582478 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri commented on a change in pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
goiri commented on a change in pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#discussion_r545265205 ## File path:

[GitHub] [hadoop] goiri commented on pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
goiri commented on pull request #2556: URL: https://github.com/apache/hadoop/pull/2556#issuecomment-747580696 This looks surprisingly successful. In addition the runtime (8 hours) doesn't look that bad; for comparison how many hours was it right before? I see some with 7 hours and

[GitHub] [hadoop] hadoop-yetus commented on pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2556: URL: https://github.com/apache/hadoop/pull/2556#issuecomment-747557355 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525639=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525639 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17438: Labels: pull-request-available (was: ) > Increase docker memory limit in Jenkins >

[GitHub] [hadoop] amahussein opened a new pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
amahussein opened a new pull request #2560: URL: https://github.com/apache/hadoop/pull/2560 This change to increase the memory limit from 20g to 22g. The last commit is needed to trigger the tests and increase the timeout. It should be skipped before merging.

[jira] [Commented] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251193#comment-17251193 ] Prateek Dubey commented on HADOOP-17437: I found the git repo -

[jira] [Work started] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17438 started by Ahmed Hussein. -- > Increase docker memory limit in Jenkins >

[jira] [Created] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17438: -- Summary: Increase docker memory limit in Jenkins Key: HADOOP-17438 URL: https://issues.apache.org/jira/browse/HADOOP-17438 Project: Hadoop Common Issue

[GitHub] [hadoop] hadoop-yetus commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747546220 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747545248 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2554: YARN-10536. distributedshell client handles interrupt

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747540421 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747538572 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=525620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525620 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-17 Thread GitBox
amahussein commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-747529035 @tasanuma, @iwasakims did anyone consider increasing the resources allocated to the docker image? For example, increase the memory and see whether or not OOM disappears?

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=525614=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525614 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-17 Thread GitBox
steveloughran commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-747521734 Mock test failure. As usual, as likely as a mock-related change as a functional code change. But as the committer has been instrumented with stats collection, I'm going to

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

2020-12-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251164#comment-17251164 ] Steve Loughran commented on HADOOP-15691: - Sorry, missed that I'd pulled this back as part of

[jira] [Commented] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251159#comment-17251159 ] Steve Loughran commented on HADOOP-17437: - Happy to take a github PR against hadoop with the

[jira] [Updated] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17437: Component/s: fs/s3 > Update Hadoop Documentation with a new AWS Credential Provider used

[GitHub] [hadoop] hadoop-yetus commented on pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2556: URL: https://github.com/apache/hadoop/pull/2556#issuecomment-747501766 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] sodonnel edited a comment on pull request #2533: HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

2020-12-17 Thread GitBox
sodonnel edited a comment on pull request #2533: URL: https://github.com/apache/hadoop/pull/2533#issuecomment-747424463 This change LGTM +1 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2558: HDFS-15732 EC client will not retry get block token when block token …

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2558: URL: https://github.com/apache/hadoop/pull/2558#issuecomment-747484300 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] amahussein commented on pull request #2554: YARN-10536. distributedshell client handles interrupt

2020-12-17 Thread GitBox
amahussein commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747466075 The changes should be fine to merge. The two failing tests are failing for more than a year. there are opened jiras to address them.

[GitHub] [hadoop] Cosss7 opened a new pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread GitBox
Cosss7 opened a new pull request #2559: URL: https://github.com/apache/hadoop/pull/2559 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[GitHub] [hadoop] dgzdot opened a new pull request #2558: HDFS-15732 EC client will not retry get block token when block token …

2020-12-17 Thread GitBox
dgzdot opened a new pull request #2558: URL: https://github.com/apache/hadoop/pull/2558 Since client side will not identify the InvalidToken error because of the SASL negotiation, always refetch token when encountered error for the first time.

[GitHub] [hadoop] dgzdot commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
dgzdot commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747427566 I made some mistakes. so close the pr This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] dgzdot closed pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
dgzdot closed pull request #2557: URL: https://github.com/apache/hadoop/pull/2557 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] sodonnel commented on pull request #2533: HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

2020-12-17 Thread GitBox
sodonnel commented on pull request #2533: URL: https://github.com/apache/hadoop/pull/2533#issuecomment-747424463 This change LGTM - +1 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] dgzdot opened a new pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
dgzdot opened a new pull request #2557: URL: https://github.com/apache/hadoop/pull/2557 Since ec client could not identify the InvalidToken error because of the SASL negotiation, always reftch token when encounter error for the first time.

[GitHub] [hadoop] hadoop-yetus commented on pull request #309: MAPREDUCE-7017:Too many times of meaningless invocation in TaskAttemptImpl#resolveHosts

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #309: URL: https://github.com/apache/hadoop/pull/309#issuecomment-747325248 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok:

[GitHub] [hadoop] hadoop-yetus commented on pull request #309: MAPREDUCE-7017:Too many times of meaningless invocation in TaskAttemptImpl#resolveHosts

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #309: URL: https://github.com/apache/hadoop/pull/309#issuecomment-747323838 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok:

[GitHub] [hadoop] aajisaka opened a new pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
aajisaka opened a new pull request #2556: URL: https://github.com/apache/hadoop/pull/2556 JIRA: https://issues.apache.org/jira/browse/HDFS-15731 Reduce the thread count from 4 to 2. This is an automated message from

[GitHub] [hadoop] aajisaka commented on pull request #2555: HDFS-13579. Fix potential OutOfMemory error in DatanodeHttpServer.

2020-12-17 Thread GitBox
aajisaka commented on pull request #2555: URL: https://github.com/apache/hadoop/pull/2555#issuecomment-747297288 Rethinking this, the OOM is not fixed by this change. Closing. This is an automated message from the Apache Git

[GitHub] [hadoop] aajisaka closed pull request #2555: HDFS-13579. Fix potential OutOfMemory error in DatanodeHttpServer.

2020-12-17 Thread GitBox
aajisaka closed pull request #2555: URL: https://github.com/apache/hadoop/pull/2555 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Comment Edited] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey edited comment on HADOOP-17437 at 12/17/20, 8:38 AM: ---

[jira] [Comment Edited] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey edited comment on HADOOP-17437 at 12/17/20, 8:35 AM: ---

[jira] [Comment Edited] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey edited comment on HADOOP-17437 at 12/17/20, 8:35 AM: ---

[jira] [Commented] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey commented on HADOOP-17437: I'm opening this issues to request to update Hadoop

[jira] [Work logged] (HADOOP-17317) [JDK 11] Upgrade dnsjava to remove illegal access warnings

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17317?focusedWorklogId=525438=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525438 ] ASF GitHub Bot logged work on HADOOP-17317: --- Author: ASF GitHub Bot

[jira] [Created] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
Prateek Dubey created HADOOP-17437: -- Summary: Update Hadoop Documentation with a new AWS Credential Provider used with EKS Key: HADOOP-17437 URL: https://issues.apache.org/jira/browse/HADOOP-17437

[GitHub] [hadoop] hadoop-yetus commented on pull request #2442: HADOOP-17317. [JDK 11] Upgrade dnsjava to remove illegal access warnings

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2442: URL: https://github.com/apache/hadoop/pull/2442#issuecomment-747288551 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-747284265 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0