[GitHub] [hadoop] hadoop-yetus commented on pull request #309: MAPREDUCE-7017:Too many times of meaningless invocation in TaskAttemptImpl#resolveHosts

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #309: URL: https://github.com/apache/hadoop/pull/309#issuecomment-747325248 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok:

[GitHub] [hadoop] sodonnel commented on pull request #2533: HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

2020-12-17 Thread GitBox
sodonnel commented on pull request #2533: URL: https://github.com/apache/hadoop/pull/2533#issuecomment-747424463 This change LGTM - +1 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] Cosss7 opened a new pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread GitBox
Cosss7 opened a new pull request #2559: URL: https://github.com/apache/hadoop/pull/2559 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[GitHub] [hadoop] dgzdot opened a new pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
dgzdot opened a new pull request #2557: URL: https://github.com/apache/hadoop/pull/2557 Since ec client could not identify the InvalidToken error because of the SASL negotiation, always reftch token when encounter error for the first time.

[GitHub] [hadoop] dgzdot closed pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
dgzdot closed pull request #2557: URL: https://github.com/apache/hadoop/pull/2557 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] dgzdot commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
dgzdot commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747427566 I made some mistakes. so close the pr This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] dgzdot opened a new pull request #2558: HDFS-15732 EC client will not retry get block token when block token …

2020-12-17 Thread GitBox
dgzdot opened a new pull request #2558: URL: https://github.com/apache/hadoop/pull/2558 Since client side will not identify the InvalidToken error because of the SASL negotiation, always refetch token when encountered error for the first time.

[GitHub] [hadoop] hadoop-yetus commented on pull request #309: MAPREDUCE-7017:Too many times of meaningless invocation in TaskAttemptImpl#resolveHosts

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #309: URL: https://github.com/apache/hadoop/pull/309#issuecomment-747323838 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok:

[GitHub] [hadoop] sodonnel edited a comment on pull request #2533: HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

2020-12-17 Thread GitBox
sodonnel edited a comment on pull request #2533: URL: https://github.com/apache/hadoop/pull/2533#issuecomment-747424463 This change LGTM +1 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17437: Component/s: fs/s3 > Update Hadoop Documentation with a new AWS Credential Provider used

[GitHub] [hadoop] steveloughran commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-17 Thread GitBox
steveloughran commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-747521734 Mock test failure. As usual, as likely as a mock-related change as a functional code change. But as the committer has been instrumented with stats collection, I'm going to

[jira] [Commented] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251193#comment-17251193 ] Prateek Dubey commented on HADOOP-17437: I found the git repo -

[GitHub] [hadoop] goiri commented on pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
goiri commented on pull request #2556: URL: https://github.com/apache/hadoop/pull/2556#issuecomment-747580696 This looks surprisingly successful. In addition the runtime (8 hours) doesn't look that bad; for comparison how many hours was it right before? I see some with 7 hours and

[GitHub] [hadoop] jbrennan333 merged pull request #2511: HDFS-15704. Mitigate lease monitor's rapid infinite loop.

2020-12-17 Thread GitBox
jbrennan333 merged pull request #2511: URL: https://github.com/apache/hadoop/pull/2511 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=525620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525620 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2558: HDFS-15732 EC client will not retry get block token when block token …

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2558: URL: https://github.com/apache/hadoop/pull/2558#issuecomment-747484300 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747538572 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2554: YARN-10536. distributedshell client handles interrupt

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747540421 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525639=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525639 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2556: URL: https://github.com/apache/hadoop/pull/2556#issuecomment-747557355 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251159#comment-17251159 ] Steve Loughran commented on HADOOP-17437: - Happy to take a github PR against hadoop with the

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=525614=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525614 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2559: URL: https://github.com/apache/hadoop/pull/2559#issuecomment-747582478 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17438: -- Summary: Increase docker memory limit in Jenkins Key: HADOOP-17438 URL: https://issues.apache.org/jira/browse/HADOOP-17438 Project: Hadoop Common Issue

[GitHub] [hadoop] amahussein opened a new pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
amahussein opened a new pull request #2560: URL: https://github.com/apache/hadoop/pull/2560 This change to increase the memory limit from 20g to 22g. The last commit is needed to trigger the tests and increase the timeout. It should be skipped before merging.

[jira] [Updated] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17438: Labels: pull-request-available (was: ) > Increase docker memory limit in Jenkins >

[GitHub] [hadoop] hadoop-yetus commented on pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2556: URL: https://github.com/apache/hadoop/pull/2556#issuecomment-747501766 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747546220 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] amahussein commented on pull request #2554: YARN-10536. distributedshell client handles interrupt

2020-12-17 Thread GitBox
amahussein commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747466075 The changes should be fine to merge. The two failing tests are failing for more than a year. there are opened jiras to address them.

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

2020-12-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251164#comment-17251164 ] Steve Loughran commented on HADOOP-15691: - Sorry, missed that I'd pulled this back as part of

[GitHub] [hadoop] amahussein commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-17 Thread GitBox
amahussein commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-747529035 @tasanuma, @iwasakims did anyone consider increasing the resources allocated to the docker image? For example, increase the memory and see whether or not OOM disappears?

[GitHub] [hadoop] hadoop-yetus commented on pull request #2557: HDFS-15732:EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2557: URL: https://github.com/apache/hadoop/pull/2557#issuecomment-747545248 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work started] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17438 started by Ahmed Hussein. -- > Increase docker memory limit in Jenkins >

[GitHub] [hadoop] goiri commented on a change in pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
goiri commented on a change in pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#discussion_r545265205 ## File path:

[GitHub] [hadoop] ericbadger commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
ericbadger commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747662919 Jeez, are we really running out of memory in a 20 GB container? That seems insane to me This is an automated

[GitHub] [hadoop] goiri commented on pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
goiri commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747679024 I don't think we broke the TestDistributedShell with this, did we? This is an automated message from the Apache

[GitHub] [hadoop] amahussein commented on pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
amahussein commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747702575 > I don't think we broke the TestDistributedShell with this, did we? No, we didn't. Those two test cases were broken for almost a year See

[GitHub] [hadoop] amahussein commented on a change in pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
amahussein commented on a change in pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#discussion_r545314569 ## File path:

[GitHub] [hadoop] steveloughran commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-17 Thread GitBox
steveloughran commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-747600304 Narrator: it was the mock. It just to a long time to debug the fact that durationTracking of deleteObject was triggering an NPE, which, in commit cleanup, was being

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=525667=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525667 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2554: URL: https://github.com/apache/hadoop/pull/2554#issuecomment-747676461 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525697=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525697 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525695=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525695 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ericbadger commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
ericbadger commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747663571 It would be nice to know what's tying up all of our memory. Because 20 GB is a lot for us to be using for unit tests

[GitHub] [hadoop] amahussein commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
amahussein commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747719615 Thanks @jbrennan333 , the failing unit tests expect the exception to be thrown more than once. I will need to go through those test units to fix them.

[GitHub] [hadoop] jbrennan333 commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
jbrennan333 commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747754051 I think the unit test changes will make them pass, but it seems like those tests will no longer be testing the code in closeImpl() that was added by [HDFS-12612].

[GitHub] [hadoop] dongjoon-hyun commented on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2020-12-17 Thread GitBox
dongjoon-hyun commented on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-747797852 Gentle ping~ This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] NickyYe opened a new pull request #2562: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
NickyYe opened a new pull request #2562: URL: https://github.com/apache/hadoop/pull/2562 https://issues.apache.org/jira/browse/HDFS-15737 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which

[GitHub] [hadoop] NickyYe opened a new pull request #2561: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
NickyYe opened a new pull request #2561: URL: https://github.com/apache/hadoop/pull/2561 https://issues.apache.org/jira/browse/HDFS-15737 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which

[GitHub] [hadoop] hadoop-yetus commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-747727830 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=525794=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525794 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein edited a comment on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
amahussein edited a comment on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747750687 @eddyxu , @jbrennan333 Can you please take a look at the Junit fixes? I found that the calls to `close()` in

[GitHub] [hadoop] amahussein commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
amahussein commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747750687 @eddyxu , Can you please take a look at the Junit fixes? I found that the calls to `close()` in `TestDFSStripedOutputStreamWithFailure#testCloseWithExceptionsInStreamer`

[GitHub] [hadoop] goiri merged pull request #2554: YARN-10536. Client in distributedShell swallows interrupt exceptions

2020-12-17 Thread GitBox
goiri merged pull request #2554: URL: https://github.com/apache/hadoop/pull/2554 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2456: HDFS-15679. DFSOutputStream should not throw exception after closed

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2456: URL: https://github.com/apache/hadoop/pull/2456#issuecomment-747826604 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] NickyYe closed pull request #2561: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
NickyYe closed pull request #2561: URL: https://github.com/apache/hadoop/pull/2561 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2561: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2561: URL: https://github.com/apache/hadoop/pull/2561#issuecomment-747798322 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Updated] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-17 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17435: --- Fix Version/s: asf-site Resolution: Fixed Status: Resolved (was: Patch

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525834=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525834 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=525825=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525825 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
aajisaka commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747825118 I asked the infrastructure team how much memory we can use: https://issues.apache.org/jira/browse/INFRA-21207

[GitHub] [hadoop] hadoop-yetus commented on pull request #2562: HDFS-15737. Don't remove datanodes from outOfServiceNodeBlocks while checking in DatanodeAdminManager

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2562: URL: https://github.com/apache/hadoop/pull/2562#issuecomment-747831900 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 11m

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=525868=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525868 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-17 Thread GitBox
tasanuma commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-747874700 @amahussein I didn't consider it. Thanks for trying it on [HADOOP-17438](https://issues.apache.org/jira/browse/HADOOP-17438). Let's see the result. I'm also paying

[GitHub] [hadoop] Cosss7 commented on pull request #2559: HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread GitBox
Cosss7 commented on pull request #2559: URL: https://github.com/apache/hadoop/pull/2559#issuecomment-747833201 Unrelated fails. UT can pass locally. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] qizhu-lucas commented on pull request #2563: YARN-10463: For Federation, we should support getApplicationAttemptRe…

2020-12-17 Thread GitBox
qizhu-lucas commented on pull request #2563: URL: https://github.com/apache/hadoop/pull/2563#issuecomment-747910858 Fix checkstyle. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] qizhu-lucas opened a new pull request #2563: YARN-10463: For Federation, we should support getApplicationAttemptRe…

2020-12-17 Thread GitBox
qizhu-lucas opened a new pull request #2563: URL: https://github.com/apache/hadoop/pull/2563 The PR for : [YARN-10463](https://issues.apache.org/jira/browse/YARN-10463) This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-17438) Increase docker memory limit in Jenkins

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17438?focusedWorklogId=525884=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525884 ] ASF GitHub Bot logged work on HADOOP-17438: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2560: HADOOP-17438. Increase docker memory limit in Jenkins.

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2560: URL: https://github.com/apache/hadoop/pull/2560#issuecomment-747919101 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-747284265 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17317) [JDK 11] Upgrade dnsjava to remove illegal access warnings

2020-12-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17317?focusedWorklogId=525438=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-525438 ] ASF GitHub Bot logged work on HADOOP-17317: --- Author: ASF GitHub Bot

[jira] [Created] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
Prateek Dubey created HADOOP-17437: -- Summary: Update Hadoop Documentation with a new AWS Credential Provider used with EKS Key: HADOOP-17437 URL: https://issues.apache.org/jira/browse/HADOOP-17437

[GitHub] [hadoop] hadoop-yetus commented on pull request #2442: HADOOP-17317. [JDK 11] Upgrade dnsjava to remove illegal access warnings

2020-12-17 Thread GitBox
hadoop-yetus commented on pull request #2442: URL: https://github.com/apache/hadoop/pull/2442#issuecomment-747288551 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey commented on HADOOP-17437: I'm opening this issues to request to update Hadoop

[jira] [Comment Edited] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey edited comment on HADOOP-17437 at 12/17/20, 8:35 AM: ---

[jira] [Comment Edited] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey edited comment on HADOOP-17437 at 12/17/20, 8:35 AM: ---

[jira] [Comment Edited] (HADOOP-17437) Update Hadoop Documentation with a new AWS Credential Provider used with EKS

2020-12-17 Thread Prateek Dubey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250897#comment-17250897 ] Prateek Dubey edited comment on HADOOP-17437 at 12/17/20, 8:38 AM: ---

[GitHub] [hadoop] aajisaka closed pull request #2555: HDFS-13579. Fix potential OutOfMemory error in DatanodeHttpServer.

2020-12-17 Thread GitBox
aajisaka closed pull request #2555: URL: https://github.com/apache/hadoop/pull/2555 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka commented on pull request #2555: HDFS-13579. Fix potential OutOfMemory error in DatanodeHttpServer.

2020-12-17 Thread GitBox
aajisaka commented on pull request #2555: URL: https://github.com/apache/hadoop/pull/2555#issuecomment-747297288 Rethinking this, the OOM is not fixed by this change. Closing. This is an automated message from the Apache Git

[GitHub] [hadoop] aajisaka opened a new pull request #2556: HDFS-15731. Reduce threadCount for unit tests to reduce the memory usage

2020-12-17 Thread GitBox
aajisaka opened a new pull request #2556: URL: https://github.com/apache/hadoop/pull/2556 JIRA: https://issues.apache.org/jira/browse/HDFS-15731 Reduce the thread count from 4 to 2. This is an automated message from