[GitHub] [hadoop] Neilxzn commented on pull request #2719: YARN-10649. fix RMNodeImpl.updateExistContainers leak

2021-02-23 Thread GitBox
Neilxzn commented on pull request #2719: URL: https://github.com/apache/hadoop/pull/2719#issuecomment-784854345 @bibinchundatt Can you please review this patch? thx This is an automated message from the Apache Git Service.

[GitHub] [hadoop] Jing9 merged pull request #2704: HDFS-15781. Add metrics for how blocks are moved in replaceBlock.

2021-02-23 Thread GitBox
Jing9 merged pull request #2704: URL: https://github.com/apache/hadoop/pull/2704 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] LeonGao91 commented on pull request #2704: HDFS-15781. Add metrics for how blocks are moved in replaceBlock.

2021-02-23 Thread GitBox
LeonGao91 commented on pull request #2704: URL: https://github.com/apache/hadoop/pull/2704#issuecomment-784823074 Thanks @Jing9 ! Build is good now. This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556752=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556752 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snvijaya commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread GitBox
snvijaya commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r581641007 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsInputStreamStatistics.java ## @@ -100,28 +100,31 @@ public

[jira] [Updated] (HADOOP-17542) Avoid unsafe split and append on fields that might be IPv6 literals

2021-02-23 Thread ANANDA G B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANANDA G B updated HADOOP-17542: Attachment: (was: HDFS-15851_001.patch) > Avoid unsafe split and append on fields that might

[jira] [Updated] (HADOOP-17542) Avoid unsafe split and append on fields that might be IPv6 literals

2021-02-23 Thread ANANDA G B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANANDA G B updated HADOOP-17542: Attachment: HADOOP-17542-HADOOP-11890-001.patch > Avoid unsafe split and append on fields that

[GitHub] [hadoop] Neilxzn opened a new pull request #2719: YARN-10649. fix RMNodeImpl.updateExistContainers leak

2021-02-23 Thread GitBox
Neilxzn opened a new pull request #2719: URL: https://github.com/apache/hadoop/pull/2719 ## detail https://issues.apache.org/jira/browse/YARN-10649 ## test no test This is an automated message from the Apache

[jira] [Created] (HADOOP-17544) Mark KeyProvider as Stable

2021-02-23 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17544: -- Summary: Mark KeyProvider as Stable Key: HADOOP-17544 URL: https://issues.apache.org/jira/browse/HADOOP-17544 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-02-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16748: --- Fix Version/s: 3.2.3 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Work logged] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?focusedWorklogId=556680=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556680 ] ASF GitHub Bot logged work on HADOOP-16748: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?focusedWorklogId=556681=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556681 ] ASF GitHub Bot logged work on HADOOP-16748: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2717: HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2)

2021-02-23 Thread GitBox
aajisaka commented on pull request #2717: URL: https://github.com/apache/hadoop/pull/2717#issuecomment-784692176 The CI looks good. Backported. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] aajisaka merged pull request #2717: HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.2)

2021-02-23 Thread GitBox
aajisaka merged pull request #2717: URL: https://github.com/apache/hadoop/pull/2717 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-23 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17538: -- Fix Version/s: 3.2.3 3.4.0 3.3.1 Hadoop

[jira] [Work logged] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?focusedWorklogId=556611=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556611 ] ASF GitHub Bot logged work on HADOOP-17538: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?focusedWorklogId=556610=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556610 ] ASF GitHub Bot logged work on HADOOP-17538: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #2716: HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index.

2021-02-23 Thread GitBox
iwasakims commented on pull request #2716: URL: https://github.com/apache/hadoop/pull/2716#issuecomment-784567800 Thanks, @ayushtkn. I merged this. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] iwasakims merged pull request #2716: HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index.

2021-02-23 Thread GitBox
iwasakims merged pull request #2716: URL: https://github.com/apache/hadoop/pull/2716 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] Jing9 commented on pull request #2704: HDFS-15781. Add metrics for how blocks are moved in replaceBlock.

2021-02-23 Thread GitBox
Jing9 commented on pull request #2704: URL: https://github.com/apache/hadoop/pull/2704#issuecomment-784514331 The current change looks good to me. +1 @LeonGao91 Could you please re-trigger the build to pass the checks?

[jira] [Updated] (HADOOP-17528) Not closing an SFTP File System instance prevents JVM from exiting.

2021-02-23 Thread Mikhail Pryakhin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Pryakhin updated HADOOP-17528: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Not closing an

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=556501=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556501 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-02-23 Thread GitBox
steveloughran commented on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-784410906 This hits the big milestone of *this has got complicated*. For best-effort tracking of what is the FS operation this thread initiated, we are functionally complete.

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=556498=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556498 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-02-23 Thread GitBox
hadoop-yetus removed a comment on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-782490453 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=556463=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556463 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-02-23 Thread GitBox
hadoop-yetus removed a comment on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-781633493 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17528) Not closing an SFTP File System instance prevents JVM from exiting.

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17528?focusedWorklogId=556461=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556461 ] ASF GitHub Bot logged work on HADOOP-17528: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17528) Not closing an SFTP File System instance prevents JVM from exiting.

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17528?focusedWorklogId=556460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556460 ] ASF GitHub Bot logged work on HADOOP-17528: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2701: HADOOP-17528. SFTP File System: close the connection pool when closing a FileSystem

2021-02-23 Thread GitBox
steveloughran commented on pull request #2701: URL: https://github.com/apache/hadoop/pull/2701#issuecomment-784353570 +1, merged to trunk This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran merged pull request #2701: HADOOP-17528. SFTP File System: close the connection pool when closing a FileSystem

2021-02-23 Thread GitBox
steveloughran merged pull request #2701: URL: https://github.com/apache/hadoop/pull/2701 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556451=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556451 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread GitBox
sumangala-patki commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r581200495 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemRandomRead.java ## @@ -405,6 +418,27

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556450=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556450 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread GitBox
sumangala-patki commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r581199945 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsInputStreamStatistics.java ## @@ -100,28 +100,31 @@

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556439=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556439 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread GitBox
bilaharith commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r581177965 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemRandomRead.java ## @@ -203,23 +203,36 @@

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556431=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556431 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread GitBox
bilaharith commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r581177965 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemRandomRead.java ## @@ -203,23 +203,36 @@

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=556400=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556400 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-23 Thread GitBox
vinaysbadami commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r580787165 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsInputStreamStatistics.java ## @@ -100,28 +100,31 @@

[GitHub] [hadoop] touchida commented on pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-02-23 Thread GitBox
touchida commented on pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#issuecomment-784237132 @ferhui @jojochuang Thanks for taking a look at my PR! Sorry for being inactive for a while. I'll resume it from the next week. >

[jira] [Commented] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

2021-02-23 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289079#comment-17289079 ] Bhavik Patel commented on HADOOP-17532: --- can you please review the patch [~tasanuma] / 

[jira] [Updated] (HADOOP-17543) HDFS Put was failed with IPV6 cluster

2021-02-23 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17543: -- Parent: HADOOP-11890 Issue Type: Sub-task (was: Improvement) > HDFS

[jira] [Moved] (HADOOP-17543) HDFS Put was failed with IPV6 cluster

2021-02-23 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula moved HDFS-15852 to HADOOP-17543: -- Component/s: (was: hdfs)

[jira] [Updated] (HADOOP-17542) Avoid unsafe split and append on fields that might be IPv6 literals

2021-02-23 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17542: -- Parent: HADOOP-11890 Issue Type: Sub-task (was: Bug) > Avoid unsafe

[GitHub] [hadoop] tomscut opened a new pull request #2718: HDFS-15854. Make some parameters configurable for SlowDiskTracker and…

2021-02-23 Thread GitBox
tomscut opened a new pull request #2718: URL: https://github.com/apache/hadoop/pull/2718 JIRA: https://issues.apache.org/jira/browse/HDFS-15854 Make some parameters configurable for SlowDiskTracker and SlowPeerTracker. Related to the previous issue: HDFS-15814.

[jira] [Moved] (HADOOP-17542) Avoid unsafe split and append on fields that might be IPv6 literals

2021-02-23 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula moved HDFS-15851 to HADOOP-17542: -- Component/s: (was: hdfs) Fix

[jira] [Work logged] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?focusedWorklogId=556326=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556326 ] ASF GitHub Bot logged work on HADOOP-17538: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2716: HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index.

2021-02-23 Thread GitBox
ayushtkn commented on a change in pull request #2716: URL: https://github.com/apache/hadoop/pull/2716#discussion_r581024554 ## File path: hadoop-project/src/site/site.xml ## @@ -216,6 +216,8 @@ + + Review comment: Thanx @iwasakims

[jira] [Work logged] (HADOOP-17538) Add kms-default.xml and httpfs-default.xml to site index

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17538?focusedWorklogId=556276=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556276 ] ASF GitHub Bot logged work on HADOOP-17538: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on a change in pull request #2716: HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index.

2021-02-23 Thread GitBox
iwasakims commented on a change in pull request #2716: URL: https://github.com/apache/hadoop/pull/2716#discussion_r580950214 ## File path: hadoop-project/src/site/site.xml ## @@ -216,6 +216,8 @@ + + Review comment: > since some are

[jira] [Work logged] (HADOOP-17514) Remove trace subcommand from hadoop CLI

2021-02-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17514?focusedWorklogId=556250=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-556250 ] ASF GitHub Bot logged work on HADOOP-17514: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #2680: HADOOP-17514. Remove trace subcommand from hadoop CLI.

2021-02-23 Thread GitBox
iwasakims commented on pull request #2680: URL: https://github.com/apache/hadoop/pull/2680#issuecomment-784053049 @jojochuang TraceAdmin protocol was removed by @smengcl because it is not needed alternative tracer impl. https://github.com/apache/hadoop/pull/2645#issuecomment-768251870