[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367011#comment-17367011 ] Hadoop QA commented on HDFS-16044: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367009#comment-17367009 ] Hadoop QA commented on HDFS-16044: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Attachment: HDFS-16044.03.patch > getListing call getLocatedBlocks even source is a directory >

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Attachment: (was: HDFS-16044.03.patch) > getListing call getLocatedBlocks even source is a directory >

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Attachment: HDFS-16044.03.patch > getListing call getLocatedBlocks even source is a directory >

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366932#comment-17366932 ] Hadoop QA commented on HDFS-16067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366930#comment-17366930 ] Hadoop QA commented on HDFS-16067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15785) Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15785?focusedWorklogId=612871=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612871 ] ASF GitHub Bot logged work on HDFS-15785: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?focusedWorklogId=612859=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612859 ] ASF GitHub Bot logged work on HDFS-16082: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

2021-06-21 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366784#comment-17366784 ] Renukaprasad C commented on HDFS-14575: --- Thank you [~hexiaoqiao] & [~weichiu] for review and

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366782#comment-17366782 ] Ahmed Hussein commented on HDFS-15150: -- Hi [~sodonnell] can you please commit the 003 patch into

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-21 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366780#comment-17366780 ] Renukaprasad C commented on HDFS-16067: --- Thanks [~hexiaoqiao] for quick update. I had update the

[jira] [Updated] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-21 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renukaprasad C updated HDFS-16067: -- Attachment: HDFS-16067.003.patch > Support Append API in NNThroughputBenchmark >

[jira] [Updated] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16072: -- Labels: pull-request-available (was: ) > TestBlockRecovery fails consistently on Branch-2.10

[jira] [Work logged] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?focusedWorklogId=612806=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612806 ] ASF GitHub Bot logged work on HDFS-16072: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?focusedWorklogId=612807=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612807 ] ASF GitHub Bot logged work on HDFS-16072: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16084) getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed

2021-06-21 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated HDFS-16084: -- Description: First reported in ARROW-13011: when a libhdfs API call fails because CLASSPATH

[jira] [Created] (HDFS-16084) getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed

2021-06-21 Thread Antoine Pitrou (Jira)
Antoine Pitrou created HDFS-16084: - Summary: getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed Key: HDFS-16084 URL: https://issues.apache.org/jira/browse/HDFS-16084

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366728#comment-17366728 ] Xiaoqiao He commented on HDFS-16044: Please check report by Yetus, include checkstyle and failed unit

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366727#comment-17366727 ] Xiaoqiao He commented on HDFS-16067: Thanks [~prasad-acit] for your update. {quote}A. Regarding

[jira] [Updated] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

2021-06-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14575: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Work logged] (HDFS-16043) HDFS : Delete performance optimization

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=612758=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612758 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16043) HDFS : Delete performance optimization

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=612741=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612741 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Work started] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16072 started by Ahmed Hussein. > TestBlockRecovery fails consistently on Branch-2.10 >

[jira] [Work logged] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?focusedWorklogId=612705=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612705 ] ASF GitHub Bot logged work on HDFS-16082: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?focusedWorklogId=612696=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612696 ] ASF GitHub Bot logged work on HDFS-16082: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

2021-06-21 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16083: - Attachment: HDFS-16083.001.patch > Forbid Observer NameNode trigger active namenode log roll >

[jira] [Created] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

2021-06-21 Thread lei w (Jira)
lei w created HDFS-16083: Summary: Forbid Observer NameNode trigger active namenode log roll Key: HDFS-16083 URL: https://issues.apache.org/jira/browse/HDFS-16083 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2021-06-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366611#comment-17366611 ] Hadoop QA commented on HDFS-13916: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-16081) List a large directory, the client waits for a long time

2021-06-21 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16081: - Description: When we list a large directory, we need to wait a lot of time. This is because the NameNode only

[jira] [Comment Edited] (HDFS-16081) List a large directory, the client waits for a long time

2021-06-21 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366440#comment-17366440 ] lei w edited comment on HDFS-16081 at 6/21/21, 12:46 PM: - Our cluster

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2021-06-21 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366562#comment-17366562 ] Masatake Iwasaki commented on HDFS-13916: - I rebased the patch on behalf of [~renxunsaky].

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2021-06-21 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-13916: Attachment: HDFS-13916.007.patch > Distcp SnapshotDiff to support WebHDFS >

[jira] [Work logged] (HDFS-16043) HDFS : Delete performance optimization

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?focusedWorklogId=612565=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612565 ] ASF GitHub Bot logged work on HDFS-16043: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16076) Avoid using slow DataNodes for reading by sorting locations

2021-06-21 Thread tomscut (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut updated HDFS-16076: --- External issue URL: (was: https://github.com/apache/hadoop/pull/3117) > Avoid using slow DataNodes for

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366495#comment-17366495 ] Hadoop QA commented on HDFS-16044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15140) Replace FoldedTreeSet in Datanode with SortedSet or TreeMap

2021-06-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15140: - Resolution: Won't Fix Status: Resolved (was: Patch Available) HDFS-13671 has

[jira] [Resolved] (HDFS-15131) FoldedTreeSet appears to degrade over time

2021-06-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15131. -- Resolution: Won't Fix HDFS-13671 is now committed which removes the FoldedTreeSet from

[jira] [Work logged] (HDFS-16076) Avoid using slow DataNodes for reading by sorting locations

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16076?focusedWorklogId=612515=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612515 ] ASF GitHub Bot logged work on HDFS-16076: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16082: Status: Patch Available (was: In Progress) > Avoid non-atomic operations on

[jira] [Work started] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16082 started by Viraj Jasani. --- > Avoid non-atomic operations on exceptionsSinceLastBalance and >

[jira] [Work logged] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?focusedWorklogId=612504=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612504 ] ASF GitHub Bot logged work on HDFS-16082: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16082: -- Labels: pull-request-available (was: ) > Avoid non-atomic operations on

[jira] [Work logged] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2021-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?focusedWorklogId=612503=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-612503 ] ASF GitHub Bot logged work on HDFS-13522: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16082: Target Version/s: 3.4.0, 3.3.2 > Avoid non-atomic operations on exceptionsSinceLastBalance and >

[jira] [Created] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

2021-06-21 Thread Viraj Jasani (Jira)
Viraj Jasani created HDFS-16082: --- Summary: Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer Key: HDFS-16082 URL:

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366460#comment-17366460 ] ludun commented on HDFS-16044: -- sorry, my locale code is different from trunk. i upload a new patch. >

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Attachment: HDFS-16044.02.patch > getListing call getLocatedBlocks even source is a directory >

[jira] [Commented] (HDFS-16081) List a large directory, the client waits for a long time

2021-06-21 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366440#comment-17366440 ] lei w commented on HDFS-16081: -- Our cluster dfs.ls.limit is not configured. In many cases, there will be

[jira] [Created] (HDFS-16081) List a large directory, the client waits for a long time

2021-06-21 Thread lei w (Jira)
lei w created HDFS-16081: Summary: List a large directory, the client waits for a long time Key: HDFS-16081 URL: https://issues.apache.org/jira/browse/HDFS-16081 Project: Hadoop HDFS Issue Type: