[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Status: Patch Available (was: Open) > Add computation time metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Attachment: HDFS-8410-003.patch 1. Rebase patch against trunk 2. Improve test function > Add computation

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Attachment: HDFS-8312-branch-2.8.01.patch > Trash does not descent into child directories to check for

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-10885: Attachment: HDFS-10885-HDFS-10285.03.patch Patch renamed for branch HDFS-10285. Thanks! > [SPS]: Mover

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584430#comment-15584430 ] Hadoop QA commented on HDFS-10885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-10885: Attachment: HDFS-10800-HDFS-10885-02.patch Reupload the patch to trigger Q Thanks! > [SPS]: Mover tool

[jira] [Updated] (HDFS-11020) Add more doc for HDFS transparent encryption

[ https://issues.apache.org/jira/browse/HDFS-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-11020: -- Assignee: Jennica Pounds (was: Yi Liu) > Add more doc for HDFS transparent encryption >

[jira] [Commented] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584335#comment-15584335 ] Brahma Reddy Battula commented on HDFS-10712: - [~shv] please update the CHANGES.txt in

[jira] [Commented] (HDFS-11015) Enforce timeout in balancer

[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584181#comment-15584181 ] Zhe Zhang commented on HDFS-11015: -- [~mwagner] Has been working on a related issue HDFS-10966. > Enforce

[jira] [Commented] (HDFS-11015) Enforce timeout in balancer

[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584179#comment-15584179 ] Zhe Zhang commented on HDFS-11015: -- Thanks for the patch Kihwal. A while ago I reported a similar issue

[jira] [Updated] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10712: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4

[jira] [Assigned] (HDFS-8410) Add computation time metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-8410: --- Assignee: SammiChen (was: Li Bo) > Add computation time metrics to datanode for ECWorker >

[jira] [Commented] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584157#comment-15584157 ] Konstantin Shvachko commented on HDFS-10712: +1. > Fix TestDataNodeVolumeFailure on 2.*

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584151#comment-15584151 ] Brahma Reddy Battula commented on HDFS-10301: - CHANGES.txt is not updated in branch-2.7, can

[jira] [Commented] (HDFS-7674) [umbrella] Adding metrics for Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584125#comment-15584125 ] Andrew Wang commented on HDFS-7674: --- Thanks [~Sammi]! > [umbrella] Adding metrics for Erasure Coding >

[jira] [Commented] (HDFS-7674) [umbrella] Adding metrics for Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584117#comment-15584117 ] SammiChen commented on HDFS-7674: - Hi Andrew, it seems these tasks cannot be closed so far. I will take

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584103#comment-15584103 ] Takanobu Asanuma commented on HDFS-10975: - The failed tests don't seem to be related. > fsck

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8672) Erasure Coding: Add EC-related Metrics to NN (seperate striped blocks count from UnderReplicatedBlocks count)

[ https://issues.apache.org/jira/browse/HDFS-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584097#comment-15584097 ] Rui Gao commented on HDFS-8672: --- Hi [~andrew.wang], I agree with you. Separating recovery-related metrics of

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584077#comment-15584077 ] Konstantin Shvachko commented on HDFS-10301: All failed tests pass locally on branch-2.7.

[jira] [Commented] (HDFS-9390) Block management for maintenance states

[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584047#comment-15584047 ] Hadoop QA commented on HDFS-9390: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9390) Block management for maintenance states

[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584023#comment-15584023 ] Hudson commented on HDFS-9390: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10628 (See

[jira] [Updated] (HDFS-9390) Block management for maintenance states

[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status: Resolved (was:

[jira] [Resolved] (HDFS-8662) In failover state, HDFS commands fail on "Retrying connect to server:"

[ https://issues.apache.org/jira/browse/HDFS-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8662. --- Resolution: Not A Problem Resolving per Nicholas' comment, this looks like it's working as intended.

[jira] [Updated] (HDFS-10427) Write and Read SequenceFile Parallelly - java.io.IOException: Cannot obtain block length for LocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-10427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10427: --- Priority: Critical (was: Blocker) > Write and Read SequenceFile Parallelly - java.io.IOException:

[jira] [Updated] (HDFS-7229) Revisit the public API of the libraries

[ https://issues.apache.org/jira/browse/HDFS-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7229: -- Affects Version/s: HDFS-6994 Target Version/s: HDFS-6994 > Revisit the public API of the libraries

[jira] [Updated] (HDFS-7229) Revisit the public API of the libraries

[ https://issues.apache.org/jira/browse/HDFS-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7229: -- Component/s: native > Revisit the public API of the libraries > ---

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583947#comment-15583947 ] Hadoop QA commented on HDFS-11011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583944#comment-15583944 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583932#comment-15583932 ] Hadoop QA commented on HDFS-8674: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-3161) 20 Append: Excluded DN replica from recovery should be removed from DN.

[ https://issues.apache.org/jira/browse/HDFS-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3161: -- Target Version/s: (was: 1.3.0) Doing some old JIRA cleanup. I know it's been years, but Uma / Vinay do

[jira] [Updated] (HDFS-4493) webhdfs fails after SPNEGO token expires

[ https://issues.apache.org/jira/browse/HDFS-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4493: -- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.1.0-beta) > webhdfs fails after SPNEGO token expires >

[jira] [Updated] (HDFS-4389) Non-HA DFSClients do not attempt reconnects

[ https://issues.apache.org/jira/browse/HDFS-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4389: -- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.0.3-alpha) > Non-HA DFSClients do not attempt reconnects

[jira] [Updated] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8893: -- Target Version/s: 2.7.4, 3.0.0-alpha2 (was: 2.7.4) > DNs with failed volumes stop serving during

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8674: -- Target Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2 (was: 2.7.4) Added some more target versions for tracking.

[jira] [Updated] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

[ https://issues.apache.org/jira/browse/HDFS-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11022: --- Description: Scenario: # A client reads a replica blk_A_x from a data node and detected

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583910#comment-15583910 ] Hadoop QA commented on HDFS-9820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-3153) For HA, a logical name is visible in URIs - add an explicit logical name

[ https://issues.apache.org/jira/browse/HDFS-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3153. --- Resolution: Won't Fix I'm going to WONTFIX this one per ATM's last comment, and since it involves

[jira] [Resolved] (HDFS-4368) Backport HDFS-3553 (hftp proxy tokens) to branch-1

[ https://issues.apache.org/jira/browse/HDFS-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-4368. --- Resolution: Won't Fix I'm going to WONTFIX this one, since it's been alive for almost 4 years, and

[jira] [Commented] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583896#comment-15583896 ] Hadoop QA commented on HDFS-10998: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Attachment: HDFS-9820.branch-2.patch Hi [~andrew.wang], I had to cherry-pick HADOOP-13034 from

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10301: --- Target Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2, 2.6.6 (was: 2.6.6) > BlockReport retransmissions may

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10301: --- Fix Version/s: 3.0.0-alpha2 2.8.0 > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583880#comment-15583880 ] Weiwei Yang commented on HDFS-8312: --- Per discussion in HADOOP-10922

[jira] [Updated] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-1950: -- Status: Open (was: Patch Available) > Blocks that are under construction are not getting read if the

[jira] [Commented] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583876#comment-15583876 ] Hadoop QA commented on HDFS-1950: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

[ https://issues.apache.org/jira/browse/HDFS-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11022: --- Comment: was deleted (was: Attach a diagram if it is easier for people to understand.) >

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583868#comment-15583868 ] Weiwei Yang commented on HDFS-10922: Great thanks a lot [~xyao] > Adding additional unit tests for

[jira] [Updated] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-1950: -- Target Version/s: (was: 1.3.0) Priority: Major (was: Blocker) Considering this issue has

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583864#comment-15583864 ] Mingliang Liu commented on HDFS-11011: -- Thanks for your patch [~xiaobingo]. It looks good to me

[jira] [Commented] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583863#comment-15583863 ] Hadoop QA commented on HDFS-10752: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583856#comment-15583856 ] John Zhuge commented on HDFS-10684: --- Oops, forgot about it. Resume shortly. > WebHDFS DataNode calls

[jira] [Assigned] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

[ https://issues.apache.org/jira/browse/HDFS-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10733: Assignee: Vinitha Reddy Gankidi > NameNode terminated after full GC

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583812#comment-15583812 ] Xiaobing Zhou commented on HDFS-11016: -- Hold off doing the similar changes like HDFS-11011 v002 since

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583802#comment-15583802 ] Zhe Zhang commented on HDFS-10872: -- Thanks Erik for the updated patch. I think we are pretty close.

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583786#comment-15583786 ] Xiaobing Zhou commented on HDFS-11011: -- v002 moved tests to TestQuote. > Add unit tests for HDFS

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Attachment: HDFS-11011.002.patch > Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583770#comment-15583770 ] Hadoop QA commented on HDFS-5517: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10957) Retire BKJM from trunk

[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10957: --- Component/s: ha > Retire BKJM from trunk > -- > > Key: HDFS-10957

[jira] [Updated] (HDFS-10957) Retire BKJM from trunk

[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10957: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Release Note: The BookkeeperJournalManager

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583752#comment-15583752 ] Andrew Wang commented on HDFS-5517: --- I'm also updating the target version, since strictly speaking we

[jira] [Commented] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

[ https://issues.apache.org/jira/browse/HDFS-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583753#comment-15583753 ] Manoj Govindassamy commented on HDFS-11022: --- Sounds similar to the case as in HDFS-10819, except

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Target Version/s: 3.0.0-alpha2 (was: 2.8.0) > Lower the default maximum number of blocks per file >

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583749#comment-15583749 ] Andrew Wang commented on HDFS-5517: --- Hi [~atm], looks like this patch has gone stale. Do you want to

[jira] [Commented] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583707#comment-15583707 ] Xiaobing Zhou commented on HDFS-10998: -- Posted v000 patch, please kindly review it, thanks. > Add

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10998: - Status: Patch Available (was: Open) > Add unit tests for HDFS command 'dfsadmin -fetchImage' in

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10998: - Attachment: HDFS-10998.000.patch > Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA >

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10998: - Description: This proposes adding unit tests to verify fetchImage works well in the case of HA.

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10998: - Summary: Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA (was: Add unit tests for

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583691#comment-15583691 ] Andrew Wang commented on HDFS-10999: Turns out we already have JIRAs for some of these, I did file

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583689#comment-15583689 ] Andrew Wang commented on HDFS-6682: --- Thanks Akira. I filed HDFS-11024 for adding rate metrics for

[jira] [Created] (HDFS-11024) Add rate metrics for block recovery work

Andrew Wang created HDFS-11024: -- Summary: Add rate metrics for block recovery work Key: HDFS-11024 URL: https://issues.apache.org/jira/browse/HDFS-11024 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

[ https://issues.apache.org/jira/browse/HDFS-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11022: --- Attachment: (was: HDFS-11022.png) > DataNode unable to remove corrupt block replica due

[jira] [Updated] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

[ https://issues.apache.org/jira/browse/HDFS-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11022: --- Attachment: HDFS-11022.png Attach a diagram if it is easier for people to understand. >

[jira] [Created] (HDFS-11023) I/O based throttling of DN replication work

Andrew Wang created HDFS-11023: -- Summary: I/O based throttling of DN replication work Key: HDFS-11023 URL: https://issues.apache.org/jira/browse/HDFS-11023 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

[ https://issues.apache.org/jira/browse/HDFS-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11022: --- Attachment: HDFS-11022.png Attach a diagram if it is easier for people to understand. >

[jira] [Created] (HDFS-11022) DataNode unable to remove corrupt block replica due to race condition

Wei-Chiu Chuang created HDFS-11022: -- Summary: DataNode unable to remove corrupt block replica due to race condition Key: HDFS-11022 URL: https://issues.apache.org/jira/browse/HDFS-11022 Project:

[jira] [Commented] (HDFS-7674) [umbrella] Adding metrics for Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583670#comment-15583670 ] Andrew Wang commented on HDFS-7674: --- Hi folks, do we think we can close on these metrics-related tasks?

[jira] [Commented] (HDFS-8672) Erasure Coding: Add EC-related Metrics to NN (seperate striped blocks count from UnderReplicatedBlocks count)

[ https://issues.apache.org/jira/browse/HDFS-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583667#comment-15583667 ] Andrew Wang commented on HDFS-8672: --- Hi folks, any update on this JIRA? We've been having a related

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10752: -- Status: Patch Available (was: Open) > Several log refactoring/improvement suggestion in HDFS >

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10752: -- Attachment: HDFS-10752.000.patch - HDFS-10749 already resolved - Replaced

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583660#comment-15583660 ] Andrew Wang commented on HDFS-10999: bq. Are we exposing how many blocks are EC blocks and how many

[jira] [Commented] (HDFS-11013) Correct typos in native erasure coding dump code

[ https://issues.apache.org/jira/browse/HDFS-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583571#comment-15583571 ] Hudson commented on HDFS-11013: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10627 (See

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583568#comment-15583568 ] Hudson commented on HDFS-10922: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10627 (See

[jira] [Commented] (HDFS-11009) Add a tool to reconstruct block meta file from CLI

[ https://issues.apache.org/jira/browse/HDFS-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583554#comment-15583554 ] Andrew Wang commented on HDFS-11009: Thanks for working on this Xiao. Looks good overall, though a few

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.branch-2.7.015.patch > BlockReport retransmissions may

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583534#comment-15583534 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Attached the patch for branch-2.7. >

[jira] [Updated] (HDFS-10922) Adding additional unit tests for Trash (II)

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10922: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583517#comment-15583517 ] Yongjun Zhang commented on HDFS-9820: - Hi [~andrew.wang], Thanks for asking, I'm actually in the

[jira] [Assigned] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-10752: - Assignee: Hanisha Koneru > Several log refactoring/improvement suggestion in HDFS >

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583505#comment-15583505 ] Xiaoyu Yao commented on HDFS-10922: --- bq. Unfortunately HADOOP-12984 was not committed to branch 2.8.

[jira] [Updated] (HDFS-11013) Correct typos in native erasure coding dump code

[ https://issues.apache.org/jira/browse/HDFS-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11013: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583481#comment-15583481 ] Andrew Wang commented on HDFS-9820: --- Hi Yongjun, looks like this was committed to trunk but not the

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583457#comment-15583457 ] Andrew Wang commented on HDFS-10684: Hi [~jzhuge], any update on this issue? > WebHDFS DataNode calls

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583442#comment-15583442 ] Xiaoyu Yao commented on HDFS-10906: --- [~hanishakoneru], thanks for the update. Patch v4 looks good to me.

[jira] [Updated] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10654: --- Target Version/s: 3.0.0-alpha2 (was: 3.0.0-alpha1) > Move building of httpfs dependency analysis

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583331#comment-15583331 ] Hudson commented on HDFS-9820: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10624 (See

[jira] [Updated] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10906: -- Attachment: HDFS-10906.004.patch Fixing checkstyle errors in patch v4. Unit tests pass locally.

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: HDFS-10872.002.patch Attaching v002 patch addressing findbugs and checkstyle. Unit test

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583295#comment-15583295 ] Hadoop QA commented on HDFS-10906: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >