[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565845#comment-15565845 ] Weiwei Yang commented on HDFS-10922: I will add # testHDFSTrashPermission # testMoveEmptyDirToTrash

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565639#comment-15565639 ] Mehran Hassani commented on HDFS-9618: -- That make sense ;), Thanks! > Fix mismatch between log level

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565729#comment-15565729 ] Ming Ma commented on HDFS-10967: Thanks [~zhz] for the summary! * Good idea to merge

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565805#comment-15565805 ] Kihwal Lee commented on HDFS-10987: --- bq. IIUC,Daryn Sharp was doing finegrained locking which is big

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Attachment: HDFS-10884-HDFS-10285-03.patch I've rebased the previous patch in latest branch code, also done

[jira] [Commented] (HDFS-10933) Refactor TestFsck

[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565158#comment-15565158 ] Hadoop QA commented on HDFS-10933: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-8041. -- Resolution: Won't Fix While this jira makes balancing more aggressive when free space is low, there are

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8041: - Status: Open (was: Patch Available) > Consider remaining space during block blockplacement if dfs space

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565178#comment-15565178 ] Hadoop QA commented on HDFS-10922: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566409#comment-15566409 ] Hadoop QA commented on HDFS-10995: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566485#comment-15566485 ] Andrew Wang commented on HDFS-10971: Thanks for commenting Zhe, good thoughts, bq. Extending this

[jira] [Created] (HDFS-10996) Ability to specify per-file EC policy at create time

Andrew Wang created HDFS-10996: -- Summary: Ability to specify per-file EC policy at create time Key: HDFS-10996 URL: https://issues.apache.org/jira/browse/HDFS-10996 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-10638: - Assignee: Virajith Jalaparti > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Attachment: HDFS-10638.004.patch Modified patch based on the final patch for

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Status: Patch Available (was: Open) > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Status: Open (was: Patch Available) > Route webhdfs through the RPC call queue >

[jira] [Commented] (HDFS-10992) file is under construction but no leases found

[ https://issues.apache.org/jira/browse/HDFS-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566272#comment-15566272 ] Rushabh S Shah commented on HDFS-10992: --- I think it is fixed in 2.7.4 and 2.7.1.2.3.0.0-2557 is

[jira] [Commented] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566630#comment-15566630 ] Andrew Wang commented on HDFS-10916: Thanks Eddy for review and commit! > Switch from "raw" to

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986.003.patch > DFSAdmin should log detailed error message if any >

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986-branch-2.8.003.patch > DFSAdmin should log detailed error message if any >

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1551#comment-1551 ] Andrew Wang commented on HDFS-10967: Thanks for the ping Zhe, I'm okay with changing the configuration

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566678#comment-15566678 ] Mingliang Liu commented on HDFS-10986: -- Thanks for the review, [~xiaobingo]. {quote} You might want

[jira] [Updated] (HDFS-10995) Ozone : move ozone client to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10995: -- Attachment: HDFS-10995-HDFS-7240.001.patch To make it easier to review, the 001 patch only moved

[jira] [Updated] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10995: -- Summary: Ozone : move ozone XceiverClient to hdfs-client (was: Ozone : move ozone client to

[jira] [Updated] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10995: -- Status: Patch Available (was: Open) > Ozone : move ozone XceiverClient to hdfs-client >

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565940#comment-15565940 ] Xiaobing Zhou commented on HDFS-10986: -- [~liuml07] thanks for the patch, LGTM. Minor comments: 1. You

[jira] [Updated] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10916: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Patch Available (was: Open) Thanks [~xyao]. I ran these tests manually and all three

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Attachment: HDFS-10984.v4.patch > Expose nntop output as metrics >

[jira] [Updated] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10429: --- Attachment: HDFS-10429.3.patch [~aplusplus] I'd like to submit a new patch: Here's a new

[jira] [Updated] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10906: -- Attachment: HDFS-10906.001.patch Fixed indentation errors > Add unit tests for Trash with HDFS

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566111#comment-15566111 ] Zhe Zhang commented on HDFS-10971: -- Thanks for the discussions Andrew / Wei-Chiu. For the initial 3.0

[jira] [Created] (HDFS-10995) Ozone : move ozone client to hdfs-client

Chen Liang created HDFS-10995: - Summary: Ozone : move ozone client to hdfs-client Key: HDFS-10995 URL: https://issues.apache.org/jira/browse/HDFS-10995 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566082#comment-15566082 ] Xiaoyu Yao commented on HDFS-10984: --- Thanks [~swagle] for updating the patch. Patch v3 looks good to me.

[jira] [Updated] (HDFS-10984) Expose nntop output as metrics

[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-10984: --- Status: Open (was: Patch Available) Cancelling to fix checkStyle. > Expose nntop output as

[jira] [Commented] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566017#comment-15566017 ] Hudson commented on HDFS-10916: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10586 (See

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566068#comment-15566068 ] Hadoop QA commented on HDFS-10429: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566155#comment-15566155 ] Xiaobing Zhou commented on HDFS-10965: -- Thanks [~liuml07] for reviews. Posted v005 to fix that. >

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Summary: Modifications to remove the assumption that StorageLocation is associated with

[jira] [Assigned] (HDFS-10983) OIV tool should make an EC file explicit

[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HDFS-10983: Assignee: Lei (Eddy) Xu > OIV tool should make an EC file explicit >

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566344#comment-15566344 ] Hadoop QA commented on HDFS-10984: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10965: - Attachment: HDFS-10965.005.patch > Add unit test for HDFS command 'dfsadmin -printTopology' >

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10903: -- Attachment: HDFS-10903.003.patch Thanks [~liuml07] for the comments, uploaded v03 patch to include

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566337#comment-15566337 ] Hadoop QA commented on HDFS-10906: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Attachment: HDFS-10789-2.patch > Route webhdfs through the RPC call queue >

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Status: Patch Available (was: Open) > Route webhdfs through the RPC call queue >

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566341#comment-15566341 ] Wei-Chiu Chuang commented on HDFS-10971: That sounds an easy solution. I can check the replication

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566360#comment-15566360 ] Hadoop QA commented on HDFS-10965: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567108#comment-15567108 ] Kai Zheng commented on HDFS-10971: -- HSM storage policy is per file, erasure coding policy could also be

[jira] [Comment Edited] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567108#comment-15567108 ] Kai Zheng edited comment on HDFS-10971 at 10/12/16 12:39 AM: - HSM storage

[jira] [Commented] (HDFS-10933) Refactor TestFsck

[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567133#comment-15567133 ] Takanobu Asanuma commented on HDFS-10933: - Thank you for your help and committing, [~jojochuang]!

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10965: - Attachment: HDFS-10965-branch-2.8.006.patch > Add unit test for HDFS command 'dfsadmin

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567000#comment-15567000 ] Xiaobing Zhou commented on HDFS-10965: -- Posted branch-2.8 patch. > Add unit test for HDFS command

[jira] [Created] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

Wei-Chiu Chuang created HDFS-10999: -- Summary: Use more generic "low redundancy" blocks instead of "under replicated" blocks Key: HDFS-10999 URL: https://issues.apache.org/jira/browse/HDFS-10999

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567021#comment-15567021 ] Hadoop QA commented on HDFS-10789: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567017#comment-15567017 ] Hudson commented on HDFS-10903: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10592 (See

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567015#comment-15567015 ] Xiaobing Zhou commented on HDFS-10986: -- Good catch for the hard coded ip and port, thanks for the

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.02.patch > Refactor: Wrap Datanode IO related operations >

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566714#comment-15566714 ] Mingliang Liu commented on HDFS-10965: -- {code} baseDir.mkdirs(); {code} This is not necessary?

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Status: Open (was: Patch Available) forgot to address checkstyle in NameNodeRpcServer.java

[jira] [Commented] (HDFS-10991) libhdfs : Client compilation is failing for hdfsTruncateFile API

[ https://issues.apache.org/jira/browse/HDFS-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566756#comment-15566756 ] Andrew Wang commented on HDFS-10991: LGTM +1, let's get this in. > libhdfs : Client compilation is

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566775#comment-15566775 ] Xiaobing Zhou commented on HDFS-10965: -- v006 fixed it, thanks. > Add unit test for HDFS command

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566800#comment-15566800 ] Hadoop QA commented on HDFS-10638: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10991) Export hdfsTruncateFile symbol in libhdfs

[ https://issues.apache.org/jira/browse/HDFS-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566799#comment-15566799 ] Hudson commented on HDFS-10991: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10590 (See

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Status: Open (was: Patch Available) > Modifications to remove the assumption that

[jira] [Resolved] (HDFS-3554) TestRaidNode is failing

[ https://issues.apache.org/jira/browse/HDFS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3554. --- Resolution: Won't Fix Resolving since HDFS-RAID has been removed from Hadoop. > TestRaidNode is

[jira] [Resolved] (HDFS-4360) multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer

[ https://issues.apache.org/jira/browse/HDFS-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-4360. --- Resolution: Won't Fix Resolving since HDFS-RAID has been removed from Hadoop. > multiple BlockFixer

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566884#comment-15566884 ] Mingliang Liu commented on HDFS-10965: -- +1 pending on Jenkins > Add unit test for HDFS command

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566890#comment-15566890 ] Virajith Jalaparti commented on HDFS-10638: --- Hi [~eddyxu], I have fixed this in the new patch

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566967#comment-15566967 ] Mingliang Liu commented on HDFS-10903: -- +1 > Replace config key literal strings with config key

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566966#comment-15566966 ] Mingliang Liu commented on HDFS-10903: -- Committed to {{trunk}} branch. Can you also provide a

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566970#comment-15566970 ] Mingliang Liu commented on HDFS-10986: -- [~brahmareddy] Can you review the v3 patch? Thanks. >

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567156#comment-15567156 ] Andrew Wang commented on HDFS-9820: --- Thanks for the replies Yongjun, sounds good. Took another look, some

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.005.patch The v5 version rebased from {{trunk}} branch and resolved minor

[jira] [Commented] (HDFS-10938) Ozone: SCM: Add datanode protocol

[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567313#comment-15567313 ] Xiaoyu Yao commented on HDFS-10938: --- Thanks [~anu] for reporting the issue and posting the patch. The

[jira] [Commented] (HDFS-10994) Support an XOR policy in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567269#comment-15567269 ] Kai Zheng commented on HDFS-10994: -- I re-phrased some bit, and changed the policy name from

[jira] [Updated] (HDFS-10994) Support an XOR policy in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10994: - Description: So far, "hdfs erasurecode" command supports three policies, RS-DEFAULT-3-2-64k,

[jira] [Issue Comment Deleted] (HDFS-10994) Support an XOR policy in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10994: - Comment: was deleted (was: I re-phrased some bit, and changed the policy name from {{XOR-2-1-64k}} to

[jira] [Assigned] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-10999: - Assignee: Yuanbo Liu > Use more generic "low redundancy" blocks instead of "under replicated"

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10990: - Attachment: HDFS-10990.003.patch Thanks [~andrew.wang] for the review and comments. Attach a new patch to

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567410#comment-15567410 ] Hudson commented on HDFS-10965: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10594 (See

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567458#comment-15567458 ] Hadoop QA commented on HDFS-10990: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567237#comment-15567237 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10994) Support an XOR policy in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10994: - Summary: Support an XOR policy in HDFS (was: Support "XOR-2-1-64k" policy in "hdfs erasurecode" command)

[jira] [Updated] (HDFS-10994) Support an XOR policy in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10994: - Description: So far, "hdfs erasurecode" command supports three policies, RS-DEFAULT-3-2-64k,

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567282#comment-15567282 ] Xiaoyu Yao commented on HDFS-10912: --- Thanks [~anu] for the update. The patch v03 looks good to me. One

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567331#comment-15567331 ] Hadoop QA commented on HDFS-10965: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10965: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10974) Document replication factor for EC files.

[ https://issues.apache.org/jira/browse/HDFS-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10974: - Attachment: HDFS-10974.002.patch Thanks [~drankye] for the comments Attach a new patch to redefined the

[jira] [Updated] (HDFS-10994) Support "XOR-2-1-64k" policy in "hdfs erasurecode" command

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10994: --- Affects Version/s: 3.0.0-alpha1 > Support "XOR-2-1-64k" policy in "hdfs erasurecode" command >

[jira] [Updated] (HDFS-10994) Support "XOR-2-1-64k" policy in "hdfs erasurecode" command

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10994: --- Labels: hdfs-ec-3.0-must-do (was: ) > Support "XOR-2-1-64k" policy in "hdfs erasurecode" command >

[jira] [Updated] (HDFS-10994) Support "XOR-2-1-64k" policy in "hdfs erasurecode" command

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10994: --- Issue Type: Sub-task (was: Task) Parent: HDFS-8031 > Support "XOR-2-1-64k" policy in "hdfs

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566746#comment-15566746 ] Daryn Sharp commented on HDFS-10301: It appears to be generally fine. One small comment is that I

[jira] [Created] (HDFS-10997) Reduce number of path resolving methods

Daryn Sharp created HDFS-10997: -- Summary: Reduce number of path resolving methods Key: HDFS-10997 URL: https://issues.apache.org/jira/browse/HDFS-10997 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10997) Reduce number of path resolving methods

[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566787#comment-15566787 ] Hadoop QA commented on HDFS-10997: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10989) Cannot get last block length after namenode failover

[ https://issues.apache.org/jira/browse/HDFS-10989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10989: --- Affects Version/s: 2.4.1 > Cannot get last block length after namenode failover >

[jira] [Commented] (HDFS-8131) Implement a space balanced block placement policy

[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566877#comment-15566877 ] Zhe Zhang commented on HDFS-8131: - {{AvailableSpaceBlockPlacementPolicy}} is very useful for large

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566888#comment-15566888 ] Virajith Jalaparti commented on HDFS-10638: --- The checkstyle warnings are due to moving

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566909#comment-15566909 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10984) Expose nntop output as metrics

[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566933#comment-15566933 ] Hudson commented on HDFS-10984: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10591 (See

  1   2   >