[jira] [Resolved] (HDFS-600) Support for pluggable erasure coding policy for HDFS

2016-10-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-600. -- Resolution: Won't Fix This one goes back to the HDFS-RAID days, which has been removed. EC has also been

[jira] [Commented] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2016-10-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556169#comment-15556169 ] Andrew Wang commented on HDFS-3544: --- The other note is that we have a JIRA to add LRC support (HDFS-7345)

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556220#comment-15556220 ] Wei-Chiu Chuang commented on HDFS-10429: I think that closeThreads(false) should be called before

[jira] [Assigned] (HDFS-10982) 'errno' set on successful code path in hdfsOpenFileImpl()

2016-10-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-10982: - Assignee: John Zhuge > 'errno' set on successful code path in hdfsOpenFileImpl() >

[jira] [Created] (HDFS-10982) 'errno' set on successful code path in hdfsOpenFileImpl()

2016-10-07 Thread Sailesh Mukil (JIRA)
Sailesh Mukil created HDFS-10982: Summary: 'errno' set on successful code path in hdfsOpenFileImpl() Key: HDFS-10982 URL: https://issues.apache.org/jira/browse/HDFS-10982 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2016-10-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3544. --- Resolution: Won't Fix HDFS-RAID has been removed and native EC support is available at HDFS-7285.

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-10-07 Thread Mehran Hassani (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556346#comment-15556346 ] Mehran Hassani commented on HDFS-9618: -- Correct me if I am wrong but I think self4j checks for all the

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Attachment: HDFS-10967.00.patch Thought more about the design options. Currently I think the most

[jira] [Commented] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556385#comment-15556385 ] Uma Maheswara Rao G commented on HDFS-10801: Latest patch looks good to me. +1 > [SPS]:

[jira] [Updated] (HDFS-10980) Optimize check for existence of parent directory

2016-10-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10980: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1596#comment-1596 ] Xiaobing Zhou commented on HDFS-10972: -- HDFS-10981 is filed to refactor DFSAdmin by removing print

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1684#comment-1684 ] Wei-Chiu Chuang commented on HDFS-10933: Committed it to trunk. The branch-2 has quite a number of

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1577#comment-1577 ] Xiaobing Zhou commented on HDFS-10972: -- Thank you [~liuml07] for reviews. patch v001 fixed them. >

[jira] [Created] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10981: Summary: remove print stream maintained in DFSAdmin Key: HDFS-10981 URL: https://issues.apache.org/jira/browse/HDFS-10981 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1610#comment-1610 ] Xiaobing Zhou commented on HDFS-10965: -- Thanks [~liuml07]. I hold off doing similar changes proposed

[jira] [Commented] (HDFS-10969) Fix typos in hdfs-default.xml

2016-10-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1678#comment-1678 ] Hudson commented on HDFS-10969: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10565 (See

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1719#comment-1719 ] Hadoop QA commented on HDFS-10939: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1739#comment-1739 ] Hadoop QA commented on HDFS-10979: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2016-10-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1806#comment-1806 ] Zhe Zhang commented on HDFS-10759: -- Sorry for the late response. I just labeled this as a 3.0 blocker,

[jira] [Updated] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2016-10-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10759: - Labels: hdfs-ec-3.0-must-do (was: ) > Change fsimage bool isStriped from boolean to an enum >

[jira] [Updated] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Priority: Minor (was: Major) > remove print stream maintained in DFSAdmin >

[jira] [Updated] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Issue Type: Improvement (was: Bug) > remove print stream maintained in DFSAdmin >

[jira] [Updated] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Component/s: shell fs > remove print stream maintained in DFSAdmin >

[jira] [Updated] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Affects Version/s: 3.0 > remove print stream maintained in DFSAdmin >

[jira] [Updated] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Component/s: test > remove print stream maintained in DFSAdmin >

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-10-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1630#comment-1630 ] Xiao Chen commented on HDFS-10797: -- I plan to commit this end of today if no objections. > Disk usage

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1808#comment-1808 ] Hadoop QA commented on HDFS-10972: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1826#comment-1826 ] Hudson commented on HDFS-10933: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10566 (See

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10972: - Attachment: HDFS-10972.001.patch > Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' >

[jira] [Updated] (HDFS-10969) Fix typos in hdfs-default.xml

2016-10-07 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10969: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1619#comment-1619 ] Wei-Chiu Chuang commented on HDFS-8028: --- Hello [~hongyu.bi] would you like to post a new patch?

[jira] [Updated] (HDFS-10980) Optimize check for existence of parent directory

2016-10-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10980: --- Status: Patch Available (was: Open) > Optimize check for existence of parent directory >

[jira] [Updated] (HDFS-10980) Optimize check for existence of parent directory

2016-10-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10980: --- Attachment: HDFS-10980.patch Trivial patch to remove String arg and use IIP to check parent inode. >

[jira] [Updated] (HDFS-10981) Remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Summary: Remove print stream maintained in DFSAdmin (was: remove print stream maintained in

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1658#comment-1658 ] Wei-Chiu Chuang commented on HDFS-10933: Committing the 3rd patch. > Refactor TestFsck >

[jira] [Updated] (HDFS-8824) Do not use small blocks for balancing the cluster

2016-10-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8824: Fix Version/s: 2.7.4 Thanks Nicholas for the work. I think this is a good improvement for branch-2.7 and

[jira] [Created] (HDFS-10980) Optimize check for existence of parent directory

2016-10-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10980: -- Summary: Optimize check for existence of parent directory Key: HDFS-10980 URL: https://issues.apache.org/jira/browse/HDFS-10980 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10981) remove print stream maintained in DFSAdmin

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10981: - Component/s: (was: test) > remove print stream maintained in DFSAdmin >

[jira] [Updated] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10979: --- Status: Patch Available (was: Open) > Pass IIP for FSDirDeleteOp methods >

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Attachment: HDFS-10939.branch-2.patch For branch-2. Just had to resolve lack of EC, and minor

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1504#comment-1504 ] Wei-Chiu Chuang commented on HDFS-10933: +1 > Refactor TestFsck > - > >

[jira] [Updated] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10979: --- Attachment: HDFS-10979.patch Very small simple patch. Bonus is shorting out protected dirs check

[jira] [Created] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10979: -- Summary: Pass IIP for FSDirDeleteOp methods Key: HDFS-10979 URL: https://issues.apache.org/jira/browse/HDFS-10979 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1885#comment-1885 ] Mingliang Liu commented on HDFS-10972: -- Can you add a failing case (e.g. no arguments provided) for

[jira] [Commented] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556150#comment-15556150 ] Hudson commented on HDFS-10979: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10568 (See

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10939: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1949#comment-1949 ] Jing Zhao commented on HDFS-10827: -- Thanks for working on this, [~tasanuma0829]! The patch looks good to

[jira] [Updated] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10979: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10980) Optimize check for existence of parent directory

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556113#comment-15556113 ] Hadoop QA commented on HDFS-10980: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10979) Pass IIP for FSDirDeleteOp methods

2016-10-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556010#comment-15556010 ] Kihwal Lee commented on HDFS-10979: --- +1 Looks good. > Pass IIP for FSDirDeleteOp methods >

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556537#comment-15556537 ] Zhe Zhang commented on HDFS-10971: -- Thanks Andrew. SGTM to expose replication factor 1 in {{FileStatus}},

[jira] [Assigned] (HDFS-10984) Expose nntop output as metrics

2016-10-07 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDFS-10984: -- Assignee: Siddharth Wagle > Expose nntop output as metrics >

[jira] [Created] (HDFS-10984) Expose nntop output as metrics

2016-10-07 Thread Siddharth Wagle (JIRA)
Siddharth Wagle created HDFS-10984: -- Summary: Expose nntop output as metrics Key: HDFS-10984 URL: https://issues.apache.org/jira/browse/HDFS-10984 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556745#comment-15556745 ] Mingliang Liu commented on HDFS-10972: -- # We don't have to call {{restoreStream()}} in

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-10-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10797: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556790#comment-15556790 ] Konstantin Shvachko commented on HDFS-10301: Hey [~arpitagarwal], how is the review going?

[jira] [Updated] (HDFS-10986) DFSAdmin should show detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-10-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556828#comment-15556828 ] Hudson commented on HDFS-10797: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10572 (See

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556868#comment-15556868 ] Kai Zheng commented on HDFS-10971: -- Sounds good to me, Andrew and Zhe. So for this issue, the

[jira] [Commented] (HDFS-10980) Optimize check for existence of parent directory

2016-10-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556513#comment-15556513 ] Hudson commented on HDFS-10980: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10571 (See

[jira] [Created] (HDFS-10983) OIV webhdfs interface should make an EC file explicit

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10983: -- Summary: OIV webhdfs interface should make an EC file explicit Key: HDFS-10983 URL: https://issues.apache.org/jira/browse/HDFS-10983 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10983) OIV webhdfs interface should make an EC file explicit

2016-10-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10983: --- Description: The OIV tool's webhdfs interface does not print if a file is striped or not. Also, it

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Description: {{TestZKFailoverController#testGracefulFailoverMultipleZKfcs}} uses fixed time sleep

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Summary: o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs should not use

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Priority: Minor (was: Major) >

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Description: {{TestZKFailoverController#testGracefulFailoverMultipleZKfcs}} uses fixed time

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Summary: o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

[jira] [Updated] (HDFS-10986) DFSAdmin should show detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Affects Version/s: (was: 2.8.0) Target Version/s: 3.0.0-alpha2 Description:

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Status: Patch Available (was: Open) > DFSAdmin should log detailed error message if any >

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556967#comment-15556967 ] Mingliang Liu commented on HDFS-10986: -- [~kihwal] and [~brahmareddy] does this make sense to you?

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-10-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Status: Patch Available (was: Open) > Refactor: Wrap Datanode IO related operations >

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Component/s: test > o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails >

[jira] [Created] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10985: Summary: o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently Key: HDFS-10985 URL: https://issues.apache.org/jira/browse/HDFS-10985

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556694#comment-15556694 ] Hadoop QA commented on HDFS-10967: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10985) o.a.h.ha.TestZKFailoverController#testGracefulFailoverMultipleZKfcs fails intermittently

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10985: - Attachment: HDFS-10985.000.patch [~ste...@apache.org] and [~atm], does this makes sense to you?

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2016-10-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556534#comment-15556534 ] Jing Zhao commented on HDFS-10759: -- Yeah I also think the idea is good. But we need to guarantee the

[jira] [Updated] (HDFS-10983) OIV webhdfs interface should make an EC file explicit

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10983: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > OIV webhdfs interface should

[jira] [Commented] (HDFS-10924) Add a new instrumented read-write lock

2016-10-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556560#comment-15556560 ] Xiao Chen commented on HDFS-10924: -- Thanks [~jingcheng...@intel.com] for the nice work here, and on the

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-10-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10797: - Component/s: snapshots > Disk usage summary of snapshots causes renamed blocks to get counted twice >

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-10-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10797: - Affects Version/s: 2.8.0 > Disk usage summary of snapshots causes renamed blocks to get counted twice >

[jira] [Created] (HDFS-10986) DFSAdmin should show detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10986: Summary: DFSAdmin should show detailed error message if any Key: HDFS-10986 URL: https://issues.apache.org/jira/browse/HDFS-10986 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2016-10-07 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556846#comment-15556846 ] Vinitha Reddy Gankidi commented on HDFS-8028: - These tests fail on branch 2-7 after HDFS-7704

[jira] [Commented] (HDFS-10969) Fix typos in hdfs-default.xml

2016-10-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554777#comment-15554777 ] Yiqun Lin commented on HDFS-10969: -- Thanks [~brahmareddy] for the review. The failed tests are not

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Attachment: HDFS-10801-HDFS-10285-01.patch Thanks [~umamaheswararao] for the review comments. Attached

[jira] [Commented] (HDFS-10974) Document replication factor for EC files.

2016-10-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554847#comment-15554847 ] Yiqun Lin commented on HDFS-10974: -- Hi [~jojochuang], I would like to attach a initial patch for this.

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554853#comment-15554853 ] Hadoop QA commented on HDFS-10933: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554392#comment-15554392 ] Wei-Chiu Chuang commented on HDFS-10975: Sure please go ahead and take it. I have been looking for

[jira] [Created] (HDFS-10978) fsck reports healthy even though dfsadmin -report shows under-replicated blocks

2016-10-07 Thread Abhay Bothra (JIRA)
Abhay Bothra created HDFS-10978: --- Summary: fsck reports healthy even though dfsadmin -report shows under-replicated blocks Key: HDFS-10978 URL: https://issues.apache.org/jira/browse/HDFS-10978 Project:

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-10-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554552#comment-15554552 ] Wei-Chiu Chuang commented on HDFS-10609: [~ajisakaa] I'm so sorry about this. Will pay much more

[jira] [Commented] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554950#comment-15554950 ] Hadoop QA commented on HDFS-10801: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556648#comment-15556648 ] Xiaobing Zhou commented on HDFS-10972: -- v002 added test for run on exception. > Add unit test for

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10972: - Attachment: HDFS-10972.002.patch > Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' >

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556717#comment-15556717 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10985) o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertsions

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556842#comment-15556842 ] Hadoop QA commented on HDFS-10985: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556929#comment-15556929 ] Hadoop QA commented on HDFS-10972: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Description: There are some subcommands in {{DFSAdmin}} that swallow IOException and give very

[jira] [Updated] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10986: - Attachment: HDFS-10986.000.patch > DFSAdmin should log detailed error message if any >

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2016-10-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556155#comment-15556155 ] Andrew Wang commented on HDFS-10759: Idea seems fine to me, I like evolvable datatypes. > Change

  1   2   >