[jira] [Assigned] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11018: Assignee: Yiqun Lin > Incorrect check and message in FsDatasetImpl#invalidate >

[jira] [Commented] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577332#comment-15577332 ] Yiqun Lin commented on HDFS-11018: -- Good catch, [~jojochuang]! Will attach a patch soon. > Incorrect

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577323#comment-15577323 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

2016-10-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577304#comment-15577304 ] Yiqun Lin commented on HDFS-10990: -- Thanks [~kihwal] for the final commit! > TestPendingInvalidateBlock

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577281#comment-15577281 ] Mingliang Liu commented on HDFS-10922: -- I always prefer these JIRAd being backported to

[jira] [Comment Edited] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577281#comment-15577281 ] Mingliang Liu edited comment on HDFS-10922 at 10/15/16 3:44 AM: I always

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577275#comment-15577275 ] Weiwei Yang commented on HDFS-10922: Hello [~xyao] I need your suggestion about branch-2 and

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577170#comment-15577170 ] Hudson commented on HDFS-10301: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10619 (See

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577150#comment-15577150 ] Konstantin Shvachko commented on HDFS-10301: Committed to trunk, branch-2, and branch-2.8

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Release Note: If root path / is an encryption zone, the old DistributedFileSystem#getTrashRoot(new

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Release Note: If root path **/** is an encryption zone, the old

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Description: Let's say root path ("/") is the encryption zone, and there is a file called "/test" in

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577126#comment-15577126 ] Yuanbo Liu commented on HDFS-10883: --- Thanks for your comment. This is my first time using release note.

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577119#comment-15577119 ] Andrew Wang commented on HDFS-10883: One more FYI, the Release Notes field is parsed as either

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Release Note: If root path / is an encryption zone, the old DistributedFileSystem#getTrashRoot(new

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Release Note: If root path {{/}} is an encryption zone, the old

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Attachment: HDFS-10301.branch-2.015.patch My formal +1 for the latest patch.

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577102#comment-15577102 ] Yuanbo Liu commented on HDFS-10883: --- [~xiaochen] Thanks for your reminder. > `getTrashRoot`'s behavior

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577082#comment-15577082 ] Xiao Chen commented on HDFS-10883: -- Hi [~yuanbo], Thanks for the contribution. Regarding release notes:

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Description: release note: If root path {{/}} is an encryption zone, the old

[jira] [Updated] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10883: -- Description: Let's say root path ("/") is the encryption zone, and there is a file called "/test" in

[jira] [Comment Edited] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577062#comment-15577062 ] Yuanbo Liu edited comment on HDFS-10883 at 10/15/16 1:07 AM: - [~andrew.wang]

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-10-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577062#comment-15577062 ] Yuanbo Liu commented on HDFS-10883: --- [~andrew.wang] Sure, I'll update the description. >

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577012#comment-15577012 ] Hudson commented on HDFS-10558: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10618 (See

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576981#comment-15576981 ] Andrew Wang commented on HDFS-9820: --- Great work Yongjun, I'm +1. New tests look good. I'm okay with doing

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10558: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576938#comment-15576938 ] Andrew Wang commented on HDFS-10999: Thanks for the insight Allen, {quote} M: "How long for

[jira] [Comment Edited] (HDFS-7343) HDFS smart storage management

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576163#comment-15576163 ] Anu Engineer edited comment on HDFS-7343 at 10/14/16 11:46 PM: --- [~zhouwei]

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576893#comment-15576893 ] Andrew Wang commented on HDFS-7343: --- Hi everyone, thanks for the great document. This is a very ambitious

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576865#comment-15576865 ] Xiaoyu Yao commented on HDFS-10922: --- [~cheersyang], DFSTestUtil#writeFile(FileSystem fs, Path p, byte[]

[jira] [Comment Edited] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576793#comment-15576793 ] Anu Engineer edited comment on HDFS-11010 at 10/14/16 11:20 PM: bq.

[jira] [Comment Edited] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576844#comment-15576844 ] Allen Wittenauer edited comment on HDFS-10999 at 10/14/16 11:16 PM:

[jira] [Comment Edited] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576793#comment-15576793 ] Anu Engineer edited comment on HDFS-11010 at 10/14/16 11:15 PM: bq.

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576844#comment-15576844 ] Allen Wittenauer commented on HDFS-10999: - bq. We tried to draw an equivalence between the

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576839#comment-15576839 ] Xiaobing Zhou commented on HDFS-10558: -- Checked the test failure is not related to the patch. >

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576823#comment-15576823 ] Hadoop QA commented on HDFS-9820: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11013) Correct typos in native erasure coding dump code

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576814#comment-15576814 ] Hadoop QA commented on HDFS-11013: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-14 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11018: -- Summary: Incorrect check and message in FsDatasetImpl#invalidate Key: HDFS-11018 URL: https://issues.apache.org/jira/browse/HDFS-11018 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576805#comment-15576805 ] Chen Liang commented on HDFS-11005: --- I did some investigation, I haven't found the root cause but it

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576793#comment-15576793 ] Anu Engineer commented on HDFS-11010: - bq. besides when we asked Google to rehost the PB 2.5 binary

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576784#comment-15576784 ] Hadoop QA commented on HDFS-10558: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576781#comment-15576781 ] Yongjun Zhang commented on HDFS-9820: - Hi [~andrew.wang], Many thanks again for the review. I uploaded

[jira] [Commented] (HDFS-11003) Expose "XmitsInProgress" through DataNodeMXBean

2016-10-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576777#comment-15576777 ] Brahma Reddy Battula commented on HDFS-11003: - [~andrew.wang] Thanks for review.. I will

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Attachment: HDFS-9820.007.patch > Improve distcp to support efficient restore to an earlier snapshot

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576756#comment-15576756 ] Hadoop QA commented on HDFS-11016: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576736#comment-15576736 ] Mingliang Liu commented on HDFS-11011: -- Can we move them together (and add comments in the UT about

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576725#comment-15576725 ] Xiaobing Zhou commented on HDFS-11011: -- Hi Mingliang, they are kind of overlapped, but here it also

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576719#comment-15576719 ] Andrew Wang commented on HDFS-11010: Hi Anu, it sounds like you want to bump to PB3 because PB2 won't

[jira] [Updated] (HDFS-11013) Correct typos in native erasure coding dump code

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11013: --- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Status: Patch

[jira] [Updated] (HDFS-11013) Correct typos in native erasure coding dump code

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11013: --- Assignee: László Bence Nagy > Correct typos in native erasure coding dump code >

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576698#comment-15576698 ] Mingliang Liu commented on HDFS-11016: -- Please see my comments in [HDFS-11011] about

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576699#comment-15576699 ] Anu Engineer commented on HDFS-11010: - [~chris.douglas] Thanks for the explanation. I was aware of the

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576649#comment-15576649 ] Manoj Govindassamy commented on HDFS-10960: --- Tested 01 patch on both branch2 and branch2.8 and

[jira] [Commented] (HDFS-11008) Change unit test for testing parsing "-source" parameter in Balancer CLI

2016-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576638#comment-15576638 ] Hudson commented on HDFS-11008: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10617 (See

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576628#comment-15576628 ] Anu Engineer commented on HDFS-10558: - [~xiaobingo] Thanks for the update. +1, pending jenkins. >

[jira] [Commented] (HDFS-11017) dfsadmin set/clrSpaceQuota fail to recognize StorageType option

2016-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576627#comment-15576627 ] Xiaoyu Yao commented on HDFS-11017: --- Thanks [~xiaobingo] for reporting this. Can you update the ticket

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576620#comment-15576620 ] Mingliang Liu commented on HDFS-11011: -- Hi Xiaobing, before reviewing the patch, I have a question:

[jira] [Updated] (HDFS-11008) Change unit test for testing parsing "-source" parameter in Balancer CLI

2016-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576581#comment-15576581 ] Manoj Govindassamy commented on HDFS-10960: --- [~eddyxu]. v01 patch should work there as it uses

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in failover

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10998: - Summary: Add unit tests for HDFS command 'dfsadmin -fetchImage' in failover (was: Add unit tests

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in failover

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10998: - Description: This proposes adding unit tests to verify fetchImage works well in the case of

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576575#comment-15576575 ] Lei (Eddy) Xu commented on HDFS-10960: -- hi, [~kihwal] Thanks for reporting it. Working on fixing it

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576572#comment-15576572 ] Kihwal Lee commented on HDFS-10960: --- Reverted from branch-2 and branch-2.8. Please rework the patch for

[jira] [Reopened] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-10960: --- > TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error > verification after

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576561#comment-15576561 ] Kihwal Lee commented on HDFS-10960: --- branch-2 build fails. {noformat} [ERROR]

[jira] [Commented] (HDFS-11003) Expose "XmitsInProgress" through DataNodeMXBean

2016-10-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576564#comment-15576564 ] Andrew Wang commented on HDFS-11003: +1 thanks Brahma > Expose "XmitsInProgress" through

[jira] [Updated] (HDFS-11017) dfsadmin set/clrSpaceQuota fail to recognize StorageType option

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11017: - Description: dfsadmin setSpaceQuota or clrSpaceQuota don't recognize valid StorageType options,

[jira] [Updated] (HDFS-11017) dfsadmin set/clrSpaceQuota fail to recognize StorageType option

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11017: - Component/s: fs > dfsadmin set/clrSpaceQuota fail to recognize StorageType option >

[jira] [Updated] (HDFS-11017) dfsadmin set/clrSpaceQuota fail to recognize StorageType option

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11017: - Labels: cli (was: ) > dfsadmin set/clrSpaceQuota fail to recognize StorageType option >

[jira] [Created] (HDFS-11017) dfsadmin set/clrSpaceQuota fail to recognize StorageType option

2016-10-14 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11017: Summary: dfsadmin set/clrSpaceQuota fail to recognize StorageType option Key: HDFS-11017 URL: https://issues.apache.org/jira/browse/HDFS-11017 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576541#comment-15576541 ] Xiaobing Zhou commented on HDFS-10558: -- v003 fixed check style issues, > DiskBalancer: Print the

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: HDFS-10558.003.patch > DiskBalancer: Print the full path to plan file >

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576525#comment-15576525 ] Xiaoyu Yao commented on HDFS-10922: --- +1 for v12 patch. I will commit it shortly. > Adding additional

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576466#comment-15576466 ] Hudson commented on HDFS-10960: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10615 (See

[jira] [Updated] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11016: - Attachment: HDFS-11016.000.patch > Add unit tests for HDFS command 'dfsadmin -set/clrQuota' >

[jira] [Updated] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11016: - Status: Patch Available (was: Open) Posted initial patch v000 for reviews. > Add unit tests for

[jira] [Updated] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11016: - Summary: Add unit tests for HDFS command 'dfsadmin -set/clrQuota' (was: Add unit test for HDFS

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Summary: Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota' (was: Add unit test for

[jira] [Updated] (HDFS-11016) Add unit test for HDFS command 'dfsadmin -set/clrQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11016: - Summary: Add unit test for HDFS command 'dfsadmin -set/clrQuota' (was: Add unit test for HDFS

[jira] [Updated] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Summary: Add unit test for HDFS command 'dfsadmin -set/clrSpaceQuota' (was: Add unit test for

[jira] [Updated] (HDFS-11016) Add unit test for HDFS command 'dfsadmin -set/clearQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11016: - Description: This proposes adding a bunch of unit tests for command 'dfsadmin setQuota' and

[jira] [Created] (HDFS-11016) Add unit test for HDFS command 'dfsadmin -set/clearQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11016: Summary: Add unit test for HDFS command 'dfsadmin -set/clearQuota' Key: HDFS-11016 URL: https://issues.apache.org/jira/browse/HDFS-11016 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Description: This proposes adding a bunch of unit tests for command 'dfsadmin setSpaceQuota' and

[jira] [Updated] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10960: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0

[jira] [Commented] (HDFS-10712) Fix TestDataNodeVolumeFailure on 2.* branches.

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576428#comment-15576428 ] Hadoop QA commented on HDFS-10712: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576415#comment-15576415 ] Hudson commented on HDFS-10827: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10614 (See

[jira] [Commented] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576405#comment-15576405 ] Hadoop QA commented on HDFS-11011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10827: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576383#comment-15576383 ] Chris Douglas commented on HDFS-11010: -- bq. Let me ask the question in a different way, what about PB

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576348#comment-15576348 ] Virajith Jalaparti commented on HDFS-10638: --- Hi [~eddyxu], Thank you for the comments! bq.

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576340#comment-15576340 ] Hadoop QA commented on HDFS-10558: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576319#comment-15576319 ] Hadoop QA commented on HDFS-10922: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11009) Add a tool to reconstruct block meta file from CLI

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576292#comment-15576292 ] Hadoop QA commented on HDFS-11009: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576268#comment-15576268 ] Hadoop QA commented on HDFS-10960: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11015) Enforce timeout in balancer

2016-10-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11015: -- Description: 1) Hung node detection: HDFS-6247 has removed the socket read timeout while adding the

[jira] [Updated] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Attachment: HDFS-11011.001.patch > Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

[jira] [Commented] (HDFS-11011) Add unit test for HDFS command 'dfsadmin -set/clearSpaceQuota'

2016-10-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576205#comment-15576205 ] Xiaobing Zhou commented on HDFS-11011: -- v001 fixed check style issues. > Add unit test for HDFS

[jira] [Assigned] (HDFS-11015) Enforce timeout in balancer

2016-10-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-11015: - Assignee: Kihwal Lee > Enforce timeout in balancer > --- > >

[jira] [Created] (HDFS-11015) Enforce timeout in balancer

2016-10-14 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11015: - Summary: Enforce timeout in balancer Key: HDFS-11015 URL: https://issues.apache.org/jira/browse/HDFS-11015 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576199#comment-15576199 ] Anu Engineer commented on HDFS-11010: - bq. What's the motivation for upgrading to PB 3, besides being

  1   2   >