[jira] [Updated] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11058: -- Attachment: HDFS-11058.01.patch Attaching v01 patch which addresses the following: #

[jira] [Updated] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-11-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11058: -- Labels: viewfs (was: ) Status: Patch Available (was: Open) > Implement 'hadoop fs

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627806#comment-15627806 ] Hudson commented on HDFS-11031: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10752 (See

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-11-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627784#comment-15627784 ] Xiao Chen commented on HDFS-10756: -- Thanks for the new version, [~yuanbo]. Some additional comments: -

[jira] [Created] (HDFS-11091) Implement a getTrashRoot that does not fall-back

2016-11-01 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-11091: Summary: Implement a getTrashRoot that does not fall-back Key: HDFS-11091 URL: https://issues.apache.org/jira/browse/HDFS-11091 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11031: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10954) [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN

2016-11-01 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627666#comment-15627666 ] Uma Maheswara Rao G commented on HDFS-10954: Thank you [~rakeshr] for giving the patch, I have

[jira] [Commented] (HDFS-11075) Provide a tool to help covert existing file of default 3x replication to EC striped layout

2016-11-01 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627659#comment-15627659 ] Takanobu Asanuma commented on HDFS-11075: - [~Sammi] Thanks for creating this jira. It may

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-11-01 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627584#comment-15627584 ] Yuanbo Liu commented on HDFS-10802: --- [~umamaheswararao] Thanks for your assignment. I'm glad to have

[jira] [Commented] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627374#comment-15627374 ] Hadoop QA commented on HDFS-10566: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627334#comment-15627334 ] Mingliang Liu commented on HDFS-11076: -- checkstyle warnings are related. > Add unit test for

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627332#comment-15627332 ] Hadoop QA commented on HDFS-11076: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11090) Leave safemode immediately if all blocks have reported in

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627326#comment-15627326 ] Mingliang Liu commented on HDFS-11090: -- Do we still need to consider the datanode threshold, and

[jira] [Created] (HDFS-11090) Leave safemode immediately if all blocks have reported in

2016-11-01 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11090: -- Summary: Leave safemode immediately if all blocks have reported in Key: HDFS-11090 URL: https://issues.apache.org/jira/browse/HDFS-11090 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11076: - Description: This JIRA tries to add unit tests for extended ACLs in HDFS, to cover the following

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627240#comment-15627240 ] Mingliang Liu commented on HDFS-11076: -- The v2 patch looks good to me overall. I will hold on commit

[jira] [Comment Edited] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627210#comment-15627210 ] Anu Engineer edited comment on HDFS-10566 at 11/2/16 12:41 AM: --- [~xiaobingo]

[jira] [Commented] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627210#comment-15627210 ] Anu Engineer commented on HDFS-10566: - [~xiaobingo] Thank you submitting the patch. It looks very good

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627199#comment-15627199 ] Hadoop QA commented on HDFS-11056: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10566: - Description: If datanode is in non-REGULAR status such as upgrade and rollback etc., it might be

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-11-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627183#comment-15627183 ] John Zhuge commented on HDFS-4957: -- Somewhat related to HDFS-8298. > NameNode failover should not fail

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10566: Assignee: Xiaobing Zhou (was: Anu Engineer) > Submit plan request should throw exception if

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10566: Status: Patch Available (was: In Progress) > Submit plan request should throw exception if

[jira] [Assigned] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-10566: --- Assignee: Anu Engineer (was: Xiaobing Zhou) > Submit plan request should throw exception if

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-11-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627171#comment-15627171 ] John Zhuge commented on HDFS-4957: -- To fix this issue, far more complex change is needed: * Failover needs

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11076: -- Attachment: HDFS-11076.002.patch Thanks [~liuml07] for the comments! Uploaded v002 patch and updated

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11076: -- Description: This JIRA tries to add unit tests for extended ACLs in HDFS, to cover the following

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11076: -- Description: This JIRA tries to add unit tests for extended ACLs in HDFS, to cover the following

[jira] [Created] (HDFS-11089) Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster

2016-11-01 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11089: Summary: Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster Key: HDFS-11089 URL: https://issues.apache.org/jira/browse/HDFS-11089 Project: Hadoop

[jira] [Commented] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627129#comment-15627129 ] Xiaobing Zhou commented on HDFS-10566: -- [~anu] I posted initial patch v000, please help to review it,

[jira] [Assigned] (HDFS-11088) Quash unnecessary safemode WARN message during NameNode startup

2016-11-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11088: Assignee: Yiqun Lin > Quash unnecessary safemode WARN message during NameNode startup >

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10566: - Attachment: HDFS-10566.000.patch > Submit plan request should throw exception if Datanode is in

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10566: - Summary: Submit plan request should throw exception if Datanode is in non-REGULAR status. (was:

[jira] [Updated] (HDFS-10566) Submit plan request should throw exception if Datanode is in non-REGULAR status.

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10566: - Summary: Submit plan request should throw exception if Datanode is in non-REGULAR status. (was:

[jira] [Updated] (HDFS-10201) Implement undo log in parity datanode for hflush operations

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10201: - Attachment: HDFS-10201.wip.patch > Implement undo log in parity datanode for hflush operations >

[jira] [Updated] (HDFS-11087) NamenodeFsck should check if the output writer is still writable.

2016-11-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11087: --- Assignee: Erik Krogen > NamenodeFsck should check if the output writer is still

[jira] [Created] (HDFS-11088) Quash unnecessary safemode WARN message during NameNode startup

2016-11-01 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11088: -- Summary: Quash unnecessary safemode WARN message during NameNode startup Key: HDFS-11088 URL: https://issues.apache.org/jira/browse/HDFS-11088 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11087) NamenodeFsck should check if the output writer is still writable.

2016-11-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627060#comment-15627060 ] Konstantin Shvachko commented on HDFS-11087: The problem is that {{PrintWriter.ensureOpen()}}

[jira] [Created] (HDFS-11087) NamenodeFsck should check if the output writer is still writable.

2016-11-01 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-11087: -- Summary: NamenodeFsck should check if the output writer is still writable. Key: HDFS-11087 URL: https://issues.apache.org/jira/browse/HDFS-11087 Project:

[jira] [Assigned] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-11085: Assignee: Xiaobing Zhou > Add unit tests for NameNode failing to startup when name dir can

[jira] [Assigned] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-11083: Assignee: Xiaobing Zhou > Add unit test for DFSAdmin -report command >

[jira] [Updated] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11056: --- Attachment: HDFS-11056.001.patch Ok. I've got a patch to fix the bug. I let it ran for a

[jira] [Updated] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11056: --- Status: Patch Available (was: Open) > Concurrent append and read operations lead to checksum

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626841#comment-15626841 ] Mingliang Liu commented on HDFS-11076: -- # I see there is @Before but no @After method. The

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11065: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626804#comment-15626804 ] Hudson commented on HDFS-11065: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10747 (See

[jira] [Created] (HDFS-11086) DataNode disk check improvements

2016-11-01 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11086: Summary: DataNode disk check improvements Key: HDFS-11086 URL: https://issues.apache.org/jira/browse/HDFS-11086 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-11-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626777#comment-15626777 ] John Zhuge commented on HDFS-4957: -- HDFS-4210 made it an IOE that can be handled. Let me check the source

[jira] [Commented] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626764#comment-15626764 ] Mingliang Liu commented on HDFS-11079: -- On my local test MBP, it took about 30 seconds to finish all

[jira] [Updated] (HDFS-10201) Implement undo log in parity datanode for hflush operations

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10201: - Assignee: Rui Gao (was: Mingliang Liu) > Implement undo log in parity datanode for hflush

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626637#comment-15626637 ] Hadoop QA commented on HDFS-11031: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-11085) Add unit tests for NameNode failing to startup when name dir can not be written

2016-11-01 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11085: Summary: Add unit tests for NameNode failing to startup when name dir can not be written Key: HDFS-11085 URL: https://issues.apache.org/jira/browse/HDFS-11085

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-11-01 Thread Aliza Itzkowitz (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626599#comment-15626599 ] Aliza Itzkowitz commented on HDFS-4957: --- I haven't tried the HDFS-4210 fix, but from the description

[jira] [Updated] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11079: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-10891 > Accelerate

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626517#comment-15626517 ] Wei-Chiu Chuang commented on HDFS-11056: I have a proof of concept fix, but getting a unit test

[jira] [Comment Edited] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625993#comment-15625993 ] Wei-Chiu Chuang edited comment on HDFS-11056 at 11/1/16 8:03 PM: -

[jira] [Commented] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626505#comment-15626505 ] Hadoop QA commented on HDFS-11081: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10941) Improve BlockManager#processMisReplicatesAsync log

2016-11-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626451#comment-15626451 ] Xiaobing Zhou commented on HDFS-10941: -- +1 pending on Jenkins. Thanks. > Improve

[jira] [Updated] (HDFS-11084) OIV ReverseXML processor does not recognize sticky bit

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11084: --- Description: HDFS-10505 added a new feature OIV ReverseXML processor to generate a fsimage

[jira] [Created] (HDFS-11084) OIV ReverseXML processor does not recognize sticky bit

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11084: -- Summary: OIV ReverseXML processor does not recognize sticky bit Key: HDFS-11084 URL: https://issues.apache.org/jira/browse/HDFS-11084 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626358#comment-15626358 ] Hudson commented on HDFS-10633: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10745 (See

[jira] [Updated] (HDFS-10941) Improve BlockManager#processMisReplicatesAsync log

2016-11-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10941: -- Status: Patch Available (was: Open) > Improve BlockManager#processMisReplicatesAsync log >

[jira] [Updated] (HDFS-10941) Improve BlockManager#processMisReplicatesAsync log

2016-11-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10941: -- Status: Open (was: Patch Available) > Improve BlockManager#processMisReplicatesAsync log >

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-11-01 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626267#comment-15626267 ] John Zhuge commented on HDFS-4957: -- HDFS-10719 is also duplicated by HDFS-4210 whose fix throws

[jira] [Created] (HDFS-11083) Add unit test for DFSAdmin -report command

2016-11-01 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11083: Summary: Add unit test for DFSAdmin -report command Key: HDFS-11083 URL: https://issues.apache.org/jira/browse/HDFS-11083 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10633: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626224#comment-15626224 ] Hadoop QA commented on HDFS-11078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10499: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 >

[jira] [Created] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2016-11-01 Thread Rakesh R (JIRA)
Rakesh R created HDFS-11082: --- Summary: Erasure Coding : Provide replicated EC policy to just replicating the files Key: HDFS-11082 URL: https://issues.apache.org/jira/browse/HDFS-11082 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-10904. - Resolution: Not A Problem > Need a new Result state for DiskBalancerWorkStatus to indicate the

[jira] [Commented] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626182#comment-15626182 ] Anu Engineer commented on HDFS-10904: - [~manojg] Thanks for a very detailed explanation. I completely

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.005.patch Thanks [~brahmareddy] for your prompt effort to commit.

[jira] [Updated] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11081: Status: Patch Available (was: Open) > Ozone:SCM: Add support for registerNode in datanode >

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-11-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626141#comment-15626141 ] Rakesh R commented on HDFS-10368: - Thanks [~andrew.wang], I will rename the following set of

[jira] [Updated] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11081: Attachment: HDFS-11081-HDFS-7240.001.patch There will be a checkstyle warning that *try {* in a

[jira] [Updated] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11081: Attachment: Design note for StateMachine.pdf A code review helper document that explains the

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-11-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.005.patch > Add additional unit test for DataNode startup behavior when

[jira] [Created] (HDFS-11081) Ozone:SCM: Add support for registerNode in datanode

2016-11-01 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11081: --- Summary: Ozone:SCM: Add support for registerNode in datanode Key: HDFS-11081 URL: https://issues.apache.org/jira/browse/HDFS-11081 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626048#comment-15626048 ] Andrew Wang commented on HDFS-11072: New JIRA(s) sound great! Thanks for volunteering [~rakeshr]. >

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625993#comment-15625993 ] Wei-Chiu Chuang commented on HDFS-11056: FsVolumeImpl#convertTemporaryToRbw does not generate last

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625972#comment-15625972 ] Yongjun Zhang commented on HDFS-11056: -- That's very nice findings [~jojochuang]! Congrats! Can we

[jira] [Comment Edited] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625942#comment-15625942 ] Wei-Chiu Chuang edited comment on HDFS-11056 at 11/1/16 4:41 PM: - I

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-11-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625942#comment-15625942 ] Wei-Chiu Chuang commented on HDFS-11056: I believe I have found the root cause of bug: The bug

[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-11-01 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Attachment: HDFS-11078.001.patch Moved message to info. > NPE in LazyPersistFileScrubber >

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2016-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625862#comment-15625862 ] Hudson commented on HDFS-10499: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10744 (See

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2016-11-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10499: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2016-11-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10499: Summary: TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-11-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625742#comment-15625742 ] Kihwal Lee commented on HDFS-11078: --- Since this can happen legitimately and does not require any further

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625732#comment-15625732 ] Rakesh R commented on HDFS-11072: - Thanks a lot [~andrew.wang] for the detailed explanation. bq. It might

[jira] [Updated] (HDFS-10997) Reduce number of path resolving methods

2016-11-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10997: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-11080) Update HttpFS to use ConfigRedactor

2016-11-01 Thread Sean Mackrory (JIRA)
Sean Mackrory created HDFS-11080: Summary: Update HttpFS to use ConfigRedactor Key: HDFS-11080 URL: https://issues.apache.org/jira/browse/HDFS-11080 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-11-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625373#comment-15625373 ] Brahma Reddy Battula commented on HDFS-10499: - [~linyiqun] thanks for updating the patch..

[jira] [Commented] (HDFS-10997) Reduce number of path resolving methods

2016-11-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625365#comment-15625365 ] Kihwal Lee commented on HDFS-10997: --- The branch-2 patch looks good. I will commit it shortly. > Reduce

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-01 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625018#comment-15625018 ] Wei Zhou commented on HDFS-10885: - Thanks [~rakeshr] for these considerate suggestions! {quote} Do you

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624923#comment-15624923 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-11-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624793#comment-15624793 ] SammiChen commented on HDFS-10815: -- Hi [~ademu], thanks for providing this information. Will try to

[jira] [Commented] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-11-01 Thread Eisuke Umeda (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624764#comment-15624764 ] Eisuke Umeda commented on HDFS-10815: - Hi SammiChen, I conducted a re-test in a single NameNode. It

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624738#comment-15624738 ] Hadoop QA commented on HDFS-10499: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-11-01 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624626#comment-15624626 ] Jingcheng Du commented on HDFS-9668: Upload a new patch V21 to address [~xiaochen]'s comments. Thanks!

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-11-01 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-21.patch > Optimize the locking in FsDatasetImpl >

  1   2   >