[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162413#comment-16162413 ] Weiwei Yang commented on HDFS-12389: Hi [~anu], [~linyiqun], [~vagarychen] Excuse me for

[jira] [Updated] (HDFS-12017) Ozone: Container: Move IPC port to 98xx range

2017-09-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-12017: Priority: Major (was: Trivial) > Ozone: Container: Move IPC port to 98xx range >

[jira] [Updated] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12412: - Attachment: HDFS-12412.00.patch Change {{stripedReadPool}} to an unbound {{cacheThreadPool}}.

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162167#comment-16162167 ] Hadoop QA commented on HDFS-11676: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: HDFS-11676-HDFS-7240.003.patch v003 patch to rebase. > Ozone: SCM CLI: Implement close

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162252#comment-16162252 ] John Zhuge commented on HDFS-11851: --- This fixes a deadlock introduced by HDFS-11529 which is only in

[jira] [Commented] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162324#comment-16162324 ] Hadoop QA commented on HDFS-12407: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

2017-09-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162384#comment-16162384 ] Konstantin Shvachko commented on HDFS-12323: The change looks good you are increasing timeout

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162405#comment-16162405 ] Anu Engineer commented on HDFS-11772: - [~linyiqun] Thank you. I will resolve this issue now. > Ozone:

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162422#comment-16162422 ] Anu Engineer commented on HDFS-12389: - +1, Thanks for fixing this. That was a dumb mistake. Really

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162435#comment-16162435 ] Weiwei Yang commented on HDFS-12389: Thanks [~anu] for the quick review, I have committed this to the

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Open (was: Patch Available) > Ensure to use CLI command to enable/disable erasure coding policy

[jira] [Assigned] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-12417: -- Assignee: Andrew Wang > Disable flaky TestDFSStripedOutputStreamWithFailure >

[jira] [Commented] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162204#comment-16162204 ] Andrew Wang commented on HDFS-12412: Thanks for working on this Eddy. I did a grep for the removed

[jira] [Updated] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12409: - Attachment: HDFS-12409.01.patch Fix checkstyle warnings. The findbug warnings are not relevant

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162260#comment-16162260 ] Ruslan Dautkhanov commented on HDFS-11851: -- [~jzhuge], I have following exception that matches

[jira] [Updated] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12389: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Issue Comment Deleted] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12417: -- Comment: was deleted (was: Hi Andrew, There is a problem with this patch, it is causing

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162142#comment-16162142 ] Bharat Viswanadham commented on HDFS-12417: --- Hi Andrew, There is a problem with this patch, it

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: (was: HDFS-11676-HDFS-7240.002.patch) > Ozone: SCM CLI: Implement close container

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162192#comment-16162192 ] Chris Douglas commented on HDFS-11600: -- bq. I posted an alternative disable patch on HDFS-12417 Sure.

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Attachment: HDFS-12420.01.patch > Disable Namenode format when data already exist >

[jira] [Work started] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12420 started by Ajay Kumar. - > Disable Namenode format when data already exist >

[jira] [Work stopped] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12420 stopped by Ajay Kumar. - > Disable Namenode format when data already exist >

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162298#comment-16162298 ] Hadoop QA commented on HDFS-12409: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11613) Ozone: Cleanup findbugs issues

2017-09-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-11613: --- Assignee: Lokesh Jain > Ozone: Cleanup findbugs issues >

[jira] [Assigned] (HDFS-11612) Ozone: Cleanup Checkstyle issues

2017-09-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-11612: --- Assignee: Shashikant Banerjee > Ozone: Cleanup Checkstyle issues >

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162313#comment-16162313 ] Hadoop QA commented on HDFS-11676: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162365#comment-16162365 ] Weiwei Yang commented on HDFS-11676: +1 on the v3 patch, thanks [~vagarychen] for the patch and

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162386#comment-16162386 ] Yiqun Lin commented on HDFS-11676: -- Also +1 from me. > Ozone: SCM CLI: Implement close container command

[jira] [Commented] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162393#comment-16162393 ] Weiwei Yang commented on HDFS-12328: Hi [~yuanbo] Thanks for updating the description, I noticed that

[jira] [Updated] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12423: - Description: TopN container choosing policy should ignore unnecessary containers. Currently TopN policy

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: HDFS-11676-HDFS-7240.002.patch > Ozone: SCM CLI: Implement close container command >

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162251#comment-16162251 ] Ruslan Dautkhanov commented on HDFS-11851: -- Would it be possible to backport this patch to HDFS

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162329#comment-16162329 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for working on this, I took a look at the 005

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162399#comment-16162399 ] Yiqun Lin commented on HDFS-11772: -- I have add creation time for volume/bucket/key, more details can see

[jira] [Comment Edited] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162399#comment-16162399 ] Yiqun Lin edited comment on HDFS-11772 at 9/12/17 2:32 AM: --- I have added

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: (was: HDFS-12414.002.patch) > Ensure to use CLI command to enable/disable erasure coding

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.002.patch > Ensure to use CLI command to enable/disable erasure coding policy >

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exists

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Summary: Disable Namenode format when data already exists (was: Disallow Namenode format when data

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exists

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Description: Disable NameNode format to avoid accidental formatting of Namenode in production cluster.

[jira] [Commented] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162443#comment-16162443 ] Weiwei Yang commented on HDFS-12423: Thanks for filing this [~linyiqun], this is a good improvement to

[jira] [Commented] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162497#comment-16162497 ] Hadoop QA commented on HDFS-12414: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162122#comment-16162122 ] Andrew Wang commented on HDFS-11600: I posted an alternative disable patch on HDFS-12417. I don't

[jira] [Commented] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162123#comment-16162123 ] Arpit Agarwal commented on HDFS-12407: -- Thanks [~ajayydv]! +1 pending Jenkins. > Journal nodes

[jira] [Updated] (HDFS-12406) dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12406: - Fix Version/s: 3.1.0 > dfsadmin command prints "Exception encountered" even if there is no >

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162278#comment-16162278 ] Hadoop QA commented on HDFS-12417: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162330#comment-16162330 ] Weiwei Yang commented on HDFS-12098: Hi [~anu], [~vagarychen] Thanks for revisiting this, I could not

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) > Ozone: Datanode is

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Affects Version/s: HDFS-7240 > Ozone: Datanode is unable to register with scm if scm starts later >

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Fix Version/s: HDFS-7240 > Ozone: Datanode is unable to register with scm if scm starts later >

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.002.patch 1. fix style issues 2. fix failed unit tests > Ensure to use CLI

[jira] [Resolved] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-11772. - Resolution: Duplicate > Ozone: KSM: set creationTime for volume/bucket/key >

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162432#comment-16162432 ] Weiwei Yang commented on HDFS-12389: Thanks for the +1 [~anu], I am going to commit this shortly.

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11676: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Created] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12423: Summary: Ozone: TopN container choosing policy should ignore unnecessary containers Key: HDFS-12423 URL: https://issues.apache.org/jira/browse/HDFS-12423 Project: Hadoop

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Patch Available (was: Open) > Ensure to use CLI command to enable/disable erasure coding policy

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162331#comment-16162331 ] Hadoop QA commented on HDFS-12409: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12420) Disallow Namenode format when data already exists

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162364#comment-16162364 ] Hadoop QA commented on HDFS-12420: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12328: --- Priority: Major (was: Critical) > Ozone: Purge metadata of deleted blocks after max retry times >

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Attachment: HDFS-12416.001.patch > BlockPlacementPolicyDefault will cause NN shutdown if log level is

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161063#comment-16161063 ] Hadoop QA commented on HDFS-12415: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Status: Patch Available (was: Open) Patch submitted. The patch will check whether the stringbuilder is

[jira] [Commented] (HDFS-12008) Improve the available-space block placement policy

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160883#comment-16160883 ] Hadoop QA commented on HDFS-12008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
Suhan Mao created HDFS-12416: Summary: BlockPlacementPolicyDefault will cause NN shutdown if log level is changed Key: HDFS-12416 URL: https://issues.apache.org/jira/browse/HDFS-12416 Project: Hadoop

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Description: In BlockPlacementPolicyDefault.chooseRandom method. The code are in below structure:

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Attachment: HDFS-12415-HDFS-7240.001.patch > Ozone: TestXceiverClientManager occasionally fails >

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Status: Patch Available (was: Open) > Ozone: TestXceiverClientManager occasionally fails >

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160899#comment-16160899 ] Weiwei Yang commented on HDFS-12415: It looks like test cases are calling {{allocateContainer}} before

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.001.patch Initial patch > Ensure to use CLI command to enable/disable erasure

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Patch Available (was: Open) > Ensure to use CLI command to enable/disable erasure coding policy

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161004#comment-16161004 ] Weiwei Yang commented on HDFS-12370: I have tested this patch in a cluster, here is the steps I have

[jira] [Created] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12415: -- Summary: Ozone: TestXceiverClientManager occasionally fails Key: HDFS-12415 URL: https://issues.apache.org/jira/browse/HDFS-12415 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12370: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Suhan Mao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhan Mao updated HDFS-12416: - Attachment: HDFS-12416.patch > BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

[jira] [Commented] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161083#comment-16161083 ] Hadoop QA commented on HDFS-12416: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12416) BlockPlacementPolicyDefault will cause NN shutdown if log level is changed

2017-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161089#comment-16161089 ] Brahma Reddy Battula commented on HDFS-12416: - Dupe of HDFS-12177 and HDFS-11827..? >

[jira] [Work stopped] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12415 stopped by Weiwei Yang. -- > Ozone: TestXceiverClientManager occasionally fails >

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161095#comment-16161095 ] Rakesh R commented on HDFS-12395: - Thanks [~Sammi] for the continuous efforts. bq. I'm not very sure

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161098#comment-16161098 ] Yiqun Lin commented on HDFS-12370: -- Thanks for the review and commit, [~cheersyang].I noticed you

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161170#comment-16161170 ] Weiwei Yang commented on HDFS-12370: Hi [~linyiqun] Thanks for sharing your idea. The problem here is

[jira] [Commented] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161140#comment-16161140 ] Hadoop QA commented on HDFS-12414: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161137#comment-16161137 ] Mukul Kumar Singh commented on HDFS-12415: -- Thanks for the patch [~cheersyang], The patch looks

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161168#comment-16161168 ] Weiwei Yang commented on HDFS-12415: Hi [~msingh] Thanks for pointing this out, you are right, that

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager occasionally fails

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Status: In Progress (was: Patch Available) > Ozone: TestXceiverClientManager occasionally fails >

[jira] [Comment Edited] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161170#comment-16161170 ] Weiwei Yang edited comment on HDFS-12370 at 9/11/17 12:50 PM: -- Hi [~linyiqun]

[jira] [Updated] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11922: --- Attachment: Asynchronous key delete .pdf All major tasks are done, updated design doc updated,

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete between SCM and DN

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Summary: Ozone: DeleteKey-4: Block delete between SCM and DN (was: Ozone: DeleteKey-4: Block delete

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11922: --- Attachment: (was: Async delete keys.pdf) > Ozone: KSM: Garbage collect deleted blocks >

[jira] [Resolved] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-11922. Resolution: Done Fix Version/s: HDFS-7240 Target Version/s: HDFS-7240 > Ozone:

[jira] [Commented] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161409#comment-16161409 ] Anu Engineer commented on HDFS-11922: - [~cheersyang] & [~yuanbo] Thanks for designing and getting this

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-09-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161415#comment-16161415 ] Rushabh S Shah commented on HDFS-11754: --- Thanks [~erofeev] for working on this. Overall the patch

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160790#comment-16160790 ] Weiwei Yang commented on HDFS-12235: The UT failure was not related, I will commit this shortly. >

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-11600: - Attachment: HDFS-11600.002.patch > Refactor TestDFSStripedOutputStreamWithFailure test classes >

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161842#comment-16161842 ] Chris Douglas commented on HDFS-11600: -- Attached a naive rebase of the original patch.

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161796#comment-16161796 ] Hadoop QA commented on HDFS-12417: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161798#comment-16161798 ] Ajay Kumar commented on HDFS-12410: --- [~chris.douglas] Instead of ignoring such storage types shall we

[jira] [Commented] (HDFS-12410) Ignore unknown StorageTypes

2017-09-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161810#comment-16161810 ] Íñigo Goiri commented on HDFS-12410: [~ajayydv] resorting to default might be another option. However,

[jira] [Updated] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12417: - Attachment: HDFS-12417.001.patch Parameterizing tests by subclassing is not the correct pattern.

  1   2   3   >