[jira] [Updated] (HDFS-5042) Completed files lost after power failure

2017-05-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5042: Attachment: HDFS-5042-02.patch Updated the patch to fix javadoc and checkstyle > Completed files

[jira] [Updated] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11695: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020652#comment-16020652 ] Uma Maheswara Rao G commented on HDFS-11695: +1 on the latest patch > [SPS]: Namenode failed

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-05-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020641#comment-16020641 ] Vinayakumar B commented on HDFS-11708: -- bq. Not sure I understand what you are trying to fix here. It

[jira] [Commented] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-05-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020621#comment-16020621 ] Hudson commented on HDFS-11419: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11768 (See

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-05-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11535: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020596#comment-16020596 ] Hadoop QA commented on HDFS-11859: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2017-05-22 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020593#comment-16020593 ] KWON BYUNGCHANG commented on HDFS-11153: This problem also occurs in ResourceManager. I think

[jira] [Updated] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2017-05-22 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-11153: Attachment: stupid.png > RPC Client detect address changed should reconnect immediately >

[jira] [Comment Edited] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2017-05-22 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020587#comment-16020587 ] DENG FEI edited comment on HDFS-11153 at 5/23/17 2:47 AM: -- As default

[jira] [Commented] (HDFS-11153) RPC Client detect address changed should reconnect immediately

2017-05-22 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020587#comment-16020587 ] DENG FEI commented on HDFS-11153: - As default behavior,why found host is changed,but do nothing.it's

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-05-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020574#comment-16020574 ] Andrew Wang commented on HDFS-7337: --- Hi folks, thanks for the discussion, bq. Is there a way to choose a

[jira] [Commented] (HDFS-11377) Balancer hung due to no available mover threads

2017-05-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020566#comment-16020566 ] Brahma Reddy Battula commented on HDFS-11377: - [~shv] can you please update the CHANGES.txt in

[jira] [Updated] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-05-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11851: --- Target Version/s: 3.0.0-alpha3 > getGlobalJNIEnv() may deadlock if exception is thrown >

[jira] [Commented] (HDFS-11808) Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020550#comment-16020550 ] Hadoop QA commented on HDFS-11808: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020549#comment-16020549 ] Hadoop QA commented on HDFS-11837: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020551#comment-16020551 ] Hadoop QA commented on HDFS-11078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-05-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020545#comment-16020545 ] Konstantin Shvachko commented on HDFS-11708: Not sure I understand what you are trying to fix

[jira] [Commented] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020542#comment-16020542 ] Hudson commented on HDFS-11866: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11767 (See

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020540#comment-16020540 ] Hadoop QA commented on HDFS-11535: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11849) JournalNode startup failure exception should be logged in log file

2017-05-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020531#comment-16020531 ] Surendra Singh Lilhore commented on HDFS-11849: --- Thanks [~brahmareddy] for review and

[jira] [Commented] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

2017-05-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020515#comment-16020515 ] Andrew Wang commented on HDFS-11383: Hi Misha, could you provide some indicative comparison numbers

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020510#comment-16020510 ] Hadoop QA commented on HDFS-11817: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11377) Balancer hung due to no available mover threads

2017-05-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11377: --- Target Version/s: 2.9.0, 2.7.4, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha3) Fix

[jira] [Updated] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11866: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020485#comment-16020485 ] Hadoop QA commented on HDFS-11865: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11597) Ozone: Add Ratis management API

2017-05-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11597: --- Attachment: HDFS-11597-HDFS-7240.20170522.patch HDFS-11597-HDFS-7240.20170522.patch:

[jira] [Commented] (HDFS-11742) Improve balancer usability after HDFS-8818

2017-05-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020458#comment-16020458 ] Konstantin Shvachko commented on HDFS-11742: [~kihwal] do you have a graph showing Balancer

[jira] [Commented] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020454#comment-16020454 ] Hadoop QA commented on HDFS-11866: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-05-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020452#comment-16020452 ] Andrew Wang commented on HDFS-10480: Thanks for working on this Manoj. Looks good overall! One

[jira] [Updated] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11859: -- Attachment: HDFS-11859-HDFS-7240.006.patch Fix the block service rpc port issue. > Ozone : separate

[jira] [Updated] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2017-05-22 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gurmukh singh updated HDFS-7134: Component/s: datanode > Replication count for a block should not update till the blocks have settled

[jira] [Commented] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2017-05-22 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020441#comment-16020441 ] gurmukh singh commented on HDFS-7134: - This behavior is still seen in hadoop 2.7.3. Can someone look

[jira] [Updated] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2017-05-22 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gurmukh singh updated HDFS-7134: Labels: HDFS (was: ) > Replication count for a block should not update till the blocks have settled

[jira] [Updated] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2017-05-22 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gurmukh singh updated HDFS-7134: Component/s: hdfs > Replication count for a block should not update till the blocks have settled >

[jira] [Updated] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2017-05-22 Thread gurmukh singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gurmukh singh updated HDFS-7134: Affects Version/s: 2.7.3 > Replication count for a block should not update till the blocks have

[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Attachment: HDFS-11078-branch-2.7.patch > NPE in LazyPersistFileScrubber >

[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Target Version/s: 2.7.4 Status: In Progress (was: Patch Available) > NPE in

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-05-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020392#comment-16020392 ] Arpit Agarwal commented on HDFS-11535: -- Thanks [~vagarychen]. +1 pending Jenkins (which should be a

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-05-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020393#comment-16020393 ] Andrew Wang commented on HDFS-10480: I'll review this shortly. bq. I never understand the need to

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11535: -- Attachment: HDFS-11535.004.patch Thanks [~arpitagarwal] for the comments! Post v004 patch with a number

[jira] [Updated] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2017-05-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9412: -- Attachment: HDFS-9412-branch-2.7.00.patch > getBlocks occupies FSLock and takes too long

[jira] [Updated] (HDFS-11808) Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress

2017-05-22 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11808: - Attachment: HDFS-11808-branch-2.7-01.patch rebased. > Backport HDFS-8549 to branch-2.7: Abort

[jira] [Updated] (HDFS-11808) Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress

2017-05-22 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11808: - Status: Patch Available (was: Open) > Backport HDFS-8549 to branch-2.7: Abort the balancer if an

[jira] [Updated] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

2017-05-22 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11837: - Status: Patch Available (was: Open) > Backport HDFS-9710 to branch-2.7: Change

[jira] [Assigned] (HDFS-11808) Backport HDFS-8549 to branch-2.7: Abort the balancer if an upgrade is in progress

2017-05-22 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HDFS-11808: Assignee: Akira Ajisaka > Backport HDFS-8549 to branch-2.7: Abort the balancer if an

[jira] [Updated] (HDFS-11837) Backport HDFS-9710 to branch-2.7: Change DN to send block receipt IBRs in batches

2017-05-22 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-11837: - Attachment: HDFS-9710-branch-2.7.00.patch > Backport HDFS-9710 to branch-2.7:

[jira] [Comment Edited] (HDFS-2538) option to disable fsck dots

2017-05-22 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020357#comment-16020357 ] Akira Ajisaka edited comment on HDFS-2538 at 5/22/17 11:01 PM: --- bq. shall we

[jira] [Commented] (HDFS-2538) option to disable fsck dots

2017-05-22 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020357#comment-16020357 ] Akira Ajisaka commented on HDFS-2538: - bq. shall we remove 2.7.4 from target version and releaseblocker

[jira] [Updated] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11817: -- Attachment: HDFS-11817.v2.trunk.patch HDFS-11817.v2.branch-2.patch > A faulty node can

[jira] [Commented] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020340#comment-16020340 ] Arpit Agarwal commented on HDFS-11866: -- +1 pending Jenkins. > JournalNode Sync should be off by

[jira] [Created] (HDFS-11869) Backport HDFS-11078 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-11869: -- Summary: Backport HDFS-11078 to branch 2.7 Key: HDFS-11869 URL: https://issues.apache.org/jira/browse/HDFS-11869 Project: Hadoop HDFS Issue Type: Task

[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Attachment: HDFS-11078-branch-2.7.patch > Backport HDFS-11078 to branch 2.7 >

[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Status: In Progress (was: Patch Available) > Backport HDFS-11078 to branch 2.7 >

[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Status: Patch Available (was: Open) > Backport HDFS-11078 to branch 2.7 >

[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: In Progress (was: Patch Available) > Backport HDFS-8674 to branch 2.7 >

[jira] [Created] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-11868: -- Summary: Backport HDFS-8674 to branch 2.7 Key: HDFS-11868 URL: https://issues.apache.org/jira/browse/HDFS-11868 Project: Hadoop HDFS Issue Type: Task

[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Attachment: HDFS-8674-branch-2.7.patch > Backport HDFS-8674 to branch 2.7 >

[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: Patch Available (was: Open) > Backport HDFS-8674 to branch 2.7 >

[jira] [Updated] (HDFS-11867) Backport HDFS-6291 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11867: --- Attachment: HDFS-6291-branch-2.7.patch > Backport HDFS-6291 to branch 2.7 >

[jira] [Updated] (HDFS-11867) Backport HDFS-6291 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11867: --- Status: In Progress (was: Patch Available) > Backport HDFS-6291 to branch 2.7 >

[jira] [Updated] (HDFS-11867) Backport HDFS-6291 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11867: --- Status: Patch Available (was: Open) > Backport HDFS-6291 to branch 2.7 >

[jira] [Created] (HDFS-11867) Backport HDFS-6291 to branch 2.7

2017-05-22 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-11867: -- Summary: Backport HDFS-6291 to branch 2.7 Key: HDFS-11867 URL: https://issues.apache.org/jira/browse/HDFS-11867 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020326#comment-16020326 ] Hadoop QA commented on HDFS-11741: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11866: -- Attachment: HDFS-11866.001.patch > JournalNode Sync should be off by default in

[jira] [Updated] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11866: -- Status: Patch Available (was: Open) > JournalNode Sync should be off by default in

[jira] [Created] (HDFS-11866) JournalNode Sync should be off by default in hdfs-default.xml

2017-05-22 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-11866: - Summary: JournalNode Sync should be off by default in hdfs-default.xml Key: HDFS-11866 URL: https://issues.apache.org/jira/browse/HDFS-11866 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020252#comment-16020252 ] Kihwal Lee commented on HDFS-11817: --- In trunk, there already is a logic to weed out null StorageInfo

[jira] [Updated] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11865: --- Status: Patch Available (was: Open) > Ozone: Do not initialize Ratis cluster during

[jira] [Updated] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11865: --- Attachment: HDFS-11865-HDFS-7240.20170522.patch HDFS-11865-HDFS-7240.20170522.patch:

[jira] [Created] (HDFS-11865) Ozone: Do not initialize Ratis cluster during datanode startup

2017-05-22 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-11865: -- Summary: Ozone: Do not initialize Ratis cluster during datanode startup Key: HDFS-11865 URL: https://issues.apache.org/jira/browse/HDFS-11865 Project:

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-05-22 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020209#comment-16020209 ] Lei (Eddy) Xu commented on HDFS-7337: - Hi, [~drankye] and [~Sammi] Thanks a lot for the reply. The

[jira] [Updated] (HDFS-11770) Ozone: KSM: Add setVolumeProperty

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11770: -- Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: HDFS-7240

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11741: --- Attachment: HDFS-11741.004.patch Hi Yongjun. The patch should still apply with git apply -3.

[jira] [Updated] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11860: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020121#comment-16020121 ] Xiaoyu Yao commented on HDFS-11860: --- Thanks [~vagarychen] for the review. I will commit the patch

[jira] [Commented] (HDFS-11770) Ozone: KSM: Add setVolumeProperty

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020117#comment-16020117 ] Xiaoyu Yao commented on HDFS-11770: --- The latest patch looks good to me. +1, I will commit it shortly.

[jira] [Commented] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020102#comment-16020102 ] Hadoop QA commented on HDFS-11859: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020098#comment-16020098 ] Hudson commented on HDFS-11863: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11765 (See

[jira] [Commented] (HDFS-11849) JournalNode startup failure exception should be logged in log file

2017-05-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020099#comment-16020099 ] Hudson commented on HDFS-11849: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11765 (See

[jira] [Commented] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020084#comment-16020084 ] Hadoop QA commented on HDFS-11860: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11849) JournalNode startup failure exception should be logged in log file

2017-05-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11849: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

[jira] [Commented] (HDFS-2538) option to disable fsck dots

2017-05-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019981#comment-16019981 ] Brahma Reddy Battula commented on HDFS-2538: shall we remove {{2.7.4}} from target version and

[jira] [Updated] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11863: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11859: -- Attachment: HDFS-11859-HDFS-7240.005.patch I can't repro the biding error when running all ozone tests

[jira] [Commented] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019934#comment-16019934 ] Brahma Reddy Battula commented on HDFS-11863: - bq.BTW, do you have found any other missing

[jira] [Commented] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019922#comment-16019922 ] Chen Liang commented on HDFS-11860: --- thanks [~xyao] for v002 patch, +1, pending jenkins > Ozone: SCM:

[jira] [Updated] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11860: -- Attachment: HDFS-11860-HDFS-7240.002.patch > Ozone: SCM: SCMContainerPlacementCapacity#chooseNode

[jira] [Commented] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019904#comment-16019904 ] Xiaoyu Yao commented on HDFS-11860: --- Thanks [~vagarychen] for the review. The test failure are not

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-05-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019886#comment-16019886 ] Kihwal Lee commented on HDFS-11817: --- Two test failures are real. {noformat}

[jira] [Commented] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019876#comment-16019876 ] Hadoop QA commented on HDFS-11863: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019869#comment-16019869 ] Hanisha Koneru commented on HDFS-11863: --- Thanks [~linyiqun] for the patch. Patch v02 LGTM. >

[jira] [Updated] (HDFS-11850) Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11850: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to the feature branch. >

[jira] [Commented] (HDFS-11850) Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019839#comment-16019839 ] Chen Liang commented on HDFS-11850: --- Thanks [~msingh] for working on this! v001 patch LGTM, will commit

[jira] [Commented] (HDFS-11860) Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list.

2017-05-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019827#comment-16019827 ] Chen Liang commented on HDFS-11860: --- Thanks [~xyao] for the debugging and the fix! v001 patch LGTM with

[jira] [Assigned] (HDFS-11539) Block Storage : configurable max cache size

2017-05-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-11539: Assignee: Mukul Kumar Singh > Block Storage : configurable max cache size >

[jira] [Comment Edited] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019695#comment-16019695 ] Yiqun Lin edited comment on HDFS-11863 at 5/22/17 3:20 PM: --- Thanks

[jira] [Updated] (HDFS-11863) Document missing metrics for blocks count in pending IBR

2017-05-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11863: - Attachment: HDFS-11863.002.patch Thanks [~brahmareddy] for the review and comments. {quote} i) Can we

[jira] [Assigned] (HDFS-11864) Document Metrics to track usage of memory for writes

2017-05-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11864: Assignee: Yiqun Lin > Document Metrics to track usage of memory for writes >

[jira] [Updated] (HDFS-11778) Ozone: KSM: add getBucketInfo

2017-05-22 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-11778: -- Attachment: HDFS-11778-HDFS-7240.000.patch > Ozone: KSM: add getBucketInfo >

  1   2   >