[jira] [Commented] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997818#comment-15997818 ] Hadoop QA commented on HDFS-11693: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11659: --- Target Version/s: 2.9.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha2) >

[jira] [Updated] (HDFS-11752) getNonDfsUsed return 0 if reserved bigger than actualNonDfsUsed

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11752: --- Target Version/s: 2.7.1, 3.0.0-alpha3 (was: 2.7.1, 3.0.0-alpha2) > getNonDfsUsed return 0 if

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-05-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997816#comment-15997816 ] SammiChen commented on HDFS-9342: - Woops! Forgot address your comments. Will upload a new patch later. >

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-05-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9342: Attachment: HDFS-9342.05.patch > Erasure coding: client should update and commit block based on acknowledged

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-05-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997785#comment-15997785 ] Hudson commented on HDFS-11530: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11689 (See

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997774#comment-15997774 ] Kihwal Lee commented on HDFS-8818: -- I will post a patch for improvement tomorrow. I am letting it run

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-05-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997771#comment-15997771 ] Yiqun Lin commented on HDFS-11530: -- {quote} I believe Chen Liang also contributed some portions of this

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-05-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 > Use HDFS specific network topology to choose

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-05-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Resolution: Fixed Status: Resolved (was: Patch Available) > Use HDFS specific network topology

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997768#comment-15997768 ] Hadoop QA commented on HDFS-11673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997765#comment-15997765 ] Hadoop QA commented on HDFS-11693: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997759#comment-15997759 ] Andrew Wang commented on HDFS-9342: --- Hi Sammi, I think my minor comments from previous review have not

[jira] [Updated] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11693: Attachment: HDFS-11693-HDFS-7240.003.patch * Test failures are not related to this patch. * Fixed

[jira] [Commented] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997744#comment-15997744 ] Hadoop QA commented on HDFS-11693: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11576: --- Labels: release-blocker (was: ) Target Version/s: 2.7.4 > Block

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-05-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997700#comment-15997700 ] SammiChen commented on HDFS-9342: - Hi [~andrew.wang], I rebased v4 patch against the latest trunk to get v5

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997698#comment-15997698 ] Virajith Jalaparti commented on HDFS-11673: --- Fixed checkstyle errors in the latest patch. >

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Status: Open (was: Patch Available) > [READ] Handle failures of Datanodes with

[jira] [Updated] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9412: -- Labels: release-blocker (was: ) Target Version/s: 2.7.4 > getBlocks

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Status: Patch Available (was: Open) > [READ] Handle failures of Datanodes with

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Attachment: HDFS-11673-HDFS-9806.003.patch > [READ] Handle failures of Datanodes with

[jira] [Commented] (HDFS-11643) Add shouldReplicate option to create builder

2017-05-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997690#comment-15997690 ] SammiChen commented on HDFS-11643: -- Thanks [~andrew.wang] and [~jojochuang] for your review effort!

[jira] [Updated] (HDFS-2538) option to disable fsck dots

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2538: -- Labels: newbie release-blocker (was: newbie) Target Version/s: 2.7.4 >

[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8549: -- Labels: release-blocker (was: ) Target Version/s: 2.8.0, 2.7.4 (was:

[jira] [Updated] (HDFS-8131) Implement a space balanced block placement policy

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8131: -- Labels: BlockPlacementPolicy release-blocker (was: BlockPlacementPolicy)

[jira] [Commented] (HDFS-11674) reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered

2017-05-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997682#comment-15997682 ] Arpit Agarwal commented on HDFS-11674: -- Hi [~vinayrpet], I'll take a look at it. Thanks for the heads

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997678#comment-15997678 ] Hadoop QA commented on HDFS-11673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10715) NPE when applying AvailableSpaceBlockPlacementPolicy

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10715: --- Labels: release-blocker (was: ) Target Version/s: 2.7.4 > NPE when

[jira] [Updated] (HDFS-9710) Change DN to send block receipt IBRs in batches

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9710: -- Labels: release-blocker (was: ) Target Version/s: 2.7.4 > Change DN to

[jira] [Updated] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8893: -- Target Version/s: 3.0.0-alpha3 (was: 2.7.4, 3.0.0-alpha3) Removing from the scope of

[jira] [Updated] (HDFS-11373) Backport HDFS-11258 and HDFS-11272 to branch-2.7

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11373: --- Labels: release-blocker (was: ) > Backport HDFS-11258 and HDFS-11272 to branch-2.7 >

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11472: --- Labels: release-blocker (was: ) > Fix inconsistent replica size after a data

[jira] [Updated] (HDFS-11674) reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11674: --- Labels: release-blocker (was: ) > reserveSpaceForReplicas is not released if append

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8498: -- Target Version/s: 2.7.4 (was: 2.9.0, 3.0.0-alpha3, 2.8.1) > Blocks can be committed

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8498: -- Labels: release-blocker (was: ) > Blocks can be committed with wrong size >

[jira] [Updated] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11693: Attachment: HDFS-11693-HDFS-7240.002.patch Missed an edit in the patch .. new patch attached. >

[jira] [Updated] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11693: Attachment: (was: HDFS-11693-HDFS-7240.002.patch) > Ozone: Add archive support to containers >

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-05-04 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11273: -- Attachment: HDFS-11273-branch-2.001.patch > Move TransferFsImage#doGetUrl function to a Util

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7964: -- Labels: release-blocker (was: ) > Add support for async edit logging >

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2017-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7964: -- Target Version/s: 2.7.4 (was: 2.9.0) > Add support for async edit logging >

[jira] [Updated] (HDFS-11693) Ozone: Add archive support to containers

2017-05-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11693: Attachment: HDFS-11693-HDFS-7240.002.patch [~xyao] and [~cheersyang] Thanks for the reviews. This

[jira] [Commented] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997597#comment-15997597 ] Hadoop QA commented on HDFS-11759: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11448) JN log segment syncing should support HA upgrade

2017-05-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997581#comment-15997581 ] Hudson commented on HDFS-11448: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11687 (See

[jira] [Updated] (HDFS-11448) JN log segment syncing should support HA upgrade

2017-05-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11448: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997554#comment-15997554 ] Virajith Jalaparti commented on HDFS-11673: --- [~ehiggs] Looks like your comment somehow got

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Status: Patch Available (was: Open) > [READ] Handle failures of Datanodes with

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Attachment: HDFS-11673-HDFS-9806.002.patch > [READ] Handle failures of Datanodes with

[jira] [Updated] (HDFS-11673) [READ] Handle failures of Datanodes with PROVIDED storage

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11673: -- Status: Open (was: Patch Available) > [READ] Handle failures of Datanodes with

[jira] [Updated] (HDFS-10725) Caller context should always be constructed by a builder

2017-05-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-10725: Release Note: Previously, CallerContext was constructed by a builder. In this new pattern,

[jira] [Updated] (HDFS-10725) Caller context should always be constructed by a builder

2017-05-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-10725: Release Note: Currently CallerContext is constructed by a builder. In this pattern, the

[jira] [Assigned] (HDFS-3302) Review and improve HDFS trash documentation

2017-05-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-3302: -- Assignee: Madhu Kiran > Review and improve HDFS trash documentation >

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-05-04 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997509#comment-15997509 ] Ewan Higgs commented on HDFS-9807: -- {quote}Posted a new patch (v010) that reverts the unrelated changes to

[jira] [Commented] (HDFS-11731) Balancer.run() prints redundant included, excluded, source nodes.

2017-05-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997506#comment-15997506 ] Vrushali C commented on HDFS-11731: --- If I am not mistaken, the {code} LOG.info("parameters = " + p);

[jira] [Commented] (HDFS-11448) JN log segment syncing should support HA upgrade

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997504#comment-15997504 ] Hadoop QA commented on HDFS-11448: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11758) libhdfs++: Catch exceptions thrown by runtime hooks

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997498#comment-15997498 ] Hadoop QA commented on HDFS-11758: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11759: -- Labels: ozone (was: ) > Ozone : SCMNodeManager#close() should also close node pool manager object >

[jira] [Comment Edited] (HDFS-11755) Underconstruction blocks can be considered missing

2017-05-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997442#comment-15997442 ] Ravi Prakash edited comment on HDFS-11755 at 5/4/17 9:20 PM: - Hi Nathan! Thank

[jira] [Commented] (HDFS-11755) Underconstruction blocks can be considered missing

2017-05-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997442#comment-15997442 ] Ravi Prakash commented on HDFS-11755: - Hi Nathan! Thank you for reporting the bug. Could you please

[jira] [Updated] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11759: -- Attachment: HDFS-11759-HDFS-7240.001.patch > Ozone : SCMNodeManager#close() should also close node pool

[jira] [Updated] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11759: -- Status: Patch Available (was: Open) > Ozone : SCMNodeManager#close() should also close node pool

[jira] [Updated] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11759: -- Affects Version/s: HDFS-7240 > Ozone : SCMNodeManager#close() should also close node pool manager

[jira] [Created] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11759: - Summary: Ozone : SCMNodeManager#close() should also close node pool manager object Key: HDFS-11759 URL: https://issues.apache.org/jira/browse/HDFS-11759 Project: Hadoop

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11698: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997430#comment-15997430 ] Uma Maheswara Rao G commented on HDFS-11695: {quote} I think LogSync should be outside of both

[jira] [Comment Edited] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-05-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997430#comment-15997430 ] Uma Maheswara Rao G edited comment on HDFS-11695 at 5/4/17 9:05 PM:

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997429#comment-15997429 ] Tsz Wo Nicholas Sze commented on HDFS-8818: --- > Can you reveal more details on the nature of the

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997411#comment-15997411 ] Anu Engineer commented on HDFS-11698: - +1, for v3 patch. I will commit this shortly. > Ozone: SCM:

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997408#comment-15997408 ] Hadoop QA commented on HDFS-11698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11758) libhdfs++: Catch exceptions thrown by runtime hooks

2017-05-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11758: --- Status: Patch Available (was: Open) > libhdfs++: Catch exceptions thrown by runtime hooks >

[jira] [Updated] (HDFS-11758) libhdfs++: Catch exceptions thrown by runtime hooks

2017-05-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11758: --- Attachment: HDFS-11758.HDFS-8707.000.patch Catches exceptions when event hooks get called.

[jira] [Commented] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997388#comment-15997388 ] Hadoop QA commented on HDFS-10785: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997386#comment-15997386 ] Hadoop QA commented on HDFS-9807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11758) libhdfs++: Catch exceptions thrown by runtime hooks

2017-05-04 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11758: -- Summary: libhdfs++: Catch exceptions thrown by runtime hooks Key: HDFS-11758 URL: https://issues.apache.org/jira/browse/HDFS-11758 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11703) [READ] Tests for ProvidedStorageMap

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11703: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Tests for

[jira] [Commented] (HDFS-11703) [READ] Tests for ProvidedStorageMap

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997382#comment-15997382 ] Virajith Jalaparti commented on HDFS-11703: --- Findbugs error is unrelated. Committed to feature

[jira] [Commented] (HDFS-11448) JN log segment syncing should support HA upgrade

2017-05-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997365#comment-15997365 ] Jing Zhao commented on HDFS-11448: -- +1 for the 03 patch. Thank you for the work [~hanishakoneru]! Thank

[jira] [Updated] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11663: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Fix

[jira] [Commented] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997362#comment-15997362 ] Virajith Jalaparti commented on HDFS-11663: --- Findbugs warnings are unrelated to this issue.

[jira] [Commented] (HDFS-11448) JN log segment syncing should support HA upgrade

2017-05-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997361#comment-15997361 ] Arpit Agarwal commented on HDFS-11448: -- +1 from me for the v03 patch. [~jingzhao], do you have any

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997344#comment-15997344 ] Hudson commented on HDFS-11687: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11684 (See

[jira] [Commented] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997338#comment-15997338 ] Virajith Jalaparti commented on HDFS-11653: --- Thanks for taking a look [~ehiggs]. Committed to

[jira] [Updated] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11653: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ]

[jira] [Updated] (HDFS-11448) JN log segment syncing should support HA upgrade

2017-05-04 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11448: -- Attachment: HDFS-11448.003.patch Thank you [~arpitagarwal]. I have addressed your comments in

[jira] [Comment Edited] (HDFS-9807) Add an optional StorageID to writes

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997232#comment-15997232 ] Virajith Jalaparti edited comment on HDFS-9807 at 5/4/17 7:19 PM: -- Posted

[jira] [Commented] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-05-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997280#comment-15997280 ] Lei (Eddy) Xu commented on HDFS-11659: -- [~yzhangal] The DataNode is added later after hot swap is due

[jira] [Comment Edited] (HDFS-11702) Remove indefinite caching of key provider uri in DFSClient

2017-05-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997270#comment-15997270 ] Rushabh S Shah edited comment on HDFS-11702 at 5/4/17 7:17 PM: --- Thanks

[jira] [Commented] (HDFS-11702) Remove indefinite caching of key provider uri in DFSClient

2017-05-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997270#comment-15997270 ] Rushabh S Shah commented on HDFS-11702: --- Thanks [~hanishakoneru] [~andrew.wang] for the reviews. bq.

[jira] [Commented] (HDFS-11643) Add shouldReplicate option to create builder

2017-05-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997266#comment-15997266 ] Hudson commented on HDFS-11643: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11683 (See

[jira] [Updated] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11687: - Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.9.0 Status:

[jira] [Updated] (HDFS-10785) libhdfs++: Implement the rest of the tools

2017-05-04 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10785: - Attachment: HDFS-10785.HDFS-8707.002.patch Fixed the whitespace issues. > libhdfs++: Implement

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-05-04 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997232#comment-15997232 ] Virajith Jalaparti commented on HDFS-9807: -- Posted a new patch (v010) that reverts the unrelated

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997206#comment-15997206 ] Andrew Wang commented on HDFS-9342: --- Thanks for reviewing Zhe! Ping [~Sammi], think we can get a quick

[jira] [Updated] (HDFS-11643) Add shouldReplicate option to create builder

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11643: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Created] (HDFS-11757) Query StreamCapabilities when creating balancer's lock file

2017-05-04 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11757: -- Summary: Query StreamCapabilities when creating balancer's lock file Key: HDFS-11757 URL: https://issues.apache.org/jira/browse/HDFS-11757 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11756) Ozone : add DEBUG CLI support of blockDB file

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11756: -- Attachment: HDFS-11756-HDFS-7240.001.patch > Ozone : add DEBUG CLI support of blockDB file >

[jira] [Updated] (HDFS-11756) Ozone : add DEBUG CLI support of blockDB file

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11756: -- Attachment: (was: HDFS-11756-HDFS-7240.001.patch) > Ozone : add DEBUG CLI support of blockDB file >

[jira] [Updated] (HDFS-11643) Add shouldReplicate option to create builder

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11643: --- Summary: Add shouldReplicate option to create builder (was: Balancer fencing fails when writing

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: HDFS-11698-HDFS-7240.003.patch Attach v003 patch to close levelDB also, thanks [~anu] for

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997196#comment-15997196 ] Andrew Wang commented on HDFS-11643: Fair enough. We should try revising this once HDFS-11644 goes in,

  1   2   >