[jira] [Commented] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560602#comment-16560602 ] Bharat Viswanadham commented on HDDS-248: - Able to build locally. Resubmitted Jenkins run for

[jira] [Commented] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560550#comment-16560550 ] genericqa commented on HDDS-248: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-267) Handle consistency issues during container update/close

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560547#comment-16560547 ] genericqa commented on HDDS-267: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider using UGI at creation time for consistent UGI handling

2018-07-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560500#comment-16560500 ] Xiao Chen commented on HDFS-13697: -- Thanks [~zvenczel] for taking up this large piece of work! I think

[jira] [Comment Edited] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider using UGI at creation time for consistent UGI handling

2018-07-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560500#comment-16560500 ] Xiao Chen edited comment on HDFS-13697 at 7/27/18 11:56 PM: Thanks

[jira] [Commented] (HDDS-267) Handle consistency issues during container update/close

2018-07-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560484#comment-16560484 ] Hanisha Koneru commented on HDDS-267: - Rebased on top of current trunk. > Handle consistency issues

[jira] [Updated] (HDDS-267) Handle consistency issues during container update/close

2018-07-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-267: Attachment: HDDS-267.002.patch > Handle consistency issues during container update/close >

[jira] [Updated] (HDDS-204) Modify Integration tests for new ContainerIO classes

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-204: Fix Version/s: 0.2.1 > Modify Integration tests for new ContainerIO classes >

[jira] [Commented] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560480#comment-16560480 ] Bharat Viswanadham commented on HDDS-248: - +1. Pending Jenkins. > Refactor

[jira] [Commented] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560469#comment-16560469 ] Hanisha Koneru commented on HDDS-248: - Thanks for the review [~bharatviswa]. Updated the patch. >

[jira] [Updated] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-248: Attachment: HDDS-248.004.patch > Refactor DatanodeContainerProtocol.proto >

[jira] [Assigned] (HDFS-13741) Cosmetic code improvement in XAttrFormat

2018-07-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-13741: --- Assignee: Angus Klein (was: Daniel Templeton) > Cosmetic code improvement in

[jira] [Assigned] (HDDS-299) Add InterfaceAudience/InterfaceStability annotations

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-299: --- Assignee: Bharat Viswanadham > Add InterfaceAudience/InterfaceStability annotations >

[jira] [Created] (HDDS-299) Add InterfaceAudience/InterfaceStability annotations

2018-07-27 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-299: --- Summary: Add InterfaceAudience/InterfaceStability annotations Key: HDDS-299 URL: https://issues.apache.org/jira/browse/HDDS-299 Project: Hadoop Distributed Data

[jira] [Commented] (HDDS-267) Handle consistency issues during container update/close

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560443#comment-16560443 ] Bharat Viswanadham commented on HDDS-267: - Hi [~hanishakoneru] Patch is not applying. Can you

[jira] [Comment Edited] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560441#comment-16560441 ] Bharat Viswanadham edited comment on HDDS-248 at 7/27/18 10:51 PM: --- Hi

[jira] [Commented] (HDDS-248) Refactor DatanodeContainerProtocol.proto

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560441#comment-16560441 ] Bharat Viswanadham commented on HDDS-248: - Hi [~hanishakoneru] Thanks for the patch. Over all

[jira] [Commented] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-07-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560404#comment-16560404 ] Xiao Chen commented on HDFS-13658: -- Thanks for revving Kitti. - ECBlockGroupStats and 

[jira] [Commented] (HDDS-280) Support ozone dist-start-stitching on openbsd/osx

2018-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560398#comment-16560398 ] Allen Wittenauer commented on HDDS-280: --- There are probably a million ways to get a docker-compose

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560384#comment-16560384 ] Chen Liang commented on HDFS-13767: --- Thanks for the comments [~shv]! Updated WIP.003 patch with you

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767.WIP.003.patch > Add msync server implementation. >

[jira] [Commented] (HDDS-298) Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560355#comment-16560355 ] genericqa commented on HDDS-298: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13523) Support observer nodes in MiniDFSCluster

2018-07-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560332#comment-16560332 ] Erik Krogen commented on HDFS-13523: Thanks for working on this [~zhengxg3]! Glad we finally got the

[jira] [Commented] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560302#comment-16560302 ] genericqa commented on HDDS-246: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-298) Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560290#comment-16560290 ] Ajay Kumar commented on HDDS-298: - Ping [~ljain],[~elek] for review. Below is brief summary of

[jira] [Comment Edited] (HDDS-298) Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560290#comment-16560290 ] Ajay Kumar edited comment on HDDS-298 at 7/27/18 8:32 PM: -- Ping [~ljain],[~elek]

[jira] [Updated] (HDDS-298) Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-298: Status: Patch Available (was: Open) > Implement SCMClientProtocolServer.getContainerWithPipeline for closed

[jira] [Updated] (HDDS-298) Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-298: Attachment: HDDS-298.00.patch > Implement SCMClientProtocolServer.getContainerWithPipeline for closed >

[jira] [Commented] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560269#comment-16560269 ] genericqa commented on HDFS-13658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider using UGI at creation time for consistent UGI handling

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560170#comment-16560170 ] genericqa commented on HDFS-13697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-245) Handle ContainerReports in the SCM

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560153#comment-16560153 ] Anu Engineer commented on HDDS-245: --- The changes look excellent. I am a +1 on this patch. Some small

[jira] [Comment Edited] (HDDS-245) Handle ContainerReports in the SCM

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560125#comment-16560125 ] Bharat Viswanadham edited comment on HDDS-245 at 7/27/18 6:44 PM: -- I think

[jira] [Comment Edited] (HDDS-245) Handle ContainerReports in the SCM

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560125#comment-16560125 ] Bharat Viswanadham edited comment on HDDS-245 at 7/27/18 6:43 PM: -- I think

[jira] [Commented] (HDDS-245) Handle ContainerReports in the SCM

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560125#comment-16560125 ] Bharat Viswanadham commented on HDDS-245: - I think for emitiReplicationRequestEvent, we need to

[jira] [Comment Edited] (HDDS-245) Handle ContainerReports in the SCM

2018-07-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560125#comment-16560125 ] Bharat Viswanadham edited comment on HDDS-245 at 7/27/18 6:41 PM: -- I think

[jira] [Commented] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560113#comment-16560113 ] genericqa commented on HDFS-13421: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-07-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13421: -- Status: Patch Available (was: Open) > [PROVIDED Phase 2] Implement DNA_BACKUP command

[jira] [Commented] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-07-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560107#comment-16560107 ] Virajith Jalaparti commented on HDFS-13421: --- Reattached [^HDFS-13421-HDFS-12090.004.patch] as

[jira] [Updated] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-07-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13421: -- Status: Open (was: Patch Available) > [PROVIDED Phase 2] Implement DNA_BACKUP command

[jira] [Updated] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode

2018-07-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13421: -- Attachment: HDFS-13421-HDFS-12090.005.patch > [PROVIDED Phase 2] Implement DNA_BACKUP

[jira] [Commented] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560093#comment-16560093 ] Shashikant Banerjee commented on HDDS-246: -- Thanks [~msingh], for the review comments. patch v2

[jira] [Updated] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-246: - Attachment: HDDS-246.02.patch > Datanode should throw BlockNotCommittedException for

[jira] [Updated] (HDDS-273) DeleteLog entries should be purged only after corresponding DNs commit the transaction

2018-07-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-273: --- Summary: DeleteLog entries should be purged only after corresponding DNs commit the transaction (was:

[jira] [Updated] (HDDS-278) ozone integration test sometime crashes

2018-07-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-278: --- Component/s: test > ozone integration test sometime crashes > ---

[jira] [Commented] (HDFS-13765) Fix javadoc for FSDirMkdirOp#createParentDirectories

2018-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560056#comment-16560056 ] Hudson commented on HDFS-13765: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14654 (See

[jira] [Updated] (HDFS-13727) Log full stack trace if DiskBalancer exits with an unhandled exception

2018-07-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13727: - Fix Version/s: 3.1.2 > Log full stack trace if DiskBalancer exits with an unhandled exception >

[jira] [Updated] (HDFS-13765) Fix javadoc for FSDirMkdirOp#createParentDirectories

2018-07-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13765: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.4

[jira] [Commented] (HDDS-271) Create a block iterator to iterate blocks in a container

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560022#comment-16560022 ] Anu Engineer commented on HDDS-271: --- {quote}I was thinking of some cases where we would like to identify

[jira] [Commented] (HDDS-270) Move generic container util functions to ContianerUtils

2018-07-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560017#comment-16560017 ] Hanisha Koneru commented on HDDS-270: - Thanks [~anu] for committing the patch. > Move generic

[jira] [Commented] (HDDS-273) DeleteLog entries should be purged only after corresponding dns commit the transaction

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560013#comment-16560013 ] genericqa commented on HDDS-273: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDDS-271) Create a block iterator to iterate blocks in a container

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560009#comment-16560009 ] Ajay Kumar edited comment on HDDS-271 at 7/27/18 5:06 PM: -- hi [~anu], plz see my

[jira] [Commented] (HDDS-271) Create a block iterator to iterate blocks in a container

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560009#comment-16560009 ] Ajay Kumar commented on HDDS-271: - hi [~anu], plz see my response inline. {quote}I really wonder if we

[jira] [Commented] (HDDS-245) Handle ContainerReports in the SCM

2018-07-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1656#comment-1656 ] Ajay Kumar commented on HDDS-245: - [~elek] thanks for working on this. Patch 4 looks good. Few questions:

[jira] [Commented] (HDFS-13727) Log full stack trace if DiskBalancer exits with an unhandled exception

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559993#comment-16559993 ] Anu Engineer commented on HDFS-13727: - [~xiaochen] Thanks for catching it. I have Cherrypicked to

[jira] [Commented] (HDDS-226) Client should update block length in OM while committing the key

2018-07-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559991#comment-16559991 ] Tsz Wo Nicholas Sze commented on HDDS-226: -- Currently, BlockID, by its name, contains just IDs.

[jira] [Commented] (HDDS-280) Support ozone dist-start-stitching on openbsd/osx

2018-07-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559988#comment-16559988 ] Elek, Marton commented on HDDS-280: --- Thanks the feedback. We use docker-compose with pre-created images:

[jira] [Commented] (HDDS-276) Fix symbolic link creation during Ozone dist process

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559989#comment-16559989 ] Anu Engineer commented on HDDS-276: --- Let us fix HDDS-280, as suggested by [~aw]. It is better to have a

[jira] [Commented] (HDDS-276) Fix symbolic link creation during Ozone dist process

2018-07-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559980#comment-16559980 ] Elek, Marton commented on HDDS-276: --- I totally agree with you, but in fact this patch doesn't modify any

[jira] [Commented] (HDFS-13727) Log full stack trace if DiskBalancer exits with an unhandled exception

2018-07-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559978#comment-16559978 ] Xiao Chen commented on HDFS-13727: -- Thanks all for the contribution here. Hey [~anu], appreciate your

[jira] [Updated] (HDFS-13771) enableManagedDfsDirsRedundancy typo in creating MiniDFSCluster

2018-07-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13771: - Status: Patch Available (was: Open) > enableManagedDfsDirsRedundancy typo in creating

[jira] [Assigned] (HDFS-13771) enableManagedDfsDirsRedundancy typo in creating MiniDFSCluster

2018-07-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-13771: Assignee: wilderchen > enableManagedDfsDirsRedundancy typo in creating MiniDFSCluster >

[jira] [Commented] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559948#comment-16559948 ] Mukul Kumar Singh commented on HDDS-246: Thanks for working on this [~shashikant]. +1,v1 patch

[jira] [Commented] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559954#comment-16559954 ] Mukul Kumar Singh commented on HDDS-246: I just realized that there are unit test failures because

[jira] [Commented] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-07-27 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559941#comment-16559941 ] Kitti Nanasi commented on HDFS-13658: - Thanks [~xiaochen] for the comments. I fixed your comments in

[jira] [Updated] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-07-27 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kitti Nanasi updated HDFS-13658: Attachment: HDFS-13658.009.patch > fsck, dfsadmin -report, and NN WebUI should report number of

[jira] [Updated] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-07-27 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kitti Nanasi updated HDFS-13658: Attachment: (was: HDFS-13658.009.patch) > fsck, dfsadmin -report, and NN WebUI should report

[jira] [Updated] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

2018-07-27 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kitti Nanasi updated HDFS-13658: Attachment: HDFS-13658.009.patch > fsck, dfsadmin -report, and NN WebUI should report number of

[jira] [Commented] (HDDS-273) DeleteLog entries should be purged only after corresponding dns commit the transaction

2018-07-27 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559934#comment-16559934 ] Lokesh Jain commented on HDDS-273: -- [~msingh] Thanks for reviewing the patch! v4 patch addresses your

[jira] [Updated] (HDDS-273) DeleteLog entries should be purged only after corresponding dns commit the transaction

2018-07-27 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-273: - Attachment: HDDS-273.004.patch > DeleteLog entries should be purged only after corresponding dns commit

[jira] [Assigned] (HDDS-200) Create Dead Node Watcher

2018-07-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-200: --- Assignee: Ajay Kumar (was: Xiaoyu Yao) Summary: Create Dead Node Watcher (was: Create

[jira] [Commented] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559902#comment-16559902 ] genericqa commented on HDDS-246: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDDS-298) Implement SCMClientProtocolServer.getContainerWithPipeline for closed containers

2018-07-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-298: --- Assignee: Ajay Kumar (was: Lokesh Jain) > Implement SCMClientProtocolServer.getContainerWithPipeline

[jira] [Updated] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider using UGI at creation time for consistent UGI handling

2018-07-27 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13697: - Summary: DFSClient should instantiate and cache KMSClientProvider using UGI at creation time for

[jira] [Updated] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider at creation time for consistent UGI handling

2018-07-27 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13697: - Attachment: HDFS-13697.05.patch > DFSClient should instantiate and cache KMSClientProvider at

[jira] [Updated] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider at creation time for consistent UGI handling

2018-07-27 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13697: - Attachment: (was: HDFS-13697.05.patch) > DFSClient should instantiate and cache

[jira] [Comment Edited] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider at creation time for consistent UGI handling

2018-07-27 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558750#comment-16558750 ] Zsolt Venczel edited comment on HDFS-13697 at 7/27/18 3:06 PM: --- The latest

[jira] [Updated] (HDFS-13697) DFSClient should instantiate and cache KMSClientProvider at creation time for consistent UGI handling

2018-07-27 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13697: - Attachment: HDFS-13697.05.patch > DFSClient should instantiate and cache KMSClientProvider at

[jira] [Commented] (HDDS-270) Move generic container util functions to ContianerUtils

2018-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559817#comment-16559817 ] Hudson commented on HDDS-270: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #14653 (See

[jira] [Updated] (HDDS-270) Move generic container util functions to ContianerUtils

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-270: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~hanishakoneru] Thank you for the

[jira] [Updated] (HDDS-276) Fix symbolic link creation during Ozone dist process

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-276: -- Status: Open (was: Patch Available) Cancelling this patch based on [~aw] feedback. We will make a

[jira] [Commented] (HDDS-276) Fix symbolic link creation during Ozone dist process

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559796#comment-16559796 ] Anu Engineer commented on HDDS-276: --- [~aw] Thanks for the feedback. You bring in a valuable perspective,

[jira] [Commented] (HDDS-276) Fix symbolic link creation during Ozone dist process

2018-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559793#comment-16559793 ] Allen Wittenauer commented on HDDS-276: --- Nope, -1 on this patch too. This patch pretty much breaks a

[jira] [Commented] (HDDS-293) Reduce memory usage in KeyData

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559787#comment-16559787 ] Anu Engineer commented on HDDS-293: --- +1, only thing that is not clear how much memory saving are we

[jira] [Commented] (HDDS-280) Support ozone dist-start-stitching on openbsd/osx

2018-07-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559784#comment-16559784 ] Allen Wittenauer commented on HDDS-280: --- bq. if and only if we need the version number in the name

[jira] [Commented] (HDDS-179) CloseContainer command should be executed only if all the prior "Write" type container requests get executed

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559786#comment-16559786 ] genericqa commented on HDDS-179: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-273) DeleteLog entries should be purged only after corresponding dns commit the transaction

2018-07-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559781#comment-16559781 ] Mukul Kumar Singh commented on HDDS-273: Thanks for working on this [~ljain]. 1)

[jira] [Commented] (HDDS-280) Support ozone dist-start-stitching on openbsd/osx

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559758#comment-16559758 ] Anu Engineer commented on HDDS-280: --- +1, on the VERSION file in the root approach. That is simpler and

[jira] [Commented] (HDDS-276) Fix symbolic link creation during Ozone dist process

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559756#comment-16559756 ] Anu Engineer commented on HDDS-276: --- [~aw] Thanks for pointing this issue out. Are you okay with perusing

[jira] [Updated] (HDFS-13772) Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled

2018-07-27 Thread Souryakanta Dwivedy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Souryakanta Dwivedy updated HDFS-13772: --- Environment: 3 Node SuSE Linux cluster  (was: 3 Node SuSE Linux cluster

[jira] [Updated] (HDFS-13772) Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled

2018-07-27 Thread Souryakanta Dwivedy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Souryakanta Dwivedy updated HDFS-13772: --- Attachment: EC_capture1.PNG > Erasure coding: Unnecessary NameNode Logs displaying

[jira] [Updated] (HDFS-13727) Log full stack trace if DiskBalancer exits with an unhandled exception

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13727: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.4

[jira] [Commented] (HDFS-13727) Log full stack trace if DiskBalancer exits with an unhandled exception

2018-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559745#comment-16559745 ] Hudson commented on HDFS-13727: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #14652 (See

[jira] [Updated] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-246: - Status: Patch Available (was: Open) > Datanode should throw BlockNotCommittedException

[jira] [Updated] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-246: - Attachment: HDDS-246.01.patch > Datanode should throw BlockNotCommittedException for

[jira] [Commented] (HDDS-246) Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client

2018-07-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559731#comment-16559731 ] Shashikant Banerjee commented on HDDS-246: -- patch is rebased to latest trunk. > Datanode should

[jira] [Updated] (HDDS-219) Genearate version-info.properties for hadoop and ozone

2018-07-27 Thread Sandeep Nemuri (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Nemuri updated HDDS-219: Status: In Progress (was: Patch Available) > Genearate version-info.properties for hadoop and ozone

[jira] [Commented] (HDDS-219) Genearate version-info.properties for hadoop and ozone

2018-07-27 Thread Sandeep Nemuri (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559725#comment-16559725 ] Sandeep Nemuri commented on HDDS-219: - [~anu], I will be updating the v2 patch soon.      > Genearate

[jira] [Commented] (HDFS-13727) Log full stack trace if DiskBalancer exits with an unhandled exception

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559724#comment-16559724 ] Anu Engineer commented on HDFS-13727: - +1, I will commit this shortly. > Log full stack trace if

[jira] [Comment Edited] (HDDS-219) Genearate version-info.properties for hadoop and ozone

2018-07-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559716#comment-16559716 ] Anu Engineer edited comment on HDDS-219 at 7/27/18 1:00 PM: bq. Anu Engineer:

[jira] [Commented] (HDFS-13769) Namenode gets stuck when deleting large dir in trash

2018-07-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559717#comment-16559717 ] genericqa commented on HDFS-13769: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >