[jira] [Created] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
Rakesh R created HDFS-13165: --- Summary: [SPS]: Collects successfully moved block details via IBR Key: HDFS-13165 URL: https://issues.apache.org/jira/browse/HDFS-13165 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-13165: --- Assignee: Rakesh R > [SPS]: Collects successfully moved block details via IBR >

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Status: Patch Available (was: Open) Attached initial patch to get early feedback. Appreciate review help.

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Attachment: HDFS-13165-HDFS-10285-00.patch > [SPS]: Collects successfully moved block details via IBR >

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368474#comment-16368474 ] genericqa commented on HDFS-6092: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Attachment: MAPREDUCE-7031.2.patch > DatanodeAdminManager Improvements >

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Attachment: (was: MAPREDUCE-7031.2.patch) > DatanodeAdminManager Improvements >

[jira] [Commented] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368807#comment-16368807 ] genericqa commented on HDFS-13078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368797#comment-16368797 ] Abhishek Sakhuja commented on HDFS-13139: - HDP default configuration had calculated non-HDFS

[jira] [Comment Edited] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368797#comment-16368797 ] Abhishek Sakhuja edited comment on HDFS-13139 at 2/19/18 5:32 AM: -- HDP

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: HDFS-13078-HDFS-7240.005.patch > Ozone: Update Ratis on Ozone to

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: (was: HDFS-13078-HDFS-7240.005.patch) > Ozone: Update Ratis on Ozone to

[jira] [Issue Comment Deleted] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Sakhuja updated HDFS-13139: Comment: was deleted (was: HDP default configuration had calculated non-HDFS reserved

[jira] [Resolved] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Sakhuja resolved HDFS-13139. - Resolution: Workaround HDP default configuration had calculated non-HDFS reserved storage

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13168: --- Description: {{ArrayDeque}} {quote}This class is likely to be faster than Stack when used as a

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13168: --- Environment: (was: {{ArrayDeque}} {quote}This class is likely to be faster than Stack when used

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-02-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368689#comment-16368689 ] Konstantin Shvachko commented on HDFS-12977: I agree try/finally look excessive. In order to

[jira] [Commented] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368762#comment-16368762 ] Tsz Wo Nicholas Sze commented on HDFS-12998: +1 the 003 patch looks good. > SnapshotDiff -

[jira] [Updated] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12998: --- Resolution: Fixed Fix Version/s: 3.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368622#comment-16368622 ] genericqa commented on HDFS-12998: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Description: Presently {{#getLiveDatanodeStorageReport()}} is fetched for every file and does the

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Description: Presently {{#getLiveDatanodeStorageReport()}} is fetched for every file and does the

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368648#comment-16368648 ] Rakesh R commented on HDFS-10285: - We have worked on the comments and following is quick update. 

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: HDFS-13078-HDFS-7240.005.patch > Ozone: Update Ratis on Ozone to

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13078: --- Hadoop Flags: Reviewed +1 the 005 patch looks good. Thanks, Mukul. > Ozone: Update

[jira] [Created] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-18 Thread Rakesh R (JIRA)
Rakesh R created HDFS-13166: --- Summary: [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls Key: HDFS-13166 URL:

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13168: --- Attachment: HDFS-13168.1.patch > XmlImageVisitor - Prefer Array over LinkedList >

[jira] [Created] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HDFS-13168: -- Summary: XmlImageVisitor - Prefer Array over LinkedList Key: HDFS-13168 URL: https://issues.apache.org/jira/browse/HDFS-13168 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13168: --- Status: Patch Available (was: Open) > XmlImageVisitor - Prefer Array over LinkedList >

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368648#comment-16368648 ] Rakesh R edited comment on HDFS-10285 at 2/18/18 7:37 PM: -- We have worked on the

[jira] [Commented] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368684#comment-16368684 ] genericqa commented on HDFS-13168: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368685#comment-16368685 ] Íñigo Goiri edited comment on HDFS-13168 at 2/18/18 10:02 PM: -- [~belugabehr],

[jira] [Commented] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368685#comment-16368685 ] Íñigo Goiri commented on HDFS-13168: [~belugabehr], do you have any approximate performance

[jira] [Commented] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368627#comment-16368627 ] Íñigo Goiri commented on HDFS-13167: Pending Yetus for [^HDFS-13167.1.patch], this looks good. The

[jira] [Commented] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368687#comment-16368687 ] genericqa commented on HDFS-13078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368778#comment-16368778 ] Hudson commented on HDFS-12998: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13680 (See

[jira] [Created] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HDFS-13167: -- Summary: DatanodeAdminManager Improvements Key: HDFS-13167 URL: https://issues.apache.org/jira/browse/HDFS-13167 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Attachment: HDFS-13167.1.patch > DatanodeAdminManager Improvements >

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Status: Patch Available (was: Open) > DatanodeAdminManager Improvements >

[jira] [Commented] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368688#comment-16368688 ] genericqa commented on HDFS-13167: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13078) Ozone: Ratis read fail because stream is closed before the reply is received

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368606#comment-16368606 ] Mukul Kumar Singh commented on HDFS-13078: -- I have uploaded the v4 patch which fixes this issue.

[jira] [Updated] (HDFS-13078) Ozone: Ratis read fail because stream is closed before the reply is received

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: HDFS-13078-HDFS-7240.004.patch > Ozone: Ratis read fail because stream is

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Summary: Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Summary: Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk

[jira] [Updated] (HDFS-13157) Do Not Remove Blocks Sequentially During Dec omission

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13157: --- Description: >From what I understand of [DataNode

[jira] [Updated] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13157: --- Summary: Do Not Remove Blocks Sequentially During Decommission (was: Do Not Remove Blocks

[jira] [Commented] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368526#comment-16368526 ] genericqa commented on HDFS-13165: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||