[jira] [Commented] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926462#comment-16926462 ] Hadoop QA commented on HDFS-14795: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309659=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309659 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-09-10 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-1571. Fix Version/s: 0.5.0 Resolution: Fixed > Create an interface for pipeline placement policy to

[jira] [Work logged] (HDDS-2107) Datanodes should retry forever to connect to SCM in an unsecure environment

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2107?focusedWorklogId=310275=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310275 ] ASF GitHub Bot logged work on HDDS-2107: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14843) Double Synchronization in BlockReportLeaseManager

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927225#comment-16927225 ] Hadoop QA commented on HDFS-14843: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14838) RBF: Display RPC (instead of HTTP) Port Number in RBF web UI

2019-09-10 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14838: -- Attachment: HDFS-14838.001.patch > RBF: Display RPC (instead of HTTP) Port Number in RBF web UI >

[jira] [Comment Edited] (HDFS-14838) RBF: Display RPC (instead of HTTP) Port Number in RBF web UI

2019-09-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927248#comment-16927248 ] Takanobu Asanuma edited comment on HDFS-14838 at 9/11/19 5:22 AM: -- +1

[jira] [Commented] (HDFS-14840) Use Java Conccurent Instead of Synchrnoization in BlockPoolTokenSecretManager

2019-09-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927264#comment-16927264 ] Akira Ajisaka commented on HDFS-14840: -- LGTM, +1 > Use Java Conccurent Instead of Synchrnoization

[jira] [Updated] (HDFS-14838) RBF: Display RPC (instead of HTTP) Port Number in RBF web UI

2019-09-10 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14838: -- Attachment: HDFS-14838-1.patch > RBF: Display RPC (instead of HTTP) Port Number in RBF web UI >

[jira] [Commented] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-09-10 Thread CR Hota (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927242#comment-16927242 ] CR Hota commented on HDFS-14609: [~zhangchen] Thanks for the ping and patch. After cancellation of

[jira] [Commented] (HDFS-14838) RBF: Display RPC (instead of HTTP) Port Number in RBF web UI

2019-09-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927248#comment-16927248 ] Takanobu Asanuma commented on HDFS-14838: - +1 for HDFS-14838-1.patch, pending Jenkins. > RBF:

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=310317=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310317 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927251#comment-16927251 ] Surendra Singh Lilhore commented on HDFS-14699: --- [~marvelrock], are you talking about 

[jira] [Comment Edited] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927253#comment-16927253 ] Surendra Singh Lilhore edited comment on HDFS-14768 at 9/11/19 4:56 AM:

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927253#comment-16927253 ] Surendra Singh Lilhore commented on HDFS-14768: --- Thanks [~gjhkael]. {quote}you need run the

[jira] [Commented] (HDDS-1868) Ozone pipelines should be marked as ready only after the leader election is complete

2019-09-10 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927259#comment-16927259 ] Siddharth Wagle commented on HDDS-1868: --- Do you think it makes sense to add a callback like

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309709=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309709 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309708=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309708 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-2034) Add create pipeline command dispatcher and handle

2019-09-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-2034: Assignee: Sammi Chen > Add create pipeline command dispatcher and handle >

[jira] [Updated] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14795: --- Attachment: HDFS-14795.007.patch > Add Throttler for writing block > ---

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926575#comment-16926575 ] Surendra Singh Lilhore commented on HDFS-14699: --- Thanks [~marvelrock]  for verification.

[jira] [Commented] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926653#comment-16926653 ] Hadoop QA commented on HDFS-14795: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926671#comment-16926671 ] Lisheng Sun commented on HDFS-14795: fixed checkstyle and uploaded the v008 patch. > Add Throttler

[jira] [Updated] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14795: --- Attachment: HDFS-14795.008.patch > Add Throttler for writing block > ---

[jira] [Commented] (HDFS-14373) EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926681#comment-16926681 ] Hadoop QA commented on HDFS-14373: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=310038=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310038 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Created] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2019-09-10 Thread David Mollitor (Jira)
David Mollitor created HDFS-14839: - Summary: Use Java Concurrent BlockingQueue instead of Internal BlockQueue Key: HDFS-14839 URL: https://issues.apache.org/jira/browse/HDFS-14839 Project: Hadoop

[jira] [Work logged] (HDDS-1786) Datanodes takeSnapshot should delete previously created snapshots

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1786?focusedWorklogId=310067=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310067 ] ASF GitHub Bot logged work on HDDS-1786: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14528) Failover from Active to Standby Failed

2019-09-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926881#comment-16926881 ] Ayush Saxena commented on HDFS-14528: - On a cursory view, the patch looks good. minor nit: correct

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310114=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310114 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1786) Datanodes takeSnapshot should delete previously created snapshots

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1786?focusedWorklogId=310059=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310059 ] ASF GitHub Bot logged work on HDDS-1786: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310099=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310099 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Created] (HDFS-14840) Use Java Conccurent Instead of Synchrnoization in BlockPoolTokenSecretManager

2019-09-10 Thread David Mollitor (Jira)
David Mollitor created HDFS-14840: - Summary: Use Java Conccurent Instead of Synchrnoization in BlockPoolTokenSecretManager Key: HDFS-14840 URL: https://issues.apache.org/jira/browse/HDFS-14840

[jira] [Work logged] (HDDS-1786) Datanodes takeSnapshot should delete previously created snapshots

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1786?focusedWorklogId=309973=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309973 ] ASF GitHub Bot logged work on HDDS-1786: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310012=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310012 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-14839: -- Status: Patch Available (was: Open) > Use Java Concurrent BlockingQueue instead of Internal

[jira] [Updated] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-14839: -- Attachment: HDFS-14839.1.patch > Use Java Concurrent BlockingQueue instead of Internal

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310112=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310112 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1982) Extend SCMNodeManager to support decommission and maintenance states

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1982?focusedWorklogId=310050=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310050 ] ASF GitHub Bot logged work on HDDS-1982: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310065=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310065 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310098=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310098 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14840) Use Java Conccurent Instead of Synchrnoization in BlockPoolTokenSecretManager

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-14840: -- Attachment: HDFS-14840.1.patch > Use Java Conccurent Instead of Synchrnoization in

[jira] [Updated] (HDFS-14840) Use Java Conccurent Instead of Synchrnoization in BlockPoolTokenSecretManager

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-14840: -- Status: Patch Available (was: Open) > Use Java Conccurent Instead of Synchrnoization in

[jira] [Commented] (HDFS-14495) RBF: Duplicate FederationRPCMetrics

2019-09-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926488#comment-16926488 ] Akira Ajisaka commented on HDFS-14495: -- This Jira is to remove @Metrics and @Metric annotation. I

[jira] [Work logged] (HDDS-2103) TestContainerReplication fails due to unhealthy container

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2103?focusedWorklogId=309692=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309692 ] ASF GitHub Bot logged work on HDDS-2103: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-13660) DistCp job fails when new data is appended in the file while the distCp copy job is running

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926519#comment-16926519 ] Hadoop QA commented on HDFS-13660: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13660) DistCp job fails when new data is appended in the file while the distCp copy job is running

2019-09-10 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13660: --- Status: Patch Available (was: Open) > DistCp job fails when new data is appended in

[jira] [Created] (HDFS-14838) Display RPC (instead of HTTP) Port Number in RBF web UI.

2019-09-10 Thread Xieming Li (Jira)
Xieming Li created HDFS-14838: - Summary: Display RPC (instead of HTTP) Port Number in RBF web UI. Key: HDFS-14838 URL: https://issues.apache.org/jira/browse/HDFS-14838 Project: Hadoop HDFS Issue

[jira] [Work logged] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?focusedWorklogId=309737=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309737 ] ASF GitHub Bot logged work on HDDS-1571: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-09-10 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926596#comment-16926596 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] Also following steps I am not very clear, could you

[jira] [Commented] (HDFS-14373) EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926537#comment-16926537 ] Surendra Singh Lilhore commented on HDFS-14373: --- Attached patch, pls review.. > EC :

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-09-10 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926597#comment-16926597 ] Zhao Yi Ming commented on HDFS-14699: - [~surendrasingh] Yes, I also look into the issue HDFS-14768

[jira] [Updated] (HDDS-2103) TestContainerReplication fails due to unhealthy container

2019-09-10 Thread Doroszlai, Attila (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doroszlai, Attila updated HDDS-2103: Status: Patch Available (was: In Progress) > TestContainerReplication fails due to

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309829=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309829 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14373) EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-14373: -- Status: Patch Available (was: Open) > EC : Decoding is failing when block

[jira] [Updated] (HDFS-14373) EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe

2019-09-10 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-14373: -- Attachment: HDFS-14373.001.patch > EC : Decoding is failing when block group

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-09-10 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926536#comment-16926536 ] Zhao Yi Ming commented on HDFS-14699: - [~marvelrock] Thanks for your testing and comments! Yes, it

[jira] [Comment Edited] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-09-10 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926506#comment-16926506 ] HuangTao edited comment on HDFS-14699 at 9/10/19 10:38 AM: --- I make a test, if

[jira] [Work logged] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?focusedWorklogId=309719=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309719 ] ASF GitHub Bot logged work on HDDS-1571: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?focusedWorklogId=309733=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309733 ] ASF GitHub Bot logged work on HDDS-1571: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?focusedWorklogId=309743=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309743 ] ASF GitHub Bot logged work on HDDS-1571: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?focusedWorklogId=309742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309742 ] ASF GitHub Bot logged work on HDDS-1571: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-09-10 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926590#comment-16926590 ] Zhao Yi Ming commented on HDFS-14768: - [~gjhkael] I applied your UT in my env and found the compile

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2019-09-10 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926629#comment-16926629 ] He Xiaoqiao commented on HDFS-10943: Thanks [~swingcong] for your pings, It is important observation.

[jira] [Commented] (HDDS-2097) Add TeraSort to acceptance test

2019-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926679#comment-16926679 ] Steve Loughran commented on HDDS-2097: -- OK, HADOOP-16058 is the patch you need; it is in the

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309664=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309664 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2097) Add TeraSort to acceptance test

2019-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926678#comment-16926678 ] Steve Loughran commented on HDDS-2097: -- The terasort stuff is there, though I did do some changes to

[jira] [Work logged] (HDDS-2044) Remove 'ozone' from the recon module names.

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2044?focusedWorklogId=309839=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309839 ] ASF GitHub Bot logged work on HDDS-2044: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2103) TestContainerReplication fails due to unhealthy container

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2103?focusedWorklogId=309672=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309672 ] ASF GitHub Bot logged work on HDDS-2103: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2032) Ozone client should retry writes in case of any ratis/stateMachine exceptions

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2032?focusedWorklogId=309683=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309683 ] ASF GitHub Bot logged work on HDDS-2032: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-09-10 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926506#comment-16926506 ] HuangTao commented on HDFS-14699: - I make a test, if we move "liveBlockIndices.add(blockIndex);" above to

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309693=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309693 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=309707=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309707 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14837) Review of Block.java

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926665#comment-16926665 ] David Mollitor commented on HDFS-14837: --- Yes. :)

[jira] [Work started] (HDDS-2107) Datanodes should retry forever to connect to SCM in an unsecure environment

2019-09-10 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-2107 started by Vivek Ratnavel Subramanian. > Datanodes should retry forever to connect to SCM in an

[jira] [Commented] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927099#comment-16927099 ] Hadoop QA commented on HDFS-14839: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14839) Use Java Concurrent BlockingQueue instead of Internal BlockQueue

2019-09-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927101#comment-16927101 ] Íñigo Goiri commented on HDFS-14839: Yetus does not look very happy. > Use Java Concurrent

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310172=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310172 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2007) Make ozone fs shell command work with OM HA service ids

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2007?focusedWorklogId=310173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310173 ] ASF GitHub Bot logged work on HDDS-2007: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14841) Remove Class-Level Synchronization in LocalReplica

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927138#comment-16927138 ] Hadoop QA commented on HDFS-14841: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14840) Use Java Conccurent Instead of Synchrnoization in BlockPoolTokenSecretManager

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927144#comment-16927144 ] Hadoop QA commented on HDFS-14840: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14842) ByteArrayManager Reduce Synchronization

2019-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927194#comment-16927194 ] Hadoop QA commented on HDFS-14842: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14795: --- Attachment: HDFS-14795.009.patch > Add Throttler for writing block > ---

[jira] [Updated] (HDFS-14795) Add Throttler for writing block

2019-09-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14795: --- Attachment: (was: HDFS-14795.009.patch) > Add Throttler for writing block >

[jira] [Created] (HDFS-14841) Remove Class-Level Synchronization in LocalReplica

2019-09-10 Thread David Mollitor (Jira)
David Mollitor created HDFS-14841: - Summary: Remove Class-Level Synchronization in LocalReplica Key: HDFS-14841 URL: https://issues.apache.org/jira/browse/HDFS-14841 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14841) Remove Class-Level Synchronization in LocalReplica

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-14841: -- Status: Patch Available (was: Open) > Remove Class-Level Synchronization in LocalReplica >

[jira] [Updated] (HDFS-14841) Remove Class-Level Synchronization in LocalReplica

2019-09-10 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HDFS-14841: -- Attachment: HDFS-14841.1.patch > Remove Class-Level Synchronization in LocalReplica >

[jira] [Work logged] (HDDS-2089) Add CLI createPipeline

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2089?focusedWorklogId=310155=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310155 ] ASF GitHub Bot logged work on HDDS-2089: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-09-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927089#comment-16927089 ] Íñigo Goiri commented on HDFS-14090: Right now, the test is doing a catch of the exception and then

[jira] [Commented] (HDFS-14838) RBF: Display RPC (instead of HTTP) Port Number in RBF web UI

2019-09-10 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927168#comment-16927168 ] Xieming Li commented on HDFS-14838: --- Hi, [~elgoiri], Thank you for the confirmation, I will submit a

[jira] [Work logged] (HDDS-2107) Datanodes should retry forever to connect to SCM in an unsecure environment

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2107?focusedWorklogId=310242=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310242 ] ASF GitHub Bot logged work on HDDS-2107: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2107) Datanodes should retry forever to connect to SCM in an unsecure environment

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2107?focusedWorklogId=310240=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310240 ] ASF GitHub Bot logged work on HDDS-2107: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-09-10 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927183#comment-16927183 ] HuangTao commented on HDFS-14768: - [~zhaoyim] you can change the

[jira] [Commented] (HDFS-14811) RBF: TestRouterRpc#testErasureCoding is flaky

2019-09-10 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927187#comment-16927187 ] Chen Zhang commented on HDFS-14811: --- [~ayushtkn] [~elgoiri], any comments? Thanks > RBF:

[jira] [Commented] (HDFS-14838) RBF: Display RPC (instead of HTTP) Port Number in RBF web UI

2019-09-10 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927195#comment-16927195 ] Xieming Li commented on HDFS-14838: --- [~tasanuma], Thank you for your review. I will rework on this

[jira] [Work started] (HDDS-2041) Don't depend on DFSUtil to check HTTP policy

2019-09-10 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-2041 started by Vivek Ratnavel Subramanian. > Don't depend on DFSUtil to check HTTP policy >

[jira] [Commented] (HDDS-2107) Datanodes should retry forever to connect to SCM in an unsecure environment

2019-09-10 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927049#comment-16927049 ] Vivek Ratnavel Subramanian commented on HDDS-2107: -- cc [~xyao] > Datanodes should retry

[jira] [Created] (HDDS-2107) Datanodes should retry forever to connect to SCM in an unsecure environment

2019-09-10 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-2107: Summary: Datanodes should retry forever to connect to SCM in an unsecure environment Key: HDDS-2107 URL: https://issues.apache.org/jira/browse/HDDS-2107

[jira] [Work logged] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1879?focusedWorklogId=310153=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310153 ] ASF GitHub Bot logged work on HDDS-1879: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14841) Remove Class-Level Synchronization in LocalReplica

2019-09-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927098#comment-16927098 ] Íñigo Goiri commented on HDFS-14841: Do you have any performance result or pointer? It makes sense

  1   2   >