[jira] [Commented] (HDDS-1637) Fix random test failure TestSCMContainerPlacementRackAware

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857209#comment-16857209 ] Sammi Chen commented on HDDS-1637: -- Thanks [~xyao] for the review and commit effort. > Fix random test

[jira] [Updated] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDFS-14356: -- Fix Version/s: 3.3.0 > Implement HDFS cache on SCM with native PMDK libs >

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856727#comment-16856727 ] Sammi Chen commented on HDFS-14356: --- Committed to trunk. > Implement HDFS cache on SCM with native

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856718#comment-16856718 ] Sammi Chen commented on HDFS-14356: --- +1. The latest patch looks good to me. Thanks [~PhiloHe] for

[jira] [Assigned] (HDDS-1553) Add metrics in rack aware container placement policy

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1553: Assignee: Sammi Chen > Add metrics in rack aware container placement policy >

[jira] [Assigned] (HDDS-1612) Add "scmcli printTopology" shell command to print datanode topology

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1612: Assignee: Sammi Chen > Add "scmcli printTopology" shell command to print datanode topology >

[jira] [Updated] (HDDS-1612) Add "scmcli printTopology" shell command to print datanode topology

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1612: - Summary: Add "scmcli printTopology" shell command to print datanode topology (was: Add shell command to

[jira] [Updated] (HDDS-1612) Add shell command to print topology

2019-06-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1612: - Description: Command "ozone scmcli printTopology". It will show nodes of all kinds of

[jira] [Commented] (HDDS-1637) Fix random test failure TestSCMContainerPlacementRackAware

2019-06-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855654#comment-16855654 ] Sammi Chen commented on HDDS-1637: -- [~xyao], thanks for report this. I upload a PR

[jira] [Commented] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-06-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855645#comment-16855645 ] Sammi Chen commented on HDDS-1490: -- 04.patch PR https://github.com/apache/hadoop/pull/903 > Support

[jira] [Updated] (HDDS-1552) RpcClient works with both Hadoop-3 and Hadoop-2

2019-06-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1552: - Summary: RpcClient works with both Hadoop-3 and Hadoop-2 (was: Provide RpcClient for Hadoop 2) >

[jira] [Comment Edited] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-06-03 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854611#comment-16854611 ] Sammi Chen edited comment on HDFS-14356 at 6/4/19 3:49 AM: --- [~PhiloHe], If I

[jira] [Assigned] (HDDS-1552) Provide RpcClient for Hadoop 2

2019-06-03 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1552: Assignee: Sammi Chen > Provide RpcClient for Hadoop 2 > -- > >

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-06-03 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854611#comment-16854611 ] Sammi Chen commented on HDFS-14356: --- [~PhiloHe], If I remembered correctly, pmem_map_file() API is to

[jira] [Updated] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-06-03 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Attachment: HDDS-1490.04.patch > Support configurable container placement policy through >

[jira] [Commented] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-05-30 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851663#comment-16851663 ] Sammi Chen commented on HDDS-1490: -- 03.patch, 1. fix check style 2. fix failed unit test > Support

[jira] [Updated] (HDDS-698) Support Topology Awareness for Ozone

2019-05-30 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-698: Attachment: (was: HDDS-1490.03.patch) > Support Topology Awareness for Ozone >

[jira] [Updated] (HDDS-698) Support Topology Awareness for Ozone

2019-05-30 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-698: Attachment: HDDS-1490.03.patch > Support Topology Awareness for Ozone >

[jira] [Updated] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-05-30 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Attachment: HDDS-1490.03.patch > Support configurable container placement policy through >

[jira] [Created] (HDDS-1612) Add shell command to print topology

2019-05-29 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1612: Summary: Add shell command to print topology Key: HDDS-1612 URL: https://issues.apache.org/jira/browse/HDDS-1612 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Comment Edited] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850757#comment-16850757 ] Sammi Chen edited comment on HDFS-14356 at 5/30/19 2:41 AM: Thanks [~PhiloHe]

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850757#comment-16850757 ] Sammi Chen commented on HDFS-14356: --- Thanks [~PhiloHe] for the update. A few comments, 1. typo "amd" in

[jira] [Updated] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Attachment: HDDS-1490.02.patch > Support configurable container placement policy through >

[jira] [Updated] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Attachment: (was: HDDS-1490.02.patch) > Support configurable container placement policy through >

[jira] [Comment Edited] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850551#comment-16850551 ] Sammi Chen edited comment on HDDS-1490 at 5/29/19 6:54 AM: --- 02.patch, change

[jira] [Updated] (HDDS-1490) Support configurable containerPlacement policy

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Description: Support system property "ozone.scm.container.placement.classname" in ozone-site.xml. User

[jira] [Updated] (HDDS-1490) Support configurable container placement policy through "ozone.scm.container.placement.classname"

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Summary: Support configurable container placement policy through

[jira] [Updated] (HDDS-1490) Support configurable container placement policy through ""

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Summary: Support configurable container placement policy through "" (was: Support configurable

[jira] [Commented] (HDDS-1490) Support configurable containerPlacement policy

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850551#comment-16850551 ] Sammi Chen commented on HDDS-1490: -- 02.patch, change list, 1. fix TestKeyManagerImpl failed issue. The

[jira] [Updated] (HDDS-1490) Support configurable containerPlacement policy

2019-05-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Attachment: HDDS-1490.02.patch > Support configurable containerPlacement policy >

[jira] [Updated] (HDDS-1490) Support configurable containerPlacement policy

2019-05-27 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Assignee: Sammi Chen Status: Patch Available (was: Open) > Support configurable containerPlacement

[jira] [Updated] (HDDS-1490) Support configurable containerPlacement policy

2019-05-27 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1490: - Attachment: HDDS-1490.01.patch > Support configurable containerPlacement policy >

[jira] [Comment Edited] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847188#comment-16847188 ] Sammi Chen edited comment on HDDS-700 at 5/24/19 2:27 AM: -- Thanks [~xyao] for

[jira] [Commented] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847188#comment-16847188 ] Sammi Chen commented on HDDS-700: - bq. Thanks [~xyao] for helping review and commit the patch.

[jira] [Comment Edited] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846721#comment-16846721 ] Sammi Chen edited comment on HDDS-700 at 5/23/19 1:39 PM: -- 03.patch, correct check

[jira] [Commented] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846721#comment-16846721 ] Sammi Chen commented on HDDS-700: - 03.patch, correct check styles. > Support rack awared node placement

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Attachment: HDDS-700.03.patch > Support rack awared node placement policy based on network topology >

[jira] [Commented] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-21 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844609#comment-16844609 ] Sammi Chen commented on HDDS-700: - 02.patch, here is the change list, 1. add logic to avoid infinite loop

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-21 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Attachment: HDDS-700.02.patch > Support rack awared node placement policy based on network topology >

[jira] [Comment Edited] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-20 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843742#comment-16843742 ] Sammi Chen edited comment on HDDS-700 at 5/20/19 8:11 AM: -- [~swagle], the short

[jira] [Commented] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-20 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843742#comment-16843742 ] Sammi Chen commented on HDDS-700: - [~swagle], the short answer is "separate NG". My initial target here is

[jira] [Created] (HDDS-1553) Add metrics in rack aware container placement policy

2019-05-17 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1553: Summary: Add metrics in rack aware container placement policy Key: HDDS-1553 URL: https://issues.apache.org/jira/browse/HDDS-1553 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842026#comment-16842026 ] Sammi Chen edited comment on HDDS-1525 at 5/17/19 9:26 AM: --- [~xyao], right, the

[jira] [Created] (HDDS-1552) Provide RpcClient for Hadoop 2

2019-05-17 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1552: Summary: Provide RpcClient for Hadoop 2 Key: HDDS-1552 URL: https://issues.apache.org/jira/browse/HDDS-1552 Project: Hadoop Distributed Data Store Issue Type: Task

[jira] [Comment Edited] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842026#comment-16842026 ] Sammi Chen edited comment on HDDS-1525 at 5/17/19 9:24 AM: --- [~xyao], right, the

[jira] [Commented] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842026#comment-16842026 ] Sammi Chen commented on HDDS-1525: -- [~xyao], right, the root cause is class KeyProviderTokenIssuer is

[jira] [Comment Edited] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842026#comment-16842026 ] Sammi Chen edited comment on HDDS-1525 at 5/17/19 9:11 AM: --- [~xyao], right, the

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-15 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1530: - Status: Patch Available (was: Open) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Commented] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839979#comment-16839979 ] Sammi Chen commented on HDDS-1525: -- [~elek], thanks for the information. I run the same test again after

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Status: Patch Available (was: Open) > Support rack awared node placement policy based on network topology >

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839937#comment-16839937 ] Sammi Chen commented on HDFS-14356: --- [~PhiloHe], I will review the new patch this week. Bye the way,

[jira] [Commented] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-13 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839049#comment-16839049 ] Sammi Chen commented on HDDS-700: - Thanks [~xyao] for the comments. bq. Line 353: if the caller does not

[jira] [Created] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-13 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1525: Summary: Mapreduce failure when using Hadoop 2.7.5 Key: HDDS-1525 URL: https://issues.apache.org/jira/browse/HDDS-1525 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-06 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Description: Implement a new container placement policy implementation based datanode's network topology. 

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-06 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Description: Implement a new container placement policy implementation based datanode's network topology. 

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-06 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Attachment: HDDS-700.01.patch > Support rack awared node placement policy based on network topology >

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-05 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Summary: Support rack awared node placement policy based on network topology (was: Support Node selection

[jira] [Created] (HDDS-1490) Support configurable containerPlacement policy

2019-05-05 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1490: Summary: Support configurable containerPlacement policy Key: HDDS-1490 URL: https://issues.apache.org/jira/browse/HDDS-1490 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-04-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824092#comment-16824092 ] Sammi Chen commented on HDFS-14356: --- Thanks [~PhiloHe] 's effort.  Some initial comments, 1.  Use

[jira] [Comment Edited] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-25 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800445#comment-16800445 ] Sammi Chen edited comment on HDFS-14355 at 3/25/19 7:21 AM: Thanks [~PhiloHe]

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-25 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800445#comment-16800445 ] Sammi Chen commented on HDFS-14355: --- Thanks [~PhiloHe] for working on it.  Several quick comments, 1.

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Fix Version/s: 0.5.0 > Detect Ozone Network topology > - > >

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Release Note: Support a flexible multi-level network topology implementation (was: Support a flexible

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Resolution: Fixed Release Note: Support a flexible multi-level network topology implementation.

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794857#comment-16794857 ] Sammi Chen commented on HDDS-699: - Yes, the test failures are not relative. I will commit the patch to

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.09.patch > Detect Ozone Network topology > - > >

[jira] [Comment Edited] (HDDS-699) Detect Ozone Network topology

2019-03-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793279#comment-16793279 ] Sammi Chen edited comment on HDDS-699 at 3/15/19 3:29 AM: -- Hi [~szetszwo], thanks

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793279#comment-16793279 ] Sammi Chen commented on HDDS-699: - Hi [~szetszwo], thanks very much for all your time to review the

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792372#comment-16792372 ] Sammi Chen commented on HDDS-699: - 08.patch fixed the issues reported by check style. > Detect Ozone

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.08.patch > Detect Ozone Network topology > - > >

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-13 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791774#comment-16791774 ] Sammi Chen commented on HDDS-699: - bq. In InnerNodeImpl.getNode(String loc), we should first check if loc

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-13 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.07.patch > Detect Ozone Network topology > - > >

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-12 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790752#comment-16790752 ] Sammi Chen commented on HDDS-699: - [~szetszwo], thanks for the further information. 06.patch addressed all

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-12 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.06.patch > Detect Ozone Network topology > - > >

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-07 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786885#comment-16786885 ] Sammi Chen commented on HDDS-699: - Thanks [~szetszwo] for such detail comments. Yes, getLeaf() in

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-06 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.05.patch > Detect Ozone Network topology > - > >

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-06 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785569#comment-16785569 ] Sammi Chen commented on HDDS-699: - 05.patch addressed the concerns [~szetszwo] raised so far, rebased

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.04.patch > Detect Ozone Network topology > - > >

[jira] [Comment Edited] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784040#comment-16784040 ] Sammi Chen edited comment on HDDS-699 at 3/5/19 4:14 AM: - Hi [~szetszwo], thanks

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784040#comment-16784040 ] Sammi Chen commented on HDDS-699: - Hi [~szetszwo], thanks for the time. 04.patch is uploaded to address

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.04.patch > Detect Ozone Network topology > - > >

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: (was: HDDS-699.04.patch) > Detect Ozone Network topology > - > >

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.03.patch > Detect Ozone Network topology > - > >

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-03-04 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783561#comment-16783561 ] Sammi Chen commented on HDDS-699: - Changes in 03. patch, # add Network Topology interface # use single

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-02-28 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780445#comment-16780445 ] Sammi Chen commented on HDDS-699: - Hi [~szetszwo], thanks for the comments. I think it's a trade off

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-02-20 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773040#comment-16773040 ] Sammi Chen commented on HDFS-13762: --- Thanks [~PhiloHe] for continue working on this.  Here are some

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-02-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771543#comment-16771543 ] Sammi Chen commented on HDDS-699: - Thanks [~szetszwo] and [~xyao] for the great suggestion. I uploaded 02

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-02-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.02.patch > Detect Ozone Network topology > - > >

[jira] [Comment Edited] (HDDS-699) Detect Ozone Network topology

2019-01-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753763#comment-16753763 ] Sammi Chen edited comment on HDDS-699 at 1/30/19 3:09 AM: -- Hi [~junjie], thanks

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-28 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754644#comment-16754644 ] Sammi Chen commented on HDDS-699: - Hi [~szetszwo], thanks for the comments.  For the NetworkTopology

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-28 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753814#comment-16753814 ] Sammi Chen commented on HDDS-699: - [~xyao], thanks for your time. {quote} Line 72: do we really want to

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-27 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753763#comment-16753763 ] Sammi Chen commented on HDDS-699: - Hi [~junjie], thanks for your review and feedbacks. {code:java} +

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-27 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753757#comment-16753757 ] Sammi Chen commented on HDDS-699: - Hi [~linyiqun]  thanks for the review effort.  {quote}Can we address

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-20 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747625#comment-16747625 ] Sammi Chen commented on HDDS-699: - Hi [~linyiqun], thanks for your good suggestion. Normally I will go with

[jira] [Comment Edited] (HDDS-699) Detect Ozone Network topology

2019-01-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744911#comment-16744911 ] Sammi Chen edited comment on HDDS-699 at 1/17/19 11:23 AM: --- Fix check style

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744911#comment-16744911 ] Sammi Chen commented on HDDS-699: - Fix check style issues and failed test > Detect Ozone Network topology

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-01-17 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.01.patch > Detect Ozone Network topology > - > >

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-01-16 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Attachment: HDDS-699.00.patch > Detect Ozone Network topology > - > >

[jira] [Commented] (HDDS-699) Detect Ozone Network topology

2019-01-16 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743952#comment-16743952 ] Sammi Chen commented on HDDS-699: - Separate patch for detect ozone network topology.  Multiple layer

[jira] [Updated] (HDDS-699) Detect Ozone Network topology

2019-01-16 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-699: Status: Patch Available (was: Open) > Detect Ozone Network topology > - > >

<    1   2   3   >