[jira] [Commented] (HDFS-13369) FSCK Report broken with RequestHedgingProxyProvider

2022-10-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616774#comment-17616774 ] Sammi Chen commented on HDFS-13369: --- Cherry-picked from trunk to branch-3.3.5. > FSCK Report broken

[jira] [Updated] (HDFS-13369) FSCK Report broken with RequestHedgingProxyProvider

2022-10-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDFS-13369: -- Fix Version/s: 3.3.5 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-13369) FSCK Report broken with RequestHedgingProxyProvider

2022-10-09 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614866#comment-17614866 ] Sammi Chen commented on HDFS-13369: --- Hi @navinko, could you submit same PR for branch  2.8.0, 3.0.0,

[jira] [Assigned] (HDDS-2602) Add a property to enable/disable ONE replica pipeline auto creation in SCMPipelineManager

2019-11-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-2602: Assignee: Li Cheng > Add a property to enable/disable ONE replica pipeline auto creation in >

[jira] [Created] (HDDS-2602) Add a property to enable/disable ONE replica pipeline auto creation in SCMPipelineManager

2019-11-21 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2602: Summary: Add a property to enable/disable ONE replica pipeline auto creation in SCMPipelineManager Key: HDDS-2602 URL: https://issues.apache.org/jira/browse/HDDS-2602

[jira] [Created] (HDDS-2540) Fix accepetance test failure introduced by wait_for_safemode_exit

2019-11-18 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2540: Summary: Fix accepetance test failure introduced by wait_for_safemode_exit Key: HDDS-2540 URL: https://issues.apache.org/jira/browse/HDDS-2540 Project: Hadoop Distributed

[jira] [Resolved] (HDDS-2499) IsLeader information is lost when update pipeline state

2019-11-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-2499. -- Fix Version/s: 0.5.0 Resolution: Fixed > IsLeader information is lost when update pipeline state

[jira] [Created] (HDDS-2499) IsLeader information is lost when update pipeline state

2019-11-14 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2499: Summary: IsLeader information is lost when update pipeline state Key: HDDS-2499 URL: https://issues.apache.org/jira/browse/HDDS-2499 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-2249) SortDatanodes does not return correct orders when many DNs on a given host

2019-11-14 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974047#comment-16974047 ] Sammi Chen edited comment on HDDS-2249 at 11/14/19 8:47 AM: Thanks [~swagle]

[jira] [Commented] (HDDS-2249) SortDatanodes does not return correct orders when many DNs on a given host

2019-11-14 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974047#comment-16974047 ] Sammi Chen commented on HDDS-2249: -- Thanks [~swagle] for report this. One idea comes to my mind is how

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-11-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971357#comment-16971357 ] Sammi Chen commented on HDDS-2356: -- Hi [~bharat], thanks for helping fix the multi-upload issues. Li

[jira] [Updated] (HDDS-1576) Support configure more than one raft log storage to host multiple pipelines

2019-11-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1576: - Summary: Support configure more than one raft log storage to host multiple pipelines (was: Support

[jira] [Updated] (HDDS-1576) Support configure more than one raft log storage to host multiple pipeline

2019-11-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1576: - Description: Support configure multiple raft log storage to host multiple THREE factor RATIS pipelines.

[jira] [Updated] (HDDS-1576) Support configure more than one raft storage to host multiple pipeline

2019-11-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1576: - Description: Support configure multiple raft SCM should not try to create a raft group by placing the

[jira] [Updated] (HDDS-1576) Support configure more than one raft log storage to host multiple pipeline

2019-11-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1576: - Summary: Support configure more than one raft log storage to host multiple pipeline (was: Support

[jira] [Updated] (HDDS-1576) Support configure more than one raft storage to host multiple pipeline

2019-11-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1576: - Summary: Support configure more than one raft storage to host multiple pipeline (was: Ensure constraint

[jira] [Updated] (HDDS-1576) Ensure constraint of one raft log per disk is met unless fast media

2019-11-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1576: - Description: SCM should not try to create a raft group by placing the raft log on a disk that is already

[jira] [Assigned] (HDDS-1576) Ensure constraint of one raft log per disk is met unless fast media

2019-11-01 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1576: Assignee: Sammi Chen (was: Li Cheng) > Ensure constraint of one raft log per disk is met unless

[jira] [Resolved] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-11-01 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-2376. -- Resolution: Not A Bug > Fail to read data through XceiverClientGrpc >

[jira] [Comment Edited] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-11-01 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964661#comment-16964661 ] Sammi Chen edited comment on HDDS-2376 at 11/1/19 6:56 AM: --- The root cause is I

[jira] [Commented] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-11-01 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964661#comment-16964661 ] Sammi Chen commented on HDDS-2376: -- The root cause is I didn't retart Hadoop 2.7.5 after I deploied the

[jira] [Resolved] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-2363. -- Resolution: Fixed > Failed to create Ratis container > > >

[jira] [Updated] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Fix Version/s: 0.5.0 > Failed to create Ratis container > > >

[jira] [Updated] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Failed to create Ratis container (was: Fail to create Ratis container) > Failed to create

[jira] [Commented] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963727#comment-16963727 ] Sammi Chen commented on HDDS-2376: -- Hi [~msingh] and [~hanishakoneru], I don't find any WARN or ERROR

[jira] [Updated] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-10-29 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2376: - Description: Run teragen, application failed with following stack, 19/10/29 14:35:42 INFO

[jira] [Created] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-10-29 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2376: Summary: Fail to read data through XceiverClientGrpc Key: HDDS-2376 URL: https://issues.apache.org/jira/browse/HDDS-2376 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2363) Fail to create Ratis container

2019-10-29 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Priority: Blocker (was: Critical) > Fail to create Ratis container > -- > >

[jira] [Updated] (HDDS-2363) Fail to create Ratis container

2019-10-29 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Description: Error logs; 2019-10-29 10:24:59,553 [pool-7-thread-1] ERROR -

[jira] [Updated] (HDDS-2363) Fail to create Ratis container

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Fail to create Ratis container (was: Fail to create Ratis pipeline ) > Fail to create Ratis

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Description: Error logs; 2019-10-29 10:24:59,553 [pool-7-thread-1] ERROR -

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Priority: Critical (was: Major) > Fail to create Ratis pipeline > -- > >

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Fail to create Ratis pipeline (was: Improve datanode write failure log) > Fail to create

[jira] [Updated] (HDDS-2363) Fail to create Ratis pipeline

2019-10-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Issue Type: Bug (was: Improvement) > Fail to create Ratis pipeline > -- > >

[jira] [Updated] (HDDS-2363) Improve datanode write failure log

2019-10-24 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Description: Logs as following didn't reveal the true failure of write failure. 2019-10-24 17:43:53,460

[jira] [Created] (HDDS-2363) Improve datanode write failure log

2019-10-24 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2363: Summary: Improve datanode write failure log Key: HDDS-2363 URL: https://issues.apache.org/jira/browse/HDDS-2363 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Resolved] (HDDS-2307) ContextFactory.java contains Windows '^M" at end of each line

2019-10-23 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-2307. -- Resolution: Not A Problem > ContextFactory.java contains Windows '^M" at end of each line >

[jira] [Commented] (HDDS-2307) ContextFactory.java contains Windows '^M" at end of each line

2019-10-23 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958494#comment-16958494 ] Sammi Chen commented on HDDS-2307: -- Hi [~cxorm], thanks for the investigation. It's accutaully a Hadoop

[jira] [Created] (HDDS-2307) ContextFactory.java contains Windows '^M" at end of each line

2019-10-15 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2307: Summary: ContextFactory.java contains Windows '^M" at end of each line Key: HDDS-2307 URL: https://issues.apache.org/jira/browse/HDDS-2307 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-2177) Add a srubber thread to detect creation failure pipelines in ALLOCATED state

2019-09-25 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2177: Summary: Add a srubber thread to detect creation failure pipelines in ALLOCATED state Key: HDDS-2177 URL: https://issues.apache.org/jira/browse/HDDS-2177 Project: Hadoop

[jira] [Created] (HDDS-2176) Add new pipeline state “CLOSING” and new CLOSE_PIPELINE_STATUS command

2019-09-25 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2176: Summary: Add new pipeline state “CLOSING” and new CLOSE_PIPELINE_STATUS command Key: HDDS-2176 URL: https://issues.apache.org/jira/browse/HDDS-2176 Project: Hadoop

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

2019-09-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932361#comment-16932361 ] Sammi Chen commented on HDDS-1933: -- Hi [~msingh] , offer user the option to choose IpAddress or Hostname

[jira] [Updated] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-09-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2034: - Summary: Async RATIS pipeline creation and destroy through heartbeat commands (was: Async pipeline

[jira] [Updated] (HDDS-2034) Async pipeline creation and destroy through heartbeat commands

2019-09-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2034: - Description: Currently, pipeline creation and destroy are synchronous operations. SCM directly connect

[jira] [Assigned] (HDDS-2033) Support join multiple pipelines on datanode

2019-09-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-2033: Assignee: Sammi Chen > Support join multiple pipelines on datanode >

[jira] [Updated] (HDDS-2034) Async pipeline creation and destroy through heartbeat commands

2019-09-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2034: - Summary: Async pipeline creation and destroy through heartbeat commands (was: Add create pipeline

[jira] [Updated] (HDDS-2118) Datanode fail to start after stop

2019-09-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2118: - Description: Steps: 1. Run Teragen and generated a few GB data in a 4 datanodes cluster. 2. Stoped

[jira] [Updated] (HDDS-2118) Datanode fail to function after stop

2019-09-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2118: - Summary: Datanode fail to function after stop (was: Datanode fail to start after stop) > Datanode fail

[jira] [Created] (HDDS-2118) Datanode fail to start after stop

2019-09-12 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2118: Summary: Datanode fail to start after stop Key: HDDS-2118 URL: https://issues.apache.org/jira/browse/HDDS-2118 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Commented] (HDDS-2106) Avoid usage of hadoop projects as parent of hdds/ozone

2019-09-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928315#comment-16928315 ] Sammi Chen commented on HDDS-2106: -- Hi [~elek] , I meet build issue after trunk rebase. Following is the

[jira] [Assigned] (HDDS-2034) Add create pipeline command dispatcher and handle

2019-09-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-2034: Assignee: Sammi Chen > Add create pipeline command dispatcher and handle >

[jira] [Updated] (HDDS-2069) Default values of property hdds.datanode.storage.utilization.critical.threshold and hdds.datanode.storage.utilization.warning.threshold are not reasonable

2019-09-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2069: - Summary: Default values of property hdds.datanode.storage.utilization.critical.threshold and

[jira] [Created] (HDDS-2069) Value of property hdds.datanode.storage.utilization.critical.threshold and hdds.datanode.storage.utilization.warning.threshold is not reasonable

2019-09-02 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2069: Summary: Value of property hdds.datanode.storage.utilization.critical.threshold and hdds.datanode.storage.utilization.warning.threshold is not reasonable Key: HDDS-2069 URL:

[jira] [Commented] (HDDS-1553) Add metrics in rack aware container placement policy

2019-08-27 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917357#comment-16917357 ] Sammi Chen commented on HDDS-1553: -- Hi [~ljain], I just attched the initial patch. Feel free to give any

[jira] [Assigned] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

2019-08-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1571: Assignee: Sammi Chen (was: Siddharth Wagle) > Create an interface for pipeline placement policy

[jira] [Assigned] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-08-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1569: Assignee: Li Cheng (was: Siddharth Wagle) > Add ability to SCM for creating multiple pipelines

[jira] [Created] (HDDS-2036) Multi-raft support on single datanode integration test

2019-08-26 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2036: Summary: Multi-raft support on single datanode integration test Key: HDDS-2036 URL: https://issues.apache.org/jira/browse/HDDS-2036 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2035) Improve CLI listPipeline

2019-08-26 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2035: Summary: Improve CLI listPipeline Key: HDDS-2035 URL: https://issues.apache.org/jira/browse/HDDS-2035 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Updated] (HDDS-1574) ensure same datanodes are not a part of multiple pipelines

2019-08-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1574: - Summary: ensure same datanodes are not a part of multiple pipelines (was: Implement pipeline placement

[jira] [Created] (HDDS-2034) Add create pipeline command dispatcher and handle

2019-08-26 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2034: Summary: Add create pipeline command dispatcher and handle Key: HDDS-2034 URL: https://issues.apache.org/jira/browse/HDDS-2034 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-1574) Implement pipeline placement policy to ensure same datanodes are not a part of multiple pipelines

2019-08-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1574: - Summary: Implement pipeline placement policy to ensure same datanodes are not a part of multiple

[jira] [Updated] (HDDS-1574) Implement pipeline choose policy to ensure same datanodes are not a part of multiple pipelines

2019-08-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1574: - Summary: Implement pipeline choose policy to ensure same datanodes are not a part of multiple pipelines

[jira] [Created] (HDDS-2033) Support join multiple pipelines on datanode

2019-08-26 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2033: Summary: Support join multiple pipelines on datanode Key: HDDS-2033 URL: https://issues.apache.org/jira/browse/HDDS-2033 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-1930) Test Topology Aware Job scheduling with Ozone Topology

2019-08-25 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1930: - Description: My initial results with Terasort does not seem to report the counter properly. Most of the

[jira] [Created] (HDDS-2031) Choose datanode for pipeline creation based on network topology

2019-08-25 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2031: Summary: Choose datanode for pipeline creation based on network topology Key: HDDS-2031 URL: https://issues.apache.org/jira/browse/HDDS-2031 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-1963) OM DB Schema defintion in OmMetadataManagerImpl and OzoneConsts are not consistent

2019-08-14 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1963: Summary: OM DB Schema defintion in OmMetadataManagerImpl and OzoneConsts are not consistent Key: HDDS-1963 URL: https://issues.apache.org/jira/browse/HDDS-1963 Project:

[jira] [Assigned] (HDDS-1897) SCMNodeManager.java#getNodeByAddress cannot find nodes by addresses

2019-08-13 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1897: Assignee: Li Cheng > SCMNodeManager.java#getNodeByAddress cannot find nodes by addresses >

[jira] [Created] (HDDS-1958) Container time information returned by "scmcli list" is not human friendly

2019-08-13 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1958: Summary: Container time information returned by "scmcli list" is not human friendly Key: HDDS-1958 URL: https://issues.apache.org/jira/browse/HDDS-1958 Project: Hadoop

[jira] [Created] (HDDS-1953) Remove pipeline persistent in SCM

2019-08-11 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1953: Summary: Remove pipeline persistent in SCM Key: HDDS-1953 URL: https://issues.apache.org/jira/browse/HDDS-1953 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-1882) TestReplicationManager failed with NPE in ReplicationManager.java

2019-08-01 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1882: - Summary: TestReplicationManager failed with NPE in ReplicationManager.java (was: TestReplicationManager

[jira] [Created] (HDDS-1882) TestReplicationManager failed with NPE

2019-07-31 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1882: Summary: TestReplicationManager failed with NPE Key: HDDS-1882 URL: https://issues.apache.org/jira/browse/HDDS-1882 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-1879) Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-07-31 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1879: Summary: Support multiple excluded scopes when choosing datanodes in NetworkTopology Key: HDDS-1879 URL: https://issues.apache.org/jira/browse/HDDS-1879 Project: Hadoop

[jira] [Updated] (HDDS-1865) Use "ozone.network.topology.aware.read" to control both RPC client and server side logic

2019-07-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1865: - Summary: Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (was:

[jira] [Updated] (HDDS-1865) Use "dfs.network.topology.aware.read.enable" to control both clien…

2019-07-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1865: - Summary: Use "dfs.network.topology.aware.read.enable" to control both clien… (was: Use

[jira] [Updated] (HDDS-1865) Use "dfs.network.topology.aware.read.enable" to control both RPC client and server side logic

2019-07-29 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1865: - Summary: Use "dfs.network.topology.aware.read.enable" to control both RPC client and server side logic

[jira] [Updated] (HDDS-1865) Use "ozone.distance.aware.read.enable" to control both client and OM side distance aware read logic

2019-07-26 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1865: - Summary: Use "ozone.distance.aware.read.enable" to control both client and OM side distance aware read

[jira] [Updated] (HDDS-1865) Use "ozone.distance.aware.read.enable" to control both client side and OM side topology aware read logic

2019-07-26 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1865: - Summary: Use "ozone.distance.aware.read.enable" to control both client side and OM side topology aware

[jira] [Created] (HDDS-1865) Use "dfs.network.topology.aware.read.enable" to control both client side and OM side topology aware read logic

2019-07-25 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1865: Summary: Use "dfs.network.topology.aware.read.enable" to control both client side and OM side topology aware read logic Key: HDDS-1865 URL:

[jira] [Created] (HDDS-1864) Turn on topology aware read in TestFailureHandlingByClient

2019-07-25 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1864: Summary: Turn on topology aware read in TestFailureHandlingByClient Key: HDDS-1864 URL: https://issues.apache.org/jira/browse/HDDS-1864 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-1707) SCMContainerPlacementRackAware#chooseDatanodes throws not enough datanodes when all nodes(40) are up

2019-07-25 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893282#comment-16893282 ] Sammi Chen commented on HDDS-1707: -- Thanks [~msingh] for report his. It been fixed by code change in

[jira] [Resolved] (HDDS-1707) SCMContainerPlacementRackAware#chooseDatanodes throws not enough datanodes when all nodes(40) are up

2019-07-25 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-1707. -- Resolution: Fixed Assignee: Sammi Chen > SCMContainerPlacementRackAware#chooseDatanodes throws

[jira] [Resolved] (HDDS-1809) Ozone Read fails with StatusRunTimeExceptions after 2 datanode fail in Ratis pipeline

2019-07-25 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-1809. -- Resolution: Fixed > Ozone Read fails with StatusRunTimeExceptions after 2 datanode fail in Ratis >

[jira] [Updated] (HDDS-1855) TestStorageContainerManager#testScmProcessDatanodeHeartbeat is failing

2019-07-25 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1855: - Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Resolved] (HDDS-1751) replication of underReplicated container fails with SCMContainerPlacementRackAware policy

2019-07-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-1751. -- Resolution: Fixed > replication of underReplicated container fails with >

[jira] [Commented] (HDDS-1751) replication of underReplicated container fails with SCMContainerPlacementRackAware policy

2019-07-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890814#comment-16890814 ] Sammi Chen commented on HDDS-1751: -- Yes, it's fixed by HDDS-1713. I run "src/test/bin/start-chaos.sh"

[jira] [Assigned] (HDDS-1751) replication of underReplicated container fails with SCMContainerPlacementRackAware policy

2019-07-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1751: Assignee: Sammi Chen > replication of underReplicated container fails with >

[jira] [Commented] (HDDS-1809) Ozone Read fails with StatusRunTimeExceptions after 2 datanode fail in Ratis pipeline

2019-07-23 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890729#comment-16890729 ] Sammi Chen commented on HDDS-1809: -- Thanks [~shashikant] for report this issue. It has been fixed by the

[jira] [Updated] (HDDS-1653) Add option to "ozone scmcli printTopology" to order the output acccording to topology layer

2019-07-18 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1653: - Resolution: Fixed Fix Version/s: 0.5.0 Status: Resolved (was: Patch Available) > Add

[jira] [Commented] (HDDS-1787) NPE thrown while trying to find DN closest to client

2019-07-15 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885781#comment-16885781 ] Sammi Chen commented on HDDS-1787: -- Hi [~msingh], thanks for the instructions. I will try it locally. I

[jira] [Commented] (HDDS-1787) NPE thrown while trying to find DN closest to client

2019-07-15 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885202#comment-16885202 ] Sammi Chen commented on HDDS-1787: -- Hi [~swagle], I uploaded a patch. Could you help me to review it? >

[jira] [Comment Edited] (HDDS-1787) NPE thrown while trying to find DN closest to client

2019-07-15 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884825#comment-16884825 ] Sammi Chen edited comment on HDDS-1787 at 7/15/19 9:01 AM: --- Hi [~swagle], I

[jira] [Commented] (HDDS-1787) NPE thrown while trying to find DN closest to client

2019-07-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884825#comment-16884825 ] Sammi Chen commented on HDDS-1787: -- Hi [~swagle], I would like to know how to run the MiniOzoneChaos

[jira] [Updated] (HDDS-1553) Add metrics in rack aware container placement policy

2019-07-11 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1553: - Description: To collect following statistics, 1. total requested datanode count (A) 2. success allocated

[jira] [Updated] (HDDS-1553) Add metrics in rack aware container placement policy

2019-07-11 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1553: - Description: To collect following statistics, 1. total requested datanode count (A) 2. success allocated

[jira] [Created] (HDDS-1663) Add datanode to network topology cluster during node register

2019-06-09 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1663: Summary: Add datanode to network topology cluster during node register Key: HDDS-1663 URL: https://issues.apache.org/jira/browse/HDDS-1663 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-1662) Missing test resources of integrataion-test project in target directory after compile

2019-06-09 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-1662: - Issue Type: Sub-task (was: Bug) Parent: HDDS-698 > Missing test resources of integrataion-test

[jira] [Created] (HDDS-1662) Missing test resources of integrataion-test project in target directory after compile

2019-06-08 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1662: Summary: Missing test resources of integrataion-test project in target directory after compile Key: HDDS-1662 URL: https://issues.apache.org/jira/browse/HDDS-1662 Project:

[jira] [Assigned] (HDDS-1661) Consolidate hadoop-hdds and hadoop-ozone into hadoop-ozone-project

2019-06-08 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1661: Assignee: (was: Sammi Chen) > Consolidate hadoop-hdds and hadoop-ozone into

[jira] [Assigned] (HDDS-1661) Consolidate hadoop-hdds and hadoop-ozone into hadoop-ozone-project

2019-06-08 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-1661: Assignee: Sammi Chen (was: Bharat Viswanadham) > Consolidate hadoop-hdds and hadoop-ozone into

[jira] [Created] (HDDS-1653) Add option to "ozone scmcli printTopology" to order the output acccording to topology layer

2019-06-05 Thread Sammi Chen (JIRA)
Sammi Chen created HDDS-1653: Summary: Add option to "ozone scmcli printTopology" to order the output acccording to topology layer Key: HDDS-1653 URL: https://issues.apache.org/jira/browse/HDDS-1653

  1   2   3   >