[jira] [Resolved] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-1894. Resolution: Fixed Fix Version/s: 0.4.1 Release Note: https://github.com/apache/hadoop/pull/1286

[jira] [Commented] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905725#comment-16905725 ] Li Cheng commented on HDDS-1894: [~xyao] [~Sammi] [~junjie] Please see PR 

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910966#comment-16910966 ] Li Cheng commented on HDDS-1933: [~msingh] I was trying to reproduce it thru UT. Tried using PowerMokito

[jira] [Comment Edited] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910966#comment-16910966 ] Li Cheng edited comment on HDDS-1933 at 8/20/19 8:58 AM: - [~msingh] I was trying

[jira] [Resolved] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-1894. Resolution: Fixed > Support listPipelines by filters in scmcli > --

[jira] [Reopened] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reopened HDDS-1894: Change Fix version > Support listPipelines by filters in scmcli > -- >

[jira] [Updated] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-1894: --- Fix Version/s: (was: 0.5.0) 0.4.1 > Support listPipelines by filters in scmcli >

[jira] [Commented] (HDDS-1897) SCMNodeManager.java#getNodeByAddress cannot find nodes by addresses

[ https://issues.apache.org/jira/browse/HDDS-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906112#comment-16906112 ] Li Cheng commented on HDDS-1897: Tried using start-chaos.sh under integration test to reproduce it. Run

[jira] [Updated] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

[ https://issues.apache.org/jira/browse/HDDS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2010: --- Description: With the intention to support multi-raft, I wanna bring up a question on how the pipeline

[jira] [Updated] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

[ https://issues.apache.org/jira/browse/HDDS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2010: --- Fix Version/s: 0.5.0 > PipelineID management for multi-raft, in SCM or in datanode? >

[jira] [Created] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

Li Cheng created HDDS-2010: -- Summary: PipelineID management for multi-raft, in SCM or in datanode? Key: HDDS-2010 URL: https://issues.apache.org/jira/browse/HDDS-2010 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

[ https://issues.apache.org/jira/browse/HDDS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2010: --- External issue ID: (was: 1564) > PipelineID management for multi-raft, in SCM or in datanode? >

[jira] [Updated] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

[ https://issues.apache.org/jira/browse/HDDS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2010: --- Target Version/s: (was: 0.5.0) > PipelineID management for multi-raft, in SCM or in datanode? >

[jira] [Updated] (HDDS-2010) PipelineID management for multi-raft, in SCM or in datanode?

[ https://issues.apache.org/jira/browse/HDDS-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2010: --- Issue Type: New Feature (was: Improvement) > PipelineID management for multi-raft, in SCM or in datanode? >

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916304#comment-16916304 ] Li Cheng commented on HDDS-1933:   [~msingh] [~elek] As I look around, this seems relevant in

[jira] [Assigned] (HDDS-1577) Add default pipeline placement policy implementation

[ https://issues.apache.org/jira/browse/HDDS-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1577: -- Assignee: Li Cheng (was: Siddharth Wagle) > Add default pipeline placement policy implementation >

[jira] [Assigned] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

[ https://issues.apache.org/jira/browse/HDDS-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1571: -- Assignee: Li Cheng (was: Sammi Chen) > Create an interface for pipeline placement policy to support

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915657#comment-16915657 ] Li Cheng commented on HDDS-1933: [~elek] Hey, could you try setting DFS_DATANODE_USE_DN_HOSTNAME_DEFAULT =

[jira] [Commented] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920753#comment-16920753 ] Li Cheng commented on HDDS-1569: -- 'Define soft and hard upper bounds for pipeline membership' Assuming

[jira] [Commented] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920809#comment-16920809 ] Li Cheng commented on HDDS-1569: [~swagle] > Add ability to SCM for creating multiple pipelines with same

[jira] [Comment Edited] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920809#comment-16920809 ] Li Cheng edited comment on HDDS-1569 at 9/2/19 12:02 PM: - [~swagle] One more

[jira] [Commented] (HDDS-1577) Add default pipeline placement policy implementation

[ https://issues.apache.org/jira/browse/HDDS-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920750#comment-16920750 ] Li Cheng commented on HDDS-1577: #PR/1366 considers topology and node heaviness in terms of engagement in

[jira] [Commented] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920787#comment-16920787 ] Li Cheng commented on HDDS-1569: [~xyao] [~Sammi] [~swagle] In terms of the 'SCMAllocationManager', do we

[jira] [Resolved] (HDDS-1577) Add default pipeline placement policy implementation

[ https://issues.apache.org/jira/browse/HDDS-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-1577. Fix Version/s: 0.5.0 Resolution: Fixed > Add default pipeline placement policy implementation >

[jira] [Assigned] (HDDS-2115) Add smoke/acceptance test for Pipeline related CLI

[ https://issues.apache.org/jira/browse/HDDS-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-2115: -- Assignee: Li Cheng > Add smoke/acceptance test for Pipeline related CLI >

[jira] [Commented] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928362#comment-16928362 ] Li Cheng commented on HDDS-1569: I separate SCMAllocationManager to another Jira 

[jira] [Created] (HDDS-2115) Add smoke/acceptance test for Pipeline related CLI

Li Cheng created HDDS-2115: -- Summary: Add smoke/acceptance test for Pipeline related CLI Key: HDDS-2115 URL: https://issues.apache.org/jira/browse/HDDS-2115 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2116) Create SCMAllocationManager as background thread for pipeline creation

Li Cheng created HDDS-2116: -- Summary: Create SCMAllocationManager as background thread for pipeline creation Key: HDDS-2116 URL: https://issues.apache.org/jira/browse/HDDS-2116 Project: Hadoop Distributed

[jira] [Resolved] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

[ https://issues.apache.org/jira/browse/HDDS-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-1571. Fix Version/s: 0.5.0 Resolution: Fixed > Create an interface for pipeline placement policy to

[jira] [Commented] (HDDS-2116) Create SCMAllocationManager as background thread for pipeline creation

[ https://issues.apache.org/jira/browse/HDDS-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931329#comment-16931329 ] Li Cheng commented on HDDS-2116: I agree on the multi-thread part. [~swagle] what else function do you

[jira] [Assigned] (HDDS-1564) Ozone multi-raft support

[ https://issues.apache.org/jira/browse/HDDS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1564: -- Assignee: Li Cheng (was: Siddharth Wagle) > Ozone multi-raft support > > >

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932172#comment-16932172 ] Li Cheng commented on HDDS-1933: [~swagle] I was talking with [~Sammi] about this. How do we decide

[jira] [Commented] (HDDS-2116) Create SCMPipelineAllocationManager as background thread for pipeline creation

[ https://issues.apache.org/jira/browse/HDDS-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932146#comment-16932146 ] Li Cheng commented on HDDS-2116: [~swagle] I think for now the role is taken by PipelinePlacementPolicy,

[jira] [Commented] (HDDS-1571) Create an interface for pipeline placement policy to support network topologies

[ https://issues.apache.org/jira/browse/HDDS-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923227#comment-16923227 ] Li Cheng commented on HDDS-1571: Put up a PlacementPolicy as basic interface and ScmCommonPlacementPolicy

[jira] [Created] (HDDS-2089) Add CLI createPipeline

Li Cheng created HDDS-2089: -- Summary: Add CLI createPipeline Key: HDDS-2089 URL: https://issues.apache.org/jira/browse/HDDS-2089 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Assigned] (HDDS-1574) Ensure same datanodes are not a part of multiple pipelines

[ https://issues.apache.org/jira/browse/HDDS-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1574: -- Assignee: Li Cheng (was: Siddharth Wagle) > Ensure same datanodes are not a part of multiple

[jira] [Assigned] (HDDS-1570) Refactor heartbeat reports to report all the pipelines that are open

[ https://issues.apache.org/jira/browse/HDDS-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1570: -- Assignee: Li Cheng (was: Siddharth Wagle) > Refactor heartbeat reports to report all the pipelines

[jira] [Commented] (HDDS-1933) Datanode should use hostname in place of ip addresses to allow DN's to work when ipaddress change

[ https://issues.apache.org/jira/browse/HDDS-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933136#comment-16933136 ] Li Cheng commented on HDDS-1933: After discussion, we suppose the change could remain as it is now. And

[jira] [Commented] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901767#comment-16901767 ] Li Cheng commented on HDDS-1894: [~junjie] Looking > Support listPipelines by filters in scmcli >

[jira] [Commented] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901789#comment-16901789 ] Li Cheng commented on HDDS-1894: [~xyao] Is it essentially just trying to do what "listPipelines | grep

[jira] [Commented] (HDDS-1894) Support listPipelines by filters in scmcli

[ https://issues.apache.org/jira/browse/HDDS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903633#comment-16903633 ] Li Cheng commented on HDDS-1894: [~xyao] Question: Do you see the command line be like ozone scmcli

[jira] [Created] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

Li Cheng created HDDS-2186: -- Summary: Fix tests using MiniOzoneCluster for its memory related exceptions Key: HDDS-2186 URL: https://issues.apache.org/jira/browse/HDDS-2186 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Affects Version/s: HDDS-1564 > Fix tests using MiniOzoneCluster for its memory related exceptions >

[jira] [Updated] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Labels: flaky-test (was: ) > Fix tests using MiniOzoneCluster for its memory related exceptions >

[jira] [Commented] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938670#comment-16938670 ] Li Cheng commented on HDDS-2186: Note that CI is also affected and it cannot print out the correct output

[jira] [Commented] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939296#comment-16939296 ] Li Cheng commented on HDDS-2186: [~ljain] After some investigation, it turned out MiniOzoneCluster is

[jira] [Issue Comment Deleted] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Comment: was deleted (was: https://github.com/apache/hadoop-ozone/pull/28) > Fix tests using

[jira] [Commented] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962740#comment-16962740 ] Li Cheng commented on HDDS-2186: The OOM issue resolved in https://github.com/apache/hadoop-ozone/pull/28.

[jira] [Resolved] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-2186. Fix Version/s: (was: 0.5.0) HDDS-1564 Target Version/s: HDDS-1564

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966372#comment-16966372 ] Li Cheng commented on HDDS-2396: [~bharat] Probably not up to date if HDDS 2379 is resolved in recent a

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971289#comment-16971289 ] Li Cheng edited comment on HDDS-2356 at 11/11/19 3:14 AM: -- [~bharat] As I said,

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971289#comment-16971289 ] Li Cheng commented on HDDS-2356: [~bharat] As I said, debug logs for Goofys doesn't work since goofys

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971290#comment-16971290 ] Li Cheng edited comment on HDDS-2356 at 11/11/19 7:21 AM: -- [~bharat] In terms of

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: om_audit_log_plc_1570863541668_9278.txt > Multipart upload report errors while writing to ozone

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971290#comment-16971290 ] Li Cheng commented on HDDS-2356: [~bharat] In terms of the key in the last stacktrace: 2019-11-08

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: 2019-11-06_18_13_57_422_ERROR > Multipart upload report errors while writing to ozone Ratis

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969888#comment-16969888 ] Li Cheng commented on HDDS-2356: [~bharat] Please check the attachment one more time. I re-upload the

[jira] [Commented] (HDDS-2443) Python client/interface for Ozone

[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969771#comment-16969771 ] Li Cheng commented on HDDS-2443: Prototyping with S3 gateway + boto3 now. Reads, Writes and Deletes can be

[jira] [Created] (HDDS-2443) Python client/interface for Ozone

Li Cheng created HDDS-2443: -- Summary: Python client/interface for Ozone Key: HDDS-2443 URL: https://issues.apache.org/jira/browse/HDDS-2443 Project: Hadoop Distributed Data Store Issue Type: New

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964138#comment-16964138 ] Li Cheng commented on HDDS-2356: [~msingh] I check OM audit log and it looks like this one:

[jira] [Commented] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964573#comment-16964573 ] Li Cheng commented on HDDS-2395: Also please note the exclude list issue.   2019-11-01 11:25:24,047

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554 ] Li Cheng edited comment on HDDS-2356 at 11/1/19 3:45 AM: - Also see a core dump in

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964578#comment-16964578 ] Li Cheng commented on HDDS-2396: Attached the entire log for the core dump. Will try to turn on ulimit and

[jira] [Created] (HDDS-2396) OM rocksdb core dump during writing

Li Cheng created HDDS-2396: -- Summary: OM rocksdb core dump during writing Key: HDDS-2396 URL: https://issues.apache.org/jira/browse/HDDS-2396 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Updated] (HDDS-2396) OM rocksdb core dump during writing

[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2396: --- Attachment: hs_err_pid9340.log > OM rocksdb core dump during writing > --- >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554 ] Li Cheng commented on HDDS-2356: Also see a core dump in rocksdb during last night's testing. Please check

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: hs_err_pid9340.log > Multipart upload report errors while writing to ozone Ratis pipeline >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963684#comment-16963684 ] Li Cheng commented on HDDS-2356: [~bharat] I tried debug_s3 and debug_fuse in goofys, but I believe it

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Description: Env: 4 VMs in total: 3 Datanodes on 3 VMs, 1 OM & 1 SCM on a separate VM, say it's VM0. I use

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Description: Env: 4 VMs in total: 3 Datanodes on 3 VMs, 1 OM & 1 SCM on a separate VM, say it's VM0. I use

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973103#comment-16973103 ] Li Cheng commented on HDDS-2356: [~bharat] I run the test again. And now see the error in audit log: ]} |

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: om-audit-VM_50_210_centos.log > Multipart upload report errors while writing to ozone Ratis

[jira] [Work started] (HDDS-2492) Fix test clean up issue in TestSCMPipelineManager

[ https://issues.apache.org/jira/browse/HDDS-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-2492 started by Li Cheng. -- > Fix test clean up issue in TestSCMPipelineManager >

[jira] [Commented] (HDDS-2492) Fix test clean up issue in TestSCMPipelineManager

[ https://issues.apache.org/jira/browse/HDDS-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974837#comment-16974837 ] Li Cheng commented on HDDS-2492: [https://github.com/apache/hadoop-ozone/pull/179] > Fix test clean up

[jira] [Resolved] (HDDS-2492) Fix test clean up issue in TestSCMPipelineManager

[ https://issues.apache.org/jira/browse/HDDS-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-2492. Fix Version/s: 0.4.1 Resolution: Fixed > Fix test clean up issue in TestSCMPipelineManager >

[jira] [Assigned] (HDDS-1573) Add scrubber metrics and pipeline metrics

[ https://issues.apache.org/jira/browse/HDDS-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1573: -- Assignee: Li Cheng > Add scrubber metrics and pipeline metrics >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976255#comment-16976255 ] Li Cheng commented on HDDS-2356: [~bharat] Make sense. I failed to find Key:plc_1570869510243_5542 related

[jira] [Resolved] (HDDS-2396) OM rocksdb core dump during writing

[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-2396. Assignee: Li Cheng Resolution: Fixed > OM rocksdb core dump during writing >

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976315#comment-16976315 ] Li Cheng commented on HDDS-2396: This is resolved in [https://github.com/apache/hadoop-ozone/pull/100]/.

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976237#comment-16976237 ] Li Cheng commented on HDDS-2356: Tried [https://github.com/apache/hadoop-ozone/pull/163] to run. It did

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976258#comment-16976258 ] Li Cheng commented on HDDS-2356: I checked out [https://github.com/apache/hadoop-ozone/pull/163] and

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: 2018-11-15-OM-logs.txt > Multipart upload report errors while writing to ozone Ratis pipeline >

[jira] [Assigned] (HDDS-1572) Implement a Pipeline scrubber to maintain healthy number of pipelines in a cluster

[ https://issues.apache.org/jira/browse/HDDS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reassigned HDDS-1572: -- Assignee: Li Cheng > Implement a Pipeline scrubber to maintain healthy number of pipelines in a >

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Description: Env: 4 VMs in total: 3 Datanodes on 3 VMs, 1 OM & 1 SCM on a separate VM, say it's VM0. I use

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Description: Env: 4 VMs in total: 3 Datanodes on 3 VMs, 1 OM & 1 SCM on a separate VM, say it's VM0. I use

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968957#comment-16968957 ] Li Cheng commented on HDDS-2356: See new Multipart upload error in yesterday's master. [~bharat] Check

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968978#comment-16968978 ] Li Cheng commented on HDDS-2356: [~bharat] My program won't abort, but I see some errors in s3g logs with

[jira] [Updated] (HDDS-2443) Python client/interface for Ozone

[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2443: --- Attachment: (was: OzoneS3.py) > Python client/interface for Ozone > - > >

[jira] [Updated] (HDDS-2443) Python client/interface for Ozone

[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2443: --- Attachment: OzoneS3.py > Python client/interface for Ozone > - > >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970119#comment-16970119 ] Li Cheng commented on HDDS-2356: [~bharat] New error shows up using today's master branch.   2019-11-08

[jira] [Updated] (HDDS-2443) Python client/interface for Ozone

[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2443: --- Attachment: OzoneS3.py > Python client/interface for Ozone > - > >

[jira] [Commented] (HDDS-2443) Python client/interface for Ozone

[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969974#comment-16969974 ] Li Cheng commented on HDDS-2443: [~elek] That would be great! I've uploaded my naive version of interface.

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960744#comment-16960744 ] Li Cheng commented on HDDS-2356: [~bharat] shows up another error. See the stack:   2019-10-28

[jira] [Commented] (HDDS-2322) DoubleBuffer flush termination and OM shutdown's after that.

[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960802#comment-16960802 ] Li Cheng commented on HDDS-2322: https://issues.apache.org/jira/browse/HDDS-2356 is still having issues.

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960866#comment-16960866 ] Li Cheng commented on HDDS-2356: MISMATCH_MULTIPART_LIST seems to be a recurring error. Never be able to

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960799#comment-16960799 ] Li Cheng commented on HDDS-2356: [~bharat] In term of reproduction, I have a dataset which includes small

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960796#comment-16960796 ] Li Cheng commented on HDDS-2356: Also it's print the same pipeline id in s3g logs like crazy. Wonder if

[jira] [Reopened] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng reopened HDDS-2356: Assignee: (was: Bharat Viswanadham) > Multipart upload report errors while writing to ozone Ratis

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960870#comment-16960870 ] Li Cheng commented on HDDS-2356: I take this Jira to track issues that seem to be related with Multipart

[jira] [Commented] (HDDS-1574) Ensure same datanodes are not a part of multiple pipelines

[ https://issues.apache.org/jira/browse/HDDS-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955811#comment-16955811 ] Li Cheng commented on HDDS-1574: [~swagle] Cloud you elaborate more to help understand this task? Do you

  1   2   >