[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978812#comment-16978812
]
Bharat Viswanadham commented on HDDS-2356:
--
With HDDS-2477 PR, I was able to verify that MPU for
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976258#comment-16976258
]
Li Cheng commented on HDDS-2356:
I checked out [https://github.com/apache/hadoop-ozone/pull/163] and
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976256#comment-16976256
]
Bharat Viswanadham commented on HDDS-2356:
--
[~timmylicheng] And for testing with PR, have you
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976255#comment-16976255
]
Li Cheng commented on HDDS-2356:
[~bharat] Make sense. I failed to find Key:plc_1570869510243_5542 related
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976253#comment-16976253
]
Bharat Viswanadham commented on HDDS-2356:
--
Before my PR
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976237#comment-16976237
]
Li Cheng commented on HDDS-2356:
Tried [https://github.com/apache/hadoop-ozone/pull/163] to run. It did
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973836#comment-16973836
]
Bharat Viswanadham commented on HDDS-2356:
--
Hi [~timmylicheng]
Thanks for sharing the logs.
I
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973103#comment-16973103
]
Li Cheng commented on HDDS-2356:
[~bharat] I run the test again. And now see the error in audit log:
]} |
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972874#comment-16972874
]
Bharat Viswanadham commented on HDDS-2356:
--
Hi [~timmylicheng]
Thanks for sharing the logs.
I
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971357#comment-16971357
]
Sammi Chen commented on HDDS-2356:
--
Hi [~bharat], thanks for helping fix the multi-upload issues. Li
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971290#comment-16971290
]
Li Cheng commented on HDDS-2356:
[~bharat] In terms of the key in the last stacktrace:
2019-11-08
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971289#comment-16971289
]
Li Cheng commented on HDDS-2356:
[~bharat] As I said, debug logs for Goofys doesn't work since goofys
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970430#comment-16970430
]
Bharat Viswanadham commented on HDDS-2356:
--
Hi [~timmylicheng]
As every run, we are seeing the
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970119#comment-16970119
]
Li Cheng commented on HDDS-2356:
[~bharat] New error shows up using today's master branch.
2019-11-08
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969888#comment-16969888
]
Li Cheng commented on HDDS-2356:
[~bharat] Please check the attachment one more time. I re-upload the
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969847#comment-16969847
]
Bharat Viswanadham commented on HDDS-2356:
--
I think this error is not related to the
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968978#comment-16968978
]
Li Cheng commented on HDDS-2356:
[~bharat] My program won't abort, but I see some errors in s3g logs with
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968967#comment-16968967
]
Bharat Viswanadham commented on HDDS-2356:
--
HI [~timmylicheng]
When uploading part file, when no
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968957#comment-16968957
]
Li Cheng commented on HDDS-2356:
See new Multipart upload error in yesterday's master. [~bharat]
Check
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964586#comment-16964586
]
Bharat Viswanadham commented on HDDS-2356:
--
Has the above error caused crash in OM? If so, can
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554
]
Li Cheng commented on HDDS-2356:
Also see a core dump in rocksdb during last night's testing. Please check
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964482#comment-16964482
]
Bharat Viswanadham commented on HDDS-2356:
--
Opened HDDS-2359 to handle CompleteMPU error cases.
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964156#comment-16964156
]
Bharat Viswanadham commented on HDDS-2356:
--
{quote} What are you looking for in audit logs?
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964138#comment-16964138
]
Li Cheng commented on HDDS-2356:
[~msingh] I check OM audit log and it looks like this one:
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963991#comment-16963991
]
Mukul Kumar Singh commented on HDDS-2356:
-
Hi [~timmylicheng], the following error is a new issue.
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963875#comment-16963875
]
Li Cheng commented on HDDS-2356:
I tried multiprocessing in python to fetch data locally and write to
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963684#comment-16963684
]
Li Cheng commented on HDDS-2356:
[~bharat] I tried debug_s3 and debug_fuse in goofys, but I believe it
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962583#comment-16962583
]
Bharat Viswanadham commented on HDDS-2356:
--
# When uploaded 2 parts, and when complete upload 1
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962313#comment-16962313
]
Bharat Viswanadham commented on HDDS-2356:
--
Hi [~timmylicheng]
{quote}The long printing logs
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961607#comment-16961607
]
Li Cheng commented on HDDS-2356:
[~bharat] The long printing logs happen only in your branch tho. The full
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961604#comment-16961604
]
Li Cheng commented on HDDS-2356:
[~bharat] I'm using python to write to a OS path. sth like:
for sub_file
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961568#comment-16961568
]
Bharat Viswanadham commented on HDDS-2356:
--
[~bharat] In term of reproduction, I have a dataset
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961223#comment-16961223
]
Bharat Viswanadham commented on HDDS-2356:
--
{quote}Also it's print the same pipeline id in s3g
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960870#comment-16960870
]
Li Cheng commented on HDDS-2356:
I take this Jira to track issues that seem to be related with Multipart
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960866#comment-16960866
]
Li Cheng commented on HDDS-2356:
MISMATCH_MULTIPART_LIST seems to be a recurring error. Never be able to
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960799#comment-16960799
]
Li Cheng commented on HDDS-2356:
[~bharat] In term of reproduction, I have a dataset which includes small
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960796#comment-16960796
]
Li Cheng commented on HDDS-2356:
Also it's print the same pipeline id in s3g logs like crazy. Wonder if
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960747#comment-16960747
]
Bharat Viswanadham commented on HDDS-2356:
--
This occurs when uploaded parts map is not matching
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960744#comment-16960744
]
Li Cheng commented on HDDS-2356:
[~bharat] shows up another error. See the stack:
2019-10-28
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960192#comment-16960192
]
Bharat Viswanadham commented on HDDS-2356:
--
[~timmylicheng] Posted patch for HDDS-2322. I have
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959468#comment-16959468
]
Li Cheng commented on HDDS-2356:
[~bharat]Yea, you are right. It does happen randomly. Seeing it again.
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959419#comment-16959419
]
Bharat Viswanadham commented on HDDS-2356:
--
The above is an issue in OM, which might happen
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959407#comment-16959407
]
Li Cheng commented on HDDS-2356:
Quick update. I tried to make ozone have more handlers (like 10+ times
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959200#comment-16959200
]
Bharat Viswanadham commented on HDDS-2356:
--
The issue is right now entries added are mutable, For
[
https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959180#comment-16959180
]
Jitendra Nath Pandey commented on HDDS-2356:
This seems very similar to HDDS-2355.
>
45 matches
Mail list logo
