[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245671#comment-17245671
]
Ryan Wu commented on HDFS-15660:
thanks for review [~linyiqun]
> StorageTypeProto is not compatiable
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Affects Version/s: 3.0.0
3.0.1
> StorageTypeProto is not compatiable between 3.x and
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: (was: HDFS-15660.003.patch)
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: HDFS-15660.003.patch
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242880#comment-17242880
]
Ryan Wu commented on HDFS-13831:
IMO you could make the loop faster to hold the lock for a short time.
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242051#comment-17242051
]
Ryan Wu commented on HDFS-13831:
[~gaofeng6] To make the
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: HDFS-15660.003.patch
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: (was: HDFS-15660.001.patch)
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241406#comment-17241406
]
Ryan Wu commented on HDFS-15660:
[~linyiqun] [~vinayakumarb] could you have a look for this? thx
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241405#comment-17241405
]
Ryan Wu commented on HDFS-15660:
In the offline cluster, the namenode version is 3.1.3 and the datanode
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: HDFS-15660.001.patch
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: (was: HDFS-15660.001.patch)
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: HDFS-15660.001.patch
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: (was: HDFS-15660.001.patch)
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238612#comment-17238612
]
Ryan Wu commented on HDFS-15660:
[~vinayakumarb] sorry for long time to reply. In our cluster, we fixed
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-15660:
---
Attachment: HDFS-15660.001.patch
> StorageTypeProto is not compatiable between 3.x and 2.6
>
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222077#comment-17222077
]
Ryan Wu commented on HDFS-15660:
{code:java}
// code placeholder
enum StorageTypeProto {
DISK = 1;
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222075#comment-17222075
]
Ryan Wu commented on HDFS-15660:
This happened when our cluster enabled heterogeneous storage. To run
[
https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu reassigned HDFS-15660:
--
Assignee: Ryan Wu
> StorageTypeProto is not compatiable between 3.x and 2.6
>
Ryan Wu created HDFS-15660:
--
Summary: StorageTypeProto is not compatiable between 3.x and 2.6
Key: HDFS-15660
URL: https://issues.apache.org/jira/browse/HDFS-15660
Project: Hadoop HDFS
Issue Type:
Ryan Wu created HDFS-15487:
--
Summary: ScriptBasedMapping lead 100% cpu utilization
Key: HDFS-15487
URL: https://issues.apache.org/jira/browse/HDFS-15487
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978976#comment-16978976
]
Ryan Wu commented on HDFS-14986:
Hi Aiphago, thanks for providing the patch that fix me too. I will
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-14986:
---
Description:
Running DU across lots of disks is very expensive . We applied the patch
HDFS-14313 to get
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-14986:
---
Description:
Running DU across lots of disks is very expensive . We applied the patch
HDFS-14313 to get
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-14986:
---
Description:
Running DU across lots of disks is very expensive . We applied the patch
HDFS-14313 to get
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973288#comment-16973288
]
Ryan Wu commented on HDFS-14986:
The DeepCopyReplica method gets FoldedTreeSet from ReplicaMap，at
the
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-14986:
---
Fix Version/s: 3.1.2
2.10.1
> ReplicaCachingGetSpaceUsed throws
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-14986:
---
Fix Version/s: (was: 2.10.1)
(was: 3.1.2)
> ReplicaCachingGetSpaceUsed throws
[
https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-14986:
---
Component/s: performance
datanode
> ReplicaCachingGetSpaceUsed throws
Ryan Wu created HDFS-14986:
--
Summary: ReplicaCachingGetSpaceUsed throws
ConcurrentModificationException
Key: HDFS-14986
URL: https://issues.apache.org/jira/browse/HDFS-14986
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606791#comment-16606791
]
Ryan Wu commented on HDFS-13884:
Thx [~linyiqun], I have adopted the advice and submmited the new patch.
[
https://issues.apache.org/jira/browse/HDFS-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13884:
---
Attachment: HDFS-13884.002.patch
> Improve the description of the setting dfs.image.compress
>
[
https://issues.apache.org/jira/browse/HDFS-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13884:
---
Attachment: HDFS-13884.001.patch
> Improve the description of the setting dfs.image.compress
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: HDFS-13831.004.patch
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: (was: HDFS-13831.004.patch)
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593148#comment-16593148
]
Ryan Wu commented on HDFS-13831:
Thanks [~xiaochen] and [~linyiqun]
I have updated the patch to adopt
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: HDFS-13831.004.patch
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590024#comment-16590024
]
Ryan Wu edited comment on HDFS-13831 at 8/23/18 10:15 AM:
--
Thx [~linyiqun]. I
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590024#comment-16590024
]
Ryan Wu edited comment on HDFS-13831 at 8/23/18 10:14 AM:
--
Thx [~linyiqun]. I
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590024#comment-16590024
]
Ryan Wu edited comment on HDFS-13831 at 8/23/18 10:13 AM:
--
Thx [~linyiqun]. I
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590024#comment-16590024
]
Ryan Wu commented on HDFS-13831:
Thx [~linyiqun]. I have updated the patch and add the error-checking
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: HDFS-13831.003.patch
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: HDFS-13831.002.patch
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: (was: HDFS-13831.002.patch)
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: HDFS-13831.002.patch
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Status: Patch Available (was: Open)
> Make block increment deletion number configurable
>
[
https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Wu updated HDFS-13831:
---
Attachment: HDFS-13831.001.patch
> Make block increment deletion number configurable
>
47 matches
Mail list logo
