[
https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma resolved HDFS-7877.
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.1.0
3.0.0-beta1
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11035:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.1.0
3.0.0-beta1
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.1.0
2.8.3
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Attachment: HDFS-12473-branch-2.patch
Compared to the patch for trunk, branch-2's version is slightly
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Attachment: HDFS-12473-6.patch
Thanks [~manojg]. Here is the new patch to address your comments, except for
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170944#comment-16170944
]
Ming Ma commented on HDFS-11035:
Thanks [~ctrezzo]. I will commit it to trunk, branch-3.0 and branch-2 by
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11035:
---
Attachment: HDFS-11035-2.patch
The new patch has added the new docs to site.xml and fixed couple nits. Thanks
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170746#comment-16170746
]
Ming Ma commented on HDFS-12473:
ah got it. So the assumption of "backward compatibility isn't an issue as
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Attachment: HDFS-12473-5.patch
>From discussion with [~zhz], 2.8.2 hasn't been released yet. Thus we don't
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169365#comment-16169365
]
Ming Ma edited comment on HDFS-11035 at 9/17/17 5:47 PM:
-
Here is the draft patch
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11035:
---
Attachment: HDFS-11035.patch
Here is the draft patch including one doc for upgrade domain and another one
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma reassigned HDFS-11035:
--
Assignee: Ming Ma
> Better documentation for maintenace mode and upgrade domain
>
[
https://issues.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11035:
---
Status: Patch Available (was: Open)
> Better documentation for maintenace mode and upgrade domain
>
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Attachment: HDFS-12473-4.patch
> Change hosts JSON file format
> -
>
>
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Attachment: HDFS-12473-2.patch
Thanks Manoj. Here is the updated patch to address your comments.
bq. What
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168521#comment-16168521
]
Ming Ma edited comment on HDFS-12473 at 9/15/17 9:09 PM:
-
Here is the draft patch.
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Issue Type: Sub-task (was: Bug)
Parent: HDFS-7877
> Change host JSON file format
>
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Assignee: Ming Ma
Status: Patch Available (was: Open)
> Change host JSON file format
>
[
https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12473:
---
Attachment: HDFS-12473.patch
Here is the draft patch.
> Change host JSON file format
>
Ming Ma created HDFS-12473:
--
Summary: Change host JSON file format
Key: HDFS-12473
URL: https://issues.apache.org/jira/browse/HDFS-12473
Project: Hadoop HDFS
Issue Type: Bug
Reporter:
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164158#comment-16164158
]
Ming Ma commented on HDFS-10702:
[~csun], the long checkpoint duration could cause the following issue:
*
[
https://issues.apache.org/jira/browse/HDFS-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122746#comment-16122746
]
Ming Ma commented on HDFS-12285:
Thanks [~shahrs87]. Yeah indeed related, although the exception and the
[
https://issues.apache.org/jira/browse/HDFS-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-12285:
---
Description:
RPC client layer provides functionality to detect ip address change:
{noformat}
Client.java
Ming Ma created HDFS-12285:
--
Summary: Better handling of namenode ip address change
Key: HDFS-12285
URL: https://issues.apache.org/jira/browse/HDFS-12285
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues-test.apache.org/jira/browse/HDFS-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090130#comment-16090130
]
Ming Ma commented on HDFS-11035:
Given these features are related to existing concepts such as
[
https://issues-test.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077367#comment-16077367
]
Ming Ma edited comment on HDFS-9388 at 8/8/17 1:06 AM:
---
Thanks [~manojg].
was
[
https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117482#comment-16117482
]
Ming Ma commented on HDFS-6939:
---
Yeah we can include this feature if it provides values. Couple questions:
*
[
https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077367#comment-16077367
]
Ming Ma commented on HDFS-9388:
---
1. Thanks [~manojg].
> Refactor decommission related code to support
[
https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070937#comment-16070937
]
Ming Ma commented on HDFS-9388:
---
Thanks [~manojg]. Looks good over all. Couple nits:
* Configuration keys
[
https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027081#comment-16027081
]
Ming Ma commented on HDFS-11446:
+1.
> TestMaintenanceState#testWithNNAndDNRestart fails intermittently
>
[
https://issues.apache.org/jira/browse/HDFS-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022321#comment-16022321
]
Ming Ma commented on HDFS-11790:
Thanks [~manojg] for reporting this. Hmm, the existing code should take
[
https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993607#comment-15993607
]
Ming Ma commented on HDFS-7541:
---
Sounds good. HDFS-9005, HDFS-9016 and HDFS-9922 have been committed to
[
https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-7541:
--
Fix Version/s: (was: 2.9.0)
2.8.2
> Upgrade Domains in HDFS
> ---
>
>
[
https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9922:
--
Resolution: Fixed
Fix Version/s: (was: 2.9.0)
2.8.2
Status: Resolved
[
https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9922:
--
Attachment: HDFS-9922.branch-2.8.001.patch
> Upgrade Domain placement policy status marks a good block in
[
https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9922:
--
Status: Patch Available (was: Reopened)
> Upgrade Domain placement policy status marks a good block in
[
https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma reopened HDFS-9922:
---
> Upgrade Domain placement policy status marks a good block in violation when
> there are decommissioned nodes
>
[
https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9016:
--
Resolution: Fixed
Fix Version/s: (was: 2.9.0)
2.8.2
Status: Resolved
[
https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9016:
--
Status: Patch Available (was: Reopened)
> Display upgrade domain information in fsck
>
[
https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9016:
--
Attachment: HDFS-9016.branch-2.8.001.patch
> Display upgrade domain information in fsck
>
[
https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma reopened HDFS-9016:
---
> Display upgrade domain information in fsck
> --
>
> Key:
[
https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9005:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: (was: 2.9.0)
2.8.2
[
https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9005:
--
Attachment: HDFS-9005.branch-2.8.001.patch
Per the discussion in the umbrella jira, we want to the feature to be
[
https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990559#comment-15990559
]
Ming Ma commented on HDFS-7541:
---
Sure I can backport HDFS-9005, HDFS-9016 and HDFS-9922 to 2.8. Which 2.8
[
https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979473#comment-15979473
]
Ming Ma commented on HDFS-9922:
---
Currently upgrade domain isn't considered available in 2.8 due to these
[
https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895823#comment-15895823
]
Ming Ma commented on HDFS-11446:
Thanks. Got the following compile error for branch-2 which uses java 7.
[
https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894786#comment-15894786
]
Ming Ma commented on HDFS-9388:
---
Or DatanodeAdminManager? DatanodeMaintenance seems good. DatanodeService and
[
https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894772#comment-15894772
]
Ming Ma commented on HDFS-11446:
Thanks [~linyiqun]. The patch looks good. Do you get compile issue when
[
https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11412:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha3
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891612#comment-15891612
]
Ming Ma commented on HDFS-11412:
+1. Committed to trunk. [~manojg], could you please provide another patch
[
https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11412:
---
Summary: Maintenance minimum replication config value allowable range
should be [0, DefaultReplication]
[
https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890705#comment-15890705
]
Ming Ma commented on HDFS-11412:
bq. this particular range can have adverse effects as it can force
[
https://issues.apache.org/jira/browse/HDFS-11411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11411:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha3
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869184#comment-15869184
]
Ming Ma commented on HDFS-9388:
---
[~manojg], most of the work has been done by other jiras. Some specific
[
https://issues.apache.org/jira/browse/HDFS-11411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869170#comment-15869170
]
Ming Ma commented on HDFS-11411:
Looks good. Nits:
* For {{testExpectedReplication}} case, should we move
[
https://issues.apache.org/jira/browse/HDFS-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11265:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha3
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869107#comment-15869107
]
Ming Ma commented on HDFS-11265:
Strictly speaking, live decommissioned nodes can serve read requests as
[
https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868977#comment-15868977
]
Ming Ma commented on HDFS-11412:
Thanks [~manojg].
* Regarding whether to use default replication factor
[
https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868948#comment-15868948
]
Ming Ma commented on HDFS-7877:
---
ok. Will follow up the discussion in HDFS-11412.
> Support maintenance
[
https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862549#comment-15862549
]
Ming Ma edited comment on HDFS-7877 at 2/11/17 10:23 PM:
-
Thanks [~manojg] and
[
https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862549#comment-15862549
]
Ming Ma commented on HDFS-7877:
---
Thanks [~manojg]. Good point. What you suggested makes sense. The reason we
[
https://issues.apache.org/jira/browse/HDFS-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11378:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha3
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-11378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843195#comment-15843195
]
Ming Ma commented on HDFS-11378:
The patch LGTM. Thanks [~manojg] for the useful test cases! We might want
[
https://issues.apache.org/jira/browse/HDFS-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-11296:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha3
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822666#comment-15822666
]
Ming Ma commented on HDFS-11296:
Thanks Manoj for the fix. Nit: Maybe use Time.now() instead?
>
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817119#comment-15817119
]
Ming Ma edited comment on HDFS-9391 at 1/11/17 4:23 AM:
Thanks [~manojg] for the
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9391:
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha2
2.9.0
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816464#comment-15816464
]
Ming Ma commented on HDFS-9391:
---
Thanks [~manojg]. It seems there is a typo in branch-2 patch
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813481#comment-15813481
]
Ming Ma commented on HDFS-9391:
---
+1. Manoj, given the patch doesn't apply directly to branch-2, can you
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812642#comment-15812642
]
Ming Ma commented on HDFS-9391:
---
Thanks Manoj. I just found something related to our discussion. For any
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804934#comment-15804934
]
Ming Ma commented on HDFS-9391:
---
Thanks. Sounds good.
> Update webUI/JMX to display maintenance state info
>
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803589#comment-15803589
]
Ming Ma commented on HDFS-9391:
---
Then for that specific case when
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803538#comment-15803538
]
Ming Ma edited comment on HDFS-9391 at 1/6/17 4:41 AM:
---
A given replica is only in
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803538#comment-15803538
]
Ming Ma commented on HDFS-9391:
---
A given replica is only in one state, either decommission or maintenance.
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800575#comment-15800575
]
Ming Ma commented on HDFS-9391:
---
Sure let us keep what you have in patch 02. Just to make sure, can you
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799905#comment-15799905
]
Ming Ma commented on HDFS-9391:
---
Good point. Actually it seems maintenanceOnlyReplicas is the same as
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15795843#comment-15795843
]
Ming Ma commented on HDFS-9391:
---
Thanks Manoj. Yep let us keep the existing property as Eddy mentioned.
* In
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756345#comment-15756345
]
Ming Ma commented on HDFS-9391:
---
Thanks [~manojg]. Some minor questions:
* {{.put("inMaintenance",
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756346#comment-15756346
]
Ming Ma commented on HDFS-9391:
---
Thanks [~manojg]. Some minor questions:
* {{.put("inMaintenance",
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9391:
--
Comment: was deleted
(was: Thanks [~manojg]. Some minor questions:
* {{.put("inMaintenance",
[
https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9391:
--
Attachment: Maintenance webUI.png
Thanks [~manojg]!
bq. Shouldn't the DecomNodes include only replicas for
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-10206:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.9.0
Status: Resolved (was:
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-10206:
---
Summary: Datanodes not sorted properly by distance when the reader isn't a
datanode (was: datanodes not
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-10206:
---
Summary: datanodes not sorted properly by distance if the reader isn't a
datanode (was: getBlockLocations
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727676#comment-15727676
]
Ming Ma commented on HDFS-10206:
Thanks [~nandakumar131]. The patch looks good. Given the patch doesn't
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-10206:
---
Status: Patch Available (was: Open)
> getBlockLocations might not sort datanodes properly by distance
>
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15718536#comment-15718536
]
Ming Ma commented on HDFS-10206:
ok. Maybe it isn't precise way to refer it. The "network path" comes from
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717543#comment-15717543
]
Ming Ma commented on HDFS-10206:
To clarify, "two nodes of the same network path" referred to two
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717370#comment-15717370
]
Ming Ma commented on HDFS-10206:
Thanks [~nandakumar131]! The patches look good overall. To make the
[
https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707537#comment-15707537
]
Ming Ma commented on HDFS-11096:
Thanks [~andrew.wang] [~ka...@cloudera.com] for bringing up this
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707535#comment-15707535
]
Ming Ma commented on HDFS-10206:
bq. Can you point out the variables which are to be made more generic?
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702984#comment-15702984
]
Ming Ma commented on HDFS-10206:
* NetworkTopology can be used by HDFS, YARN and MAPREDUCE. It is better
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692234#comment-15692234
]
Ming Ma commented on HDFS-10206:
Thanks [~nanda619] for the micro benchmark and the new patch.
* Any idea
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15679692#comment-15679692
]
Ming Ma commented on HDFS-10206:
bq. Any comments on using NetworkTopology.contains(node) to check and use
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674317#comment-15674317
]
Ming Ma commented on HDFS-10206:
bq. that is why getDistanceUsingNetworkLocation is called only when the
[
https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673058#comment-15673058
]
Ming Ma commented on HDFS-10206:
Thank [~nandakumar131]!
* When the conditions {{reader.equals(node) &
[
https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637336#comment-15637336
]
Ming Ma commented on HDFS-10702:
Thanks [~zhz] for the ping. Thanks [~clouderajiayi] [~mackrorysd] for the
[
https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9390:
--
Resolution: Fixed
Fix Version/s: 3.0.0-alpha2
2.9.0
Status: Resolved (was:
[
https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9390:
--
Attachment: HDFS-9390-branch-2.002.patch
Reload with the proper patch name for Jenkins to run.
> Block
[
https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-9390:
--
Attachment: (was: HDFS-9390-2-branch-2.patch)
> Block management for maintenance states
>
1 - 100 of 767 matches
Mail list logo
