[
https://issues.apache.org/jira/browse/HDFS-14678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910767#comment-16910767
]
Leon Gao commented on HDFS-14678:
-
Yes we need this in branch 2, I will create another PR for this.
>
[
https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938308#comment-16938308
]
Leon Gao commented on HDFS-10648:
-
Thanks [~zhangchen], Looking forward to it!
> Expose Balancer metrics
[
https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938151#comment-16938151
]
Leon Gao commented on HDFS-10648:
-
[~zhangchen] Just check-in if you are actively working on this?
It is
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964598#comment-16964598
]
Leon Gao commented on HDFS-14927:
-
Thanks [~inigoiri] and [~ayushtkn] for the review ^
> RBF: Add
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.009.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.008.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997664#comment-16997664
]
Leon Gao commented on HDFS-10648:
-
[~zhangchen] Just follow up a bit if you are still working on it,
[
https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14894:
Attachment: HDFS-14894.001.patch
Status: Patch Available (was: In Progress)
> Add balancer
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959320#comment-16959320
]
Leon Gao commented on HDFS-14927:
-
Submitting patch and update the ticket name.. As executorService is
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959321#comment-16959321
]
Leon Gao commented on HDFS-14927:
-
Example metrics:
"AsyncCallerServiceThreadPool" :
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.001.patch
Status: Patch Available (was: Reopened)
> RBF: Add metrics for
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959331#comment-16959331
]
Leon Gao commented on HDFS-14927:
-
[~elgoiri] Please let me know the change makes sense to you, then I
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Summary: RBF: Add metrics for async callers thread pool (was: RBF: Add
metrics for active RPC client
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Description: It is good to add some monitoring on the async caller thread
pool to handle fan-out RPC
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961476#comment-16961476
]
Leon Gao commented on HDFS-14927:
-
Fix checkstyle ^
[~elgoiri] I think the failure is unrelated (the
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.003.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.004.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.005.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962309#comment-16962309
]
Leon Gao commented on HDFS-14927:
-
[~inigoiri] Thanks for the review
Resolved 1) and 2) in your comments
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962568#comment-16962568
]
Leon Gao commented on HDFS-14927:
-
Got it [~inigoiri], I was hesitating for that as well ^
Updated
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.007.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.006.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962488#comment-16962488
]
Leon Gao commented on HDFS-14927:
-
Ah I got your question.
How it works is that
Leon Gao created HDFS-14927:
---
Summary: RBF: Add metrics for active RPC client threads
Key: HDFS-14927
URL: https://issues.apache.org/jira/browse/HDFS-14927
Project: Hadoop HDFS
Issue Type:
Leon Gao created HDFS-14926:
---
Summary: RBF: Add metrics for active RPC client threads
Key: HDFS-14926
URL: https://issues.apache.org/jira/browse/HDFS-14926
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958303#comment-16958303
]
Leon Gao commented on HDFS-14927:
-
Ah thanks for the pointer! Found it [~elgoiri]
> RBF: Add metrics for
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao resolved HDFS-14927.
-
Resolution: Invalid
> RBF: Add metrics for active RPC client threads
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958411#comment-16958411
]
Leon Gao commented on HDFS-14927:
-
[~inigoiri] Sry just looking more carefully,
I was searching for some
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao reopened HDFS-14927:
-
Reopen to gather more info
> RBF: Add metrics for active RPC client threads
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Summary: RBF: Add metrics for active RPC client threads for async calls
(was: RBF: Add metrics for active
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Description: It is good to add some monitoring on the active RPC client
threads to handle fan-out RPC
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14927:
Attachment: HDFS-14927.002.patch
> RBF: Add metrics for async callers thread pool
>
[
https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960221#comment-16960221
]
Leon Gao commented on HDFS-14927:
-
Add UT and update function name to getAsyncCallerPool
> RBF: Add
Leon Gao created HDFS-14894:
---
Summary: Add balancer parameter to balance top N used nodes
Key: HDFS-14894
URL: https://issues.apache.org/jira/browse/HDFS-14894
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14894:
Description:
We sometimes see a few of our datanodes reach very high usage (due to various
reasons) and
[
https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948214#comment-16948214
]
Leon Gao commented on HDFS-14894:
-
[~kihwal] Good idea. This ticket is to put a convenient option to
[
https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949836#comment-16949836
]
Leon Gao commented on HDFS-14894:
-
Hi [~kihwal] , Could you take a look at the PR and let me know any
[
https://issues.apache.org/jira/browse/HDFS-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14904:
Description: In each iteration, balancer should pick nodes with the
highest/lowest usage first, as
Leon Gao created HDFS-14904:
---
Summary: Balancer should pick nodes based on utilization in each
iteration
Key: HDFS-14904
URL: https://issues.apache.org/jira/browse/HDFS-14904
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949836#comment-16949836
]
Leon Gao edited comment on HDFS-14894 at 10/12/19 1:46 AM:
---
Hi [~kihwal]
[
https://issues.apache.org/jira/browse/HDFS-14894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-14894 started by Leon Gao.
---
> Add balancer parameter to balance top used nodes
>
[
https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao reassigned HDFS-10648:
---
Assignee: Leon Gao (was: Chen Zhang)
> Expose Balancer metrics through Metrics2
>
[
https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022634#comment-17022634
]
Leon Gao commented on HDFS-10648:
-
I got some time to work on this for our cluster with `-asService`
[
https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194120#comment-17194120
]
Leon Gao commented on HDFS-15456:
-
Hi [~ayushtkn] This one almost fails consistently on my laptop : )
I
[
https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao reassigned HDFS-15456:
---
Assignee: Leon Gao
> TestExternalStoragePolicySatisfier fails intermittently
>
[
https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193079#comment-17193079
]
Leon Gao commented on HDFS-15548:
-
Yes, I think the common use case will be between DISK and ARCHIVE, as
[
https://issues.apache.org/jira/browse/HDFS-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192644#comment-17192644
]
Leon Gao commented on HDFS-15549:
-
[~jianghuazhu] I think this will depend on the implementation of
[
https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192643#comment-17192643
]
Leon Gao commented on HDFS-15548:
-
Thanks for checking in! I have created a PR. Please take a look and
[
https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214300#comment-17214300
]
Leon Gao commented on HDFS-15548:
-
[~vinayakumarb] [~ayushtkn] [~weichiu] Could you please take a second
[
https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212122#comment-17212122
]
Leon Gao commented on HDFS-15456:
-
Thanks [~ayushtkn] for the review! Yeah I can give a try on those when
Leon Gao created HDFS-15547:
---
Summary: Dynamic disk-level tiering
Key: HDFS-15547
URL: https://issues.apache.org/jira/browse/HDFS-15547
Project: Hadoop HDFS
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/HDFS-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15547:
Attachment: Proposal - Dynamic disk-level tiering.pdf
> Dynamic disk-level tiering
>
[
https://issues.apache.org/jira/browse/HDFS-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186860#comment-17186860
]
Leon Gao commented on HDFS-15547:
-
[~sureshms] [~weichiu] [~sunchao] This is the new use case of archival
Leon Gao created HDFS-15549:
---
Summary: Improve DISK/ARCHIVE movement if they are on same
filesystem
Key: HDFS-15549
URL: https://issues.apache.org/jira/browse/HDFS-15549
Project: Hadoop HDFS
Leon Gao created HDFS-15548:
---
Summary: Allow configuring DISK/ARCHIVE storage types on same
device mount
Key: HDFS-15548
URL: https://issues.apache.org/jira/browse/HDFS-15548
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199685#comment-17199685
]
Leon Gao commented on HDFS-15456:
-
Hi [~ayushtkn] , Any other thoughts on this?
>
[
https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199808#comment-17199808
]
Leon Gao commented on HDFS-15456:
-
[~ayushtkn] Yeah it fails in almost all of the recent PRs:
[
https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197299#comment-17197299
]
Leon Gao commented on HDFS-15548:
-
Hi, [~csun] [~weichiu] [~hexiaoqiao] Would you please take a look that
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170330#comment-17170330
]
Leon Gao commented on HDFS-15509:
-
Ah, thanks for the pointer [~ayushtkn]! Didn't notice that ticket.
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172046#comment-17172046
]
Leon Gao commented on HDFS-15509:
-
[~ayushtkn] Yeah, I agree on the point that to make both NNs
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172046#comment-17172046
]
Leon Gao edited comment on HDFS-15509 at 8/6/20, 5:57 AM:
--
[~ayushtkn] Yeah, I
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172046#comment-17172046
]
Leon Gao edited comment on HDFS-15509 at 8/6/20, 5:58 AM:
--
[~ayushtkn] Yeah, I
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173720#comment-17173720
]
Leon Gao commented on HDFS-15509:
-
Ah no problem : ) this is not a big deal. Just encountered this during
Leon Gao created HDFS-15509:
---
Summary: Set safemode should not fail if one of the namenode is
down.
Key: HDFS-15509
URL: https://issues.apache.org/jira/browse/HDFS-15509
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: HDFS-15509.patch
Status: Patch Available (was: Open)
> Set safemode should not fail
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169738#comment-17169738
]
Leon Gao commented on HDFS-15509:
-
Attach a small fix
> Set safemode should not fail if one of the
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: (was: HDFS-15509.patch)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Status: Open (was: Patch Available)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: HDFS-15509.patch
Status: Patch Available (was: Open)
> Set safemode should not fail
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Status: Open (was: Patch Available)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: (was: HDFS-15509.patch)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Status: Open (was: Patch Available)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: HDFS-15509.patch
Status: Patch Available (was: Open)
> Set safemode should not fail
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Status: Open (was: Patch Available)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: (was: HDFS-15509.patch)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: HDFS-15509.patch
Status: Patch Available (was: Open)
> Set safemode should not fail
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: HDFS-15509.patch
Status: Patch Available (was: Open)
> Set safemode should not fail
[
https://issues.apache.org/jira/browse/HDFS-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15509:
Attachment: (was: HDFS-15509.patch)
> Set safemode should not fail if one of the namenode is down.
>
[
https://issues.apache.org/jira/browse/HDFS-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161727#comment-17161727
]
Leon Gao commented on HDFS-10648:
-
[~hemanthboyina] Rebased. Saw some test failures but looks like not
[
https://issues.apache.org/jira/browse/HDFS-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao reassigned HDFS-15771:
---
Assignee: Leon Gao
> Enable configurable trash can directory location
>
[
https://issues.apache.org/jira/browse/HDFS-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262975#comment-17262975
]
Leon Gao commented on HDFS-15771:
-
[~bianqi] Thanks for reporting, we have an internal patch for this
[
https://issues.apache.org/jira/browse/HDFS-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao reassigned HDFS-15771:
---
Assignee: (was: Leon Gao)
> Enable configurable trash can directory location
>
[
https://issues.apache.org/jira/browse/HDFS-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263069#comment-17263069
]
Leon Gao commented on HDFS-15771:
-
[~bianqi] Oh cool, sry I thought you are looking for someone to
[
https://issues.apache.org/jira/browse/HDFS-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263069#comment-17263069
]
Leon Gao edited comment on HDFS-15771 at 1/12/21, 4:38 AM:
---
[~bianqi] Oh cool,
[
https://issues.apache.org/jira/browse/HDFS-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242819#comment-17242819
]
Leon Gao commented on HDFS-14904:
-
Thanks for the review! [~jingzhao]
> Add Option to let Balancer
[
https://issues.apache.org/jira/browse/HDFS-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228854#comment-17228854
]
Leon Gao commented on HDFS-15548:
-
Thanks a lot for the reviews [~jingzhao] [~hexiaoqiao] !
> Allow
[
https://issues.apache.org/jira/browse/HDFS-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-15549 started by Leon Gao.
---
> Improve DISK/ARCHIVE movement if they are on same filesystem
>
Leon Gao created HDFS-15683:
---
Summary: Allow configuring DISK/ARCHIVE capacity for individual
volumes
Key: HDFS-15683
URL: https://issues.apache.org/jira/browse/HDFS-15683
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14904:
Target Version/s: (was: 3.4.0)
> Balancer should pick nodes based on utilization in each iteration
>
[
https://issues.apache.org/jira/browse/HDFS-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-14904:
Description:
Normally the most important purpose for HDFS balancer is to reduce the top used
node to
[
https://issues.apache.org/jira/browse/HDFS-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261673#comment-17261673
]
Leon Gao commented on HDFS-15549:
-
I have put a draft patch with some tests.
I tried to use hardlink to
[
https://issues.apache.org/jira/browse/HDFS-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266448#comment-17266448
]
Leon Gao commented on HDFS-15549:
-
thanks for the review [~jingzhao] !
> Use Hardlink to move replica
[
https://issues.apache.org/jira/browse/HDFS-15785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15785:
Description:
Currently as HDFS supports observers, multiple-standby and router, the namenode
hosts are
Leon Gao created HDFS-15785:
---
Summary: Datanode to support using DNS to resolve nameservices to
IP addresses to get list of namenodes
Key: HDFS-15785
URL: https://issues.apache.org/jira/browse/HDFS-15785
[
https://issues.apache.org/jira/browse/HDFS-15683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268137#comment-17268137
]
Leon Gao edited comment on HDFS-15683 at 1/19/21, 6:49 PM:
---
Hi [~jingzhao]
[
https://issues.apache.org/jira/browse/HDFS-15683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268137#comment-17268137
]
Leon Gao commented on HDFS-15683:
-
Hi [~jingzhao] [~hexiaoqiao] Could you please take a look at the draft
Leon Gao created HDFS-15781:
---
Summary: Add metrics for block movemements
Key: HDFS-15781
URL: https://issues.apache.org/jira/browse/HDFS-15781
Project: Hadoop HDFS
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HDFS-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leon Gao updated HDFS-15781:
Summary: Add metrics for how blocks are moved in replaceBlock (was: Add
metrics for block movemements)
>
[
https://issues.apache.org/jira/browse/HDFS-15683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274031#comment-17274031
]
Leon Gao commented on HDFS-15683:
-
Discuss offline with [~jingzhao], we can add an additional config to
Leon Gao created HDFS-15807:
---
Summary: RefreshVolume fails when replacing DISK/ARCHIVE vol on
same mount
Key: HDFS-15807
URL: https://issues.apache.org/jira/browse/HDFS-15807
Project: Hadoop HDFS
1 - 100 of 129 matches
Mail list logo
