[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-03-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055520#comment-17055520 ] Lisheng Sun commented on HDFS-13639: [~elgoiri] [~ayushtkn] Could you have time to help review it?

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-03-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055519#comment-17055519 ] Lisheng Sun commented on HDFS-13639: i submit one PR about this issue. > SlotReleaser is not fast

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-03-12 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17057937#comment-17057937 ] Lisheng Sun commented on HDFS-15202: Thanx [~pustota] for your report. I understand your PR is

[jira] [Comment Edited] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081677#comment-17081677 ] Lisheng Sun edited comment on HDFS-15255 at 4/15/20, 4:48 AM: -- I confirmed

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Fix Version/s: 3.4.0 > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077254#comment-17077254 ] Lisheng Sun commented on HDFS-15255: Thanx [~sodonnell] for your Test. According to your result, in

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.002.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076365#comment-17076365 ] Lisheng Sun commented on HDFS-15255: the 002 patch added the UT and fixed checkstyle. > Consider

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076423#comment-17076423 ] Lisheng Sun commented on HDFS-15255:  If the last one overwrite the before one. According to the

[jira] [Updated] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15247: --- Attachment: (was: HDFS-15247.002.patch) > RBF: Provide Non DFS Used per DataNode in DataNode UI

[jira] [Updated] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15247: --- Attachment: HDFS-15247.002.patch > RBF: Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-12 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081677#comment-17081677 ] Lisheng Sun commented on HDFS-15255: I confirmed again the failed UTs are related to this jira.  

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Description: When only one replica of a block is SDD, the others are HDD. When the client reads the

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Description: When only one replica of a block is SDD, the others are HDD. When the client reads the

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Description: When only one replica of a block is SDD, the others are HDD. When the client reads the

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Description: When only one replica of a block is SDD, the others are HDD. When the client reads the

[jira] [Commented] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081630#comment-17081630 ] Lisheng Sun commented on HDFS-15247: Thanx [~ayushtkn] for your reminder. I added the v002 patch and

[jira] [Updated] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-04-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15247: --- Attachment: HDFS-15247.002.patch > RBF: Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Created] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load enabled

2020-04-19 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15285: -- Summary: The same distance and load nodes don't shuffle when consider DataNode load enabled Key: HDFS-15285 URL: https://issues.apache.org/jira/browse/HDFS-15285

[jira] [Updated] (HDFS-15285) The same distance and load nodes don't shuffle when considering DataNode load enabled

2020-04-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15285: --- Summary: The same distance and load nodes don't shuffle when considering DataNode load enabled

[jira] [Updated] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load enabled

2020-04-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15285: --- Summary: The same distance and load nodes don't shuffle when consider DataNode load enabled (was:

[jira] [Updated] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load

2020-04-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15285: --- Summary: The same distance and load nodes don't shuffle when consider DataNode load (was: The same

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086900#comment-17086900 ] Lisheng Sun commented on HDFS-15255: Check modified code through FindBud-IDEAD in my local, this 

[jira] [Updated] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load enabled

2020-04-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15285: --- Attachment: HDFS-15285.001.patch Status: Patch Available (was: Open) > The same distance

[jira] [Commented] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load

2020-04-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088323#comment-17088323 ] Lisheng Sun commented on HDFS-15285: hi [~elgoiri]  [~ayushtkn]  Could you help review this patch?

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088660#comment-17088660 ] Lisheng Sun commented on HDFS-15255: According to DatanodeInfoWithStorage, DatanodeDescriptor,

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.006.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.004.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.005.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078226#comment-17078226 ] Lisheng Sun commented on HDFS-15255: added the v003 patch. added document and fixed the checkstyle.

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.003.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Commented] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-04-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079437#comment-17079437 ] Lisheng Sun commented on HDFS-15247: hi, Ayush Saxena I have some problem that deployed hdfs-rbf in

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14919: --- Attachment: HDFS-14919.002.patch > Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059643#comment-17059643 ] Lisheng Sun commented on HDFS-15202: Yes, you can develop it step by step. I think you need add UT

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059624#comment-17059624 ] Lisheng Sun commented on HDFS-15202: Two situations: 1. when clientShortCircuitNum is 10, The

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Attachment: HDFS-13639.002.patch Fix Version/s: (was: 2.4.0) 3.3.0

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059624#comment-17059624 ] Lisheng Sun edited comment on HDFS-15202 at 3/15/20, 11:43 AM: --- Two

[jira] [Commented] (HDFS-14809) Reduce BlockReaderLocal RPC calls

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059627#comment-17059627 ] Lisheng Sun commented on HDFS-14809: [~ken_1...@163.com] {quote} As far as i know the shm and slot

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059653#comment-17059653 ] Lisheng Sun commented on HDFS-15202: UT mean unit test. the current unit test is that only the case

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14919: --- Attachment: HDFS-14919.003.patch > Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059983#comment-17059983 ] Lisheng Sun commented on HDFS-14919: Thank [~ayushtkn] for your reminder. I changed dfshealth.js too

[jira] [Created] (HDFS-15255) Consider StorageType in DatanodeManager#sortLocatedBlock()

2020-04-01 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15255: -- Summary: Consider StorageType in DatanodeManager#sortLocatedBlock() Key: HDFS-15255 URL: https://issues.apache.org/jira/browse/HDFS-15255 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-15255) Consider StorageType in DatanodeManager#sortLocatedBlock()

2020-04-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-15255: -- Assignee: Lisheng Sun > Consider StorageType in DatanodeManager#sortLocatedBlock() >

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.001.patch Status: Patch Available (was: Open) > Consider StorageType

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Summary: Consider StorageType when DatanodeManager#sortLocatedBlock() (was: Consider StorageType in

[jira] [Commented] (HDFS-15256) Fix typo in DataXceiverServer#run()

2020-04-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076106#comment-17076106 ] Lisheng Sun commented on HDFS-15256: hi [~ayushtkn] [~elgoiri] Should we commit this patch to the

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076104#comment-17076104 ] Lisheng Sun commented on HDFS-15255: {quote}FindBugs:Call to

[jira] [Created] (HDFS-15264) Backport HDFS-13571 to branch-3.1

2020-04-06 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15264: -- Summary: Backport HDFS-13571 to branch-3.1 Key: HDFS-15264 URL: https://issues.apache.org/jira/browse/HDFS-15264 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Assigned] (HDFS-15256) Fix typo in DataXceiverServer#run()

2020-04-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-15256: -- Assignee: Lisheng Sun > Fix typo in DataXceiverServer#run() >

[jira] [Assigned] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-03-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-15247: -- Assignee: Lisheng Sun > RBF: Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Commented] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-03-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070232#comment-17070232 ] Lisheng Sun commented on HDFS-15247: I added one PR for this issue. > RBF: Provide Non DFS Used per

[jira] [Updated] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2020-03-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15247: --- Attachment: HDFS-15247.001.patch Status: Patch Available (was: Open) > RBF: Provide Non DFS

[jira] [Created] (HDFS-15256) Fix typo in DataXceiverServer#run()

2020-04-02 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15256: -- Summary: Fix typo in DataXceiverServer#run() Key: HDFS-15256 URL: https://issues.apache.org/jira/browse/HDFS-15256 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15256) Fix typo in DataXceiverServer#run()

2020-04-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15256: --- Attachment: HDFS-15256.001.patch Status: Patch Available (was: Open) > Fix typo in

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076313#comment-17076313 ] Lisheng Sun commented on HDFS-15255: Thanx [~sodonnell] for patient review and good suggestions.

[jira] [Updated] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load

2020-04-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15285: --- Attachment: HDFS-15285.002.patch > The same distance and load nodes don't shuffle when consider

[jira] [Commented] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load

2020-04-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094999#comment-17094999 ] Lisheng Sun commented on HDFS-15285: Added the identical v002 patch to trigger a new build. > The

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-2.10.004.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1,

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-05-01 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-2.10.005.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1,

[jira] [Commented] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-05-01 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097366#comment-17097366 ] Lisheng Sun commented on HDFS-15264: the branch-2.10.005.patch fixed the checkstyle. the findbugs

[jira] [Commented] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096615#comment-17096615 ] Lisheng Sun commented on HDFS-15264: The branch-2.10.003.patch fixed compile problem.  The problem

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-2.10.003.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1,

[jira] [Comment Edited] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-05-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098195#comment-17098195 ] Lisheng Sun edited comment on HDFS-15264 at 5/3/20, 3:04 AM: - The findbugs

[jira] [Commented] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-05-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098195#comment-17098195 ] Lisheng Sun commented on HDFS-15264: The findbugs should be not related to this patch. [~ayushtkn]

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098643#comment-17098643 ] Lisheng Sun commented on HDFS-14283: The failed ut is unrelated to this patch. The Error info is

[jira] [Assigned] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-12288: -- Assignee: Lisheng Sun (was: Chen Zhang) > Fix DataNode's xceiver count calculation >

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-12288: --- Attachment: HDFS-12288.008.patch > Fix DataNode's xceiver count calculation >

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.007.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098889#comment-17098889 ] Lisheng Sun commented on HDFS-12288: hi [~zhangchen]  Are you still working on this jira? If not, i

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-04 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098868#comment-17098868 ] Lisheng Sun commented on HDFS-15255: Add the v007 patch.  This patch removes equals and hashCode

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099596#comment-17099596 ] Lisheng Sun commented on HDFS-12288: hi [~elgoiri] Could you help take a review for this patch? Thank

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099607#comment-17099607 ] Lisheng Sun commented on HDFS-15255: the v007 patch removes equals and hashCode from

[jira] [Comment Edited] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099607#comment-17099607 ] Lisheng Sun edited comment on HDFS-15255 at 5/5/20, 7:35 AM: - the v007 patch 

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15255: --- Attachment: HDFS-15255.008.patch > Consider StorageType when DatanodeManager#sortLocatedBlock() >

[jira] [Comment Edited] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099607#comment-17099607 ] Lisheng Sun edited comment on HDFS-15255 at 5/5/20, 7:36 AM: - hi [~sodonnell]

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.008.patch > DFSInputStream to prefer cached replica >

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.008.patch > DFSInputStream to prefer cached replica >

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099652#comment-17099652 ] Lisheng Sun commented on HDFS-14283: Thanx [~ayushtkn] for your suggestion. {quote} + if

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: (was: HDFS-14283.008.patch) > DFSInputStream to prefer cached replica >

[jira] [Commented] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095235#comment-17095235 ] Lisheng Sun commented on HDFS-15285: The failed UT should be unrelated to this patch. > The same

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HADOOP-16886-branch-3.1.001.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1 >

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-3.1.001.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1 >

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: (was: HADOOP-16886-branch-3.1.001.patch) > Backport HDFS-13571,HDFS-15149 to

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Summary: Backport HDFS-13571,HDFS-15149 to branch-3.1 (was: Backport HDFS-13571 to branch-3.1) >

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-3.1.002.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1 >

[jira] [Assigned] (HDFS-15264) Backport HDFS-13571 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-15264: -- Assignee: Lisheng Sun > Backport HDFS-13571 to branch-3.1 > -

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-29 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264.001.patch Status: Patch Available (was: Open) > Backport

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Summary: Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10 (was: Backport

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-3.1.003.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1 >

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-3.1.004.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1,

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-2.10.001.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1,

[jira] [Commented] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096482#comment-17096482 ] Lisheng Sun commented on HDFS-15264: the  failed ut should be  unrelated to the branch-3.1-004.patch.

[jira] [Updated] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

2020-04-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15264: --- Attachment: HDFS-15264-branch-2.10.002.patch > Backport HDFS-13571,HDFS-15149 to branch-3.1,

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-15 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084138#comment-17084138 ] Lisheng Sun commented on HDFS-15255: Thank [~sodonnell] for your suggestion. According to your

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-05-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105030#comment-17105030 ] Lisheng Sun commented on HDFS-13639: hi [~sodonnell]  [~ayushtkn] Could you have time to help review

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Attachment: image-2020-05-17-23-53-41-115.png > SlotReleaser is not fast enough >

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103843#comment-17103843 ] Lisheng Sun commented on HDFS-12288: hi [~elgoiri] i understands this patch resolved the issues that

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103856#comment-17103856 ] Lisheng Sun commented on HDFS-15255:   {quote} 2. There was a conflict due to HDFS-14283 in

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Status: Open (was: Patch Available) > SlotReleaser is not fast enough >

[jira] [Work started] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13639 started by Lisheng Sun. -- > SlotReleaser is not fast enough > --- > >

<    3   4   5   6   7   8   9   10   >