[jira] [Updated] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Attachment: HDFS-14935.003.patch > Refactor DFSNetworkTopology#isNodeInScope >

[jira] [Commented] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960293#comment-16960293 ] Lisheng Sun commented on HDFS-14935: [~ayushtkn] i think if there is illegalArgumentException, it

[jira] [Comment Edited] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun edited comment on HDFS-14935 at 10/25/19 3:27 PM: -- hi

[jira] [Updated] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Summary: Refactor DFSNetworkTopology#isNodeInScope (was: Optimize DFSNetworkTopology#isNodeInScope)

[jira] [Updated] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Description: {code:java} private boolean isNodeInScope(Node node, String scope) { if

[jira] [Updated] (HDFS-14935) Refactor DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Description: {code:java} private boolean isNodeInScope(Node node, String scope) { if

[jira] [Updated] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Description: {code:java} private boolean isNodeInScope(Node node, String scope) { if

[jira] [Comment Edited] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun edited comment on HDFS-14935 at 10/25/19 9:59 AM: -- hi

[jira] [Comment Edited] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun edited comment on HDFS-14935 at 10/25/19 9:58 AM: -- hi

[jira] [Comment Edited] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun edited comment on HDFS-14935 at 10/25/19 9:58 AM: -- hi

[jira] [Comment Edited] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun edited comment on HDFS-14935 at 10/25/19 9:57 AM: -- hi

[jira] [Comment Edited] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun edited comment on HDFS-14935 at 10/25/19 9:55 AM: -- hi

[jira] [Commented] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959623#comment-16959623 ] Lisheng Sun commented on HDFS-14935: this Jira is used to optimize code and no need to write

[jira] [Updated] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Attachment: HDFS-14935.002.patch > Optimize DFSNetworkTopology#isNodeInScope >

[jira] [Updated] (HDFS-14935) Optimize DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Summary: Optimize DFSNetworkTopology#isNodeInScope (was: Unified constant in

[jira] [Updated] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Attachment: (was: HDFS-14935.001.patch) > Unified constant in DFSNetworkTopology#isNodeInScope >

[jira] [Updated] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Attachment: HDFS-14935.001.patch > Unified constant in DFSNetworkTopology#isNodeInScope >

[jira] [Assigned] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14935: -- Assignee: Lisheng Sun > Unified constant in DFSNetworkTopology#isNodeInScope >

[jira] [Updated] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14935: --- Attachment: HDFS-14935.001.patch Status: Patch Available (was: Open) > Unified constant in

[jira] [Created] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14935: -- Summary: Unified constant in DFSNetworkTopology#isNodeInScope Key: HDFS-14935 URL: https://issues.apache.org/jira/browse/HDFS-14935 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2019-10-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958493#comment-16958493 ] Lisheng Sun commented on HDFS-11430: {code:java} @Override public Node getLeaf(int leafIndex, Node

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2019-10-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14919: --- Attachment: HDFS-14919.001.patch Status: Patch Available (was: Open) > Provide Non DFS Used

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957217#comment-16957217 ] Lisheng Sun commented on HDFS-14283: Thanx [~ayushtkn] [~hexiaoqiao] for your good suggestions. I

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-22 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.004.patch > DFSInputStream to prefer cached replica >

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14919: --- Summary: Provide Non DFS Used per DataNode in DataNode UI (was: Provide Non DFS Used per disk in

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956605#comment-16956605 ] Lisheng Sun commented on HDFS-14919: [~elgoiri]  [~hemanthboyina] I think we need to look at the no

[jira] [Assigned] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14919: -- Assignee: Lisheng Sun > Provide Non DFS Used per disk in DataNode UI >

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14919: --- Attachment: hadoop3.1_datanode_ui.png hadoop2.6_datanode_ui.png > Provide Non DFS

[jira] [Created] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14919: -- Summary: Provide Non DFS Used per disk in DataNode UI Key: HDFS-14919 URL: https://issues.apache.org/jira/browse/HDFS-14919 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955388#comment-16955388 ] Lisheng Sun commented on HDFS-14283: hi [~smeng] [~weichiu] [~ayushtkn] [~elgoiri] Could you have

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955088#comment-16955088 ] Lisheng Sun commented on HDFS-14913: [^HDFS-14913-02.patch] LGTM +1. > Correct the value of

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950371#comment-16950371 ] Lisheng Sun commented on HDFS-14283: hi [~smeng] [~weichiu] Could you help review this patch? 1.the

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950286#comment-16950286 ] Lisheng Sun commented on HDFS-6524: --- [~ayushtkn] sorry, I did not understand the meaning of this failure

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.003.patch > DFSInputStream to prefer cached replica >

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950239#comment-16950239 ] Lisheng Sun commented on HDFS-6524: --- Thanks [~ayushtkn] for your good suggestions. I updated the patch

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: HDFS-6524.007.patch > Choosing datanode retries times considering with block replica

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950228#comment-16950228 ] Lisheng Sun commented on HDFS-6524: --- [~surendrasingh] [~weichiu]  [~ayushtkn] Could you help review

[jira] [Comment Edited] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-13 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950228#comment-16950228 ] Lisheng Sun edited comment on HDFS-6524 at 10/13/19 6:26 AM: - [~surendrasingh]

[jira] [Commented] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2019-10-12 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950226#comment-16950226 ] Lisheng Sun commented on HDFS-14895: [~ayushtkn] Could you have time to continue to take a review for

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949052#comment-16949052 ] Lisheng Sun commented on HDFS-6524: --- ping [~elgoiri] Should we commit this patch to trunk and all other

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.005.patch > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Commented] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947792#comment-16947792 ] Lisheng Sun commented on HDFS-14896: [~ayushtkn] Could you help continue to take a review for the

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.004.patch > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.003(2).patch > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.003.patch > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.003.patch > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: (was: HDFS-14896.003.patch) > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946665#comment-16946665 ] Lisheng Sun commented on HDFS-6524: --- [~elgoiri] Could you help commit this patch to trunk? Thank you a

[jira] [Commented] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2019-10-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946401#comment-16946401 ] Lisheng Sun commented on HDFS-14895: [~ayushtkn] -HDFS-9023 defines BlockPlacementPolicy.LOG.debug

[jira] [Commented] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2019-10-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945561#comment-16945561 ] Lisheng Sun commented on HDFS-14895: hi [~ayushtkn], Could you have time to take a reivew for this

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.002.patch > Make MIN_BLOCKS_FOR_WRITE configurable >

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Attachment: HDFS-14896.001.patch Status: Patch Available (was: Open) > Make

[jira] [Updated] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14896: --- Summary: Make MIN_BLOCKS_FOR_WRITE configurable (was: Make MIN_BLOCKS_FOR_WRITE configuable) >

[jira] [Created] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configuable

2019-10-06 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14896: -- Summary: Make MIN_BLOCKS_FOR_WRITE configuable Key: HDFS-14896 URL: https://issues.apache.org/jira/browse/HDFS-14896 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2019-10-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14895: --- Attachment: HDFS-14895.001.patch Status: Patch Available (was: Open) > Define LOG instead

[jira] [Created] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2019-10-06 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14895: -- Summary: Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block Key: HDFS-14895 URL: https://issues.apache.org/jira/browse/HDFS-14895

[jira] [Updated] (HDFS-14877) Remove unused imports from TestClose.java

2019-10-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14877: --- Resolution: Implemented Status: Resolved (was: Patch Available) > Remove unused imports

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-10-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944208#comment-16944208 ] Lisheng Sun commented on HDFS-6524: --- [~elgoiri] In current code 

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942552#comment-16942552 ] Lisheng Sun commented on HDFS-14283: Thanks [~smeng] for good comment and review. Current 

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.002.patch > DFSInputStream to prefer cached replica >

[jira] [Commented] (HDFS-14876) Remove unused imports from TestBlockMissingException.java and TestClose.java

2019-09-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940073#comment-16940073 ] Lisheng Sun commented on HDFS-14876: Hi [~ayushtkn]  HDFS-14849  remove unused imports in

[jira] [Updated] (HDFS-14876) Remove unused imports from TestBlockMissingException.java and TestClose.java

2019-09-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14876: --- Attachment: HDFS-14876.002.patch > Remove unused imports from TestBlockMissingException.java and

[jira] [Commented] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939823#comment-16939823 ] Lisheng Sun commented on HDFS-14850: hi [~elgoiri]  Should we commit this patch to trunk? Thank you.

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939822#comment-16939822 ] Lisheng Sun commented on HDFS-6524: --- [~elgoiri] Could you have time to continue to reveiew this patch?

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939482#comment-16939482 ] Lisheng Sun commented on HDFS-6524: --- all failed unit tests are not related to this patch. > Choosing

[jira] [Commented] (HDFS-14876) Remove unused imports from TestBlockMissingException.java and TestClose.java

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939476#comment-16939476 ] Lisheng Sun commented on HDFS-14876: Thanks [~ayushtkn] for good suggestions. I updated this patch

[jira] [Updated] (HDFS-14876) Remove unused imports from TestBlockMissingException.java and TestClose.java

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14876: --- Description: There 3 unused imports in TestBlockMissingException.java and TestClose.java. Let's

[jira] [Updated] (HDFS-14876) Remove unused imports from TestBlockMissingException.java and TestClose.java

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14876: --- Summary: Remove unused imports from TestBlockMissingException.java and TestClose.java (was: Remove

[jira] [Updated] (HDFS-14876) Remove unused imports from TestBlockMissingException.java

2019-09-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14876: --- Attachment: HDFS-14876.001.patch > Remove unused imports from TestBlockMissingException.java >

[jira] [Updated] (HDFS-14877) Remove unused imports from TestClose.java

2019-09-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14877: --- Attachment: HDFS-14877.000.patch Status: Patch Available (was: Open) > Remove unused

[jira] [Created] (HDFS-14877) Remove unused imports from TestClose.java

2019-09-26 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14877: -- Summary: Remove unused imports from TestClose.java Key: HDFS-14877 URL: https://issues.apache.org/jira/browse/HDFS-14877 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14876) Remove unused imports from TestBlockMissingException.java

2019-09-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14876: --- Attachment: HDFS-14876.000.patch Status: Patch Available (was: Open) > Remove unused

[jira] [Created] (HDFS-14876) Remove unused imports from TestBlockMissingException.java

2019-09-26 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14876: -- Summary: Remove unused imports from TestBlockMissingException.java Key: HDFS-14876 URL: https://issues.apache.org/jira/browse/HDFS-14876 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938796#comment-16938796 ] Lisheng Sun commented on HDFS-6524: --- Thanks [~elgoiri] for your good suggestions. Updated UT.

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: HDFS-6524.006.patch > Choosing datanode retries times considering with block replica

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: (was: HDFS-6524.006.patch) > Choosing datanode retries times considering with block

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: HDFS-6524.006.patch > Choosing datanode retries times considering with block replica

[jira] [Comment Edited] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937864#comment-16937864 ] Lisheng Sun edited comment on HDFS-14850 at 9/25/19 3:54 PM: - [~elgoiri] If

[jira] [Comment Edited] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937864#comment-16937864 ] Lisheng Sun edited comment on HDFS-14850 at 9/25/19 3:53 PM: - [~elgoiri] If

[jira] [Commented] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937864#comment-16937864 ] Lisheng Sun commented on HDFS-14850: [~elgoiri] If the new method is static, this static method does

[jira] [Resolved] (HDFS-14871) StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1

2019-09-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun resolved HDFS-14871. Resolution: Duplicate > StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1

[jira] [Updated] (HDFS-14871) StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1

2019-09-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14871: --- Summary: StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1 (was:

[jira] [Created] (HDFS-14871) StagingTestBase uses methods not available in Mockito 1.8.5

2019-09-24 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14871: -- Summary: StagingTestBase uses methods not available in Mockito 1.8.5 Key: HDFS-14871 URL: https://issues.apache.org/jira/browse/HDFS-14871 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936513#comment-16936513 ] Lisheng Sun edited comment on HDFS-14850 at 9/24/19 7:33 AM: - fixed the

[jira] [Commented] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936513#comment-16936513 ] Lisheng Sun commented on HDFS-14850: fixed the failures and uploaded the v005 patch. Could you have

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Attachment: HDFS-14850.005.patch > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Attachment: HDFS-14850.004(2).patch > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2019-09-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935758#comment-16935758 ] Lisheng Sun commented on HDFS-14283: hi [~smeng] Could you have time to take a review for this patch?

[jira] [Commented] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935755#comment-16935755 ] Lisheng Sun commented on HDFS-6524: --- hi [~elgoiri] {quote} Can we have some more coverage for this? We

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Attachment: HDFS-14850.004.patch > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Commented] (HDFS-14844) Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable

2019-09-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932987#comment-16932987 ] Lisheng Sun commented on HDFS-14844: all failed UTs are ok in local. So they are unrelated to this

[jira] [Commented] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932986#comment-16932986 ] Lisheng Sun commented on HDFS-14850: hi [~jojochuang] [~elgoiri] Could you help take a review for

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Attachment: HDFS-14850.003.patch > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Updated] (HDFS-14844) Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14844: --- Attachment: HDFS-14844.005.patch > Make buffer of

[jira] [Commented] (HDFS-14844) Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932013#comment-16932013 ] Lisheng Sun commented on HDFS-14844: [~elgoiri] I agree your option. And I confirmed all failed UTs

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Component/s: performance > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Component/s: httpfs > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Updated] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14850: --- Attachment: HDFS-14850.002.patch > Optimize FileSystemAccessService#getFileSystemConfiguration >

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: HDFS-6524.005(2).patch > Choosing datanode retries times considering with block replica

[jira] [Updated] (HDFS-6524) Choosing datanode retries times considering with block replica number

2019-09-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-6524: -- Attachment: (was: HDFS-6524.005.patch) > Choosing datanode retries times considering with block

<    1   2   3   4   5   6   7   8   9   10   >