[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149176#comment-17149176 ] Danil Lipovoy commented on HDFS-15409: -- I was surprised, but old (current) version shows better

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143602#comment-17143602 ] Danil Lipovoy commented on HDFS-15409: -- About HBase blocks distribution - all tests show the same

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141523#comment-17141523 ] Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 7:42 PM: Actually

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141523#comment-17141523 ] Danil Lipovoy commented on HDFS-15409: -- Actually this test out of clientShortCircuitNum, because it

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366 ] Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 9:39 AM: I think

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366 ] Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 9:38 AM: I think

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366 ] Danil Lipovoy edited comment on HDFS-15409 at 6/21/20, 9:35 AM: I think

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141366#comment-17141366 ] Danil Lipovoy commented on HDFS-15409: -- I think you are absolutely right that the real blockId is

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110439#comment-17110439 ] Danil Lipovoy commented on HDFS-15202: -- I'am so sorry, my bad( > HDFS-client: boost ShortCircuit

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098310#comment-17098310 ] Danil Lipovoy commented on HDFS-15202: -- [~leosun08] Thank you!) > HDFS-client: boost ShortCircuit

[jira] [Issue Comment Deleted] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Comment: was deleted (was: [~leosun08] Could you take a look, please?) > HDFS-client: boost

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081718#comment-17081718 ] Danil Lipovoy commented on HDFS-15202: -- [~leosun08] Could you take a look, please? > HDFS-client:

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076149#comment-17076149 ] Danil Lipovoy commented on HDFS-15202: -- [~leosun08] Sorry for waiting, was a little bit busy) I

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059985#comment-17059985 ] Danil Lipovoy commented on HDFS-15202: -- [~quanli] I did 2 tests: 1. Via HBase. It was massive

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059648#comment-17059648 ] Danil Lipovoy commented on HDFS-15202: -- >>Yes, you can develop it step by step. Cool) >>I think you

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638 ] Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:39 PM: - Yes,

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638 ] Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:34 PM: - Yes,

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638 ] Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:32 PM: - Yes,

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638 ] Danil Lipovoy commented on HDFS-15202: -- Yes, you are right, there are ways improve performance even

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059638#comment-17059638 ] Danil Lipovoy edited comment on HDFS-15202 at 3/15/20, 12:31 PM: - Yes,

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:57 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:46 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:45 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:42 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:41 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:40 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:40 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:38 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:38 PM:

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy edited comment on HDFS-15202 at 3/12/20, 4:37 PM:

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058076#comment-17058076 ] Danil Lipovoy commented on HDFS-15202: -- [~leosun08] Thanks for interest!) Let me provide more

[jira] [Issue Comment Deleted] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Comment: was deleted (was: [~weichiu] ok,

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054897#comment-17054897 ] Danil Lipovoy edited comment on HDFS-15202 at 3/9/20, 1:32 PM: --- Done more

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054902#comment-17054902 ] Danil Lipovoy edited comment on HDFS-15202 at 3/9/20, 12:59 PM: How to

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054902#comment-17054902 ] Danil Lipovoy commented on HDFS-15202: -- How to read the picture: the execution time of 100 thousand

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Attachment: hdfs_scc_3_test.png > HDFS-client: boost ShortCircuit Cache >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054897#comment-17054897 ] Danil Lipovoy commented on HDFS-15202: -- Done more tests. There were test via HBase. More clean just

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Attachment: HDFS_CPU_full_cycle.png > HDFS-client: boost ShortCircuit Cache >

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Attachment: hdfs_scc_test_full-cycle.png > HDFS-client: boost ShortCircuit Cache >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054040#comment-17054040 ] Danil Lipovoy commented on HDFS-15202: -- Here we can see the locks when the cache is only 1.

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Attachment: locks.png > HDFS-client: boost ShortCircuit Cache >

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Attachment: cpu_SSC2.png > HDFS-client: boost ShortCircuit Cache >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054022#comment-17054022 ] Danil Lipovoy commented on HDFS-15202: -- !cpu_SSC2.png! > HDFS-client: boost ShortCircuit Cache >

[jira] [Comment Edited] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054021#comment-17054021 ] Danil Lipovoy edited comment on HDFS-15202 at 3/7/20, 12:33 PM: Done more

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054021#comment-17054021 ] Danil Lipovoy commented on HDFS-15202: -- Done more tests. Moved out generators on others hosts. And

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Attachment: requests_SSC.png cpu_SSC.png > HDFS-client: boost ShortCircuit Cache

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054018#comment-17054018 ] Danil Lipovoy commented on HDFS-15202: -- [~weichiu] [Done|https://github.com/apache/hadoop/pull/1884]

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Description: ТотI want to propose how to improve reading performance HDFS-client. The idea:

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051452#comment-17051452 ] Danil Lipovoy commented on HDFS-15202: -- [~weichiu] ok,

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Description: I want to propose how to improve reading performance HDFS-client. The idea: create

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Description: I want to propose how to improve reading performance HDFS-client. The idea: create

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Description: I want to propose how to improve reading performance HDFS-client. The idea: create

[jira] [Updated] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danil Lipovoy updated HDFS-15202: - Environment: 4 nodes E5-2698 v4 @ 2.20GHz, 700 Gb Mem. 8 RegionServers (2 by host) 8 tables by

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050472#comment-17050472 ] Danil Lipovoy commented on HDFS-15202: -- Hi [~weichiu]! Of course, I am newbe here, don't know how