[GitHub] [carbondata] shenjiayu17 opened a new pull request #3986: [CARBONDATA-4034] Improve the time-consuming of Horizontal Compaction for update

Thu, 15 Oct 2020 06:25:12 -0700 


shenjiayu17 opened a new pull request #3986:
URL: https://github.com/apache/carbondata/pull/3986


    ### Why is this PR needed?
    The horizontal compaction flow will be too slow when updating with lots of 
segments(or lots of blocks), so we try to analyze and optimize it for 
time-consuming problem.
    
    ### What changes were proposed in this PR?
   In performDeleteDeltaCompaction, optimize the method 
getSegListIUDCompactionQualified. Combine two traversals of segments which have 
same process, and move listFiles process outside the traversal of blocks.
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to