marchpure opened a new pull request #3660: [HOTFIX] Remove Useless filepath 
truncation During pruning
URL: https://github.com/apache/carbondata/pull/3660
 
 
    ### Why is this PR needed?
    During prunning, for each blocklet, it will truncate the filepath with the 
keyword "/Part0". But it is meaningless.
   Specially, for partition table, the filepath is in style of 
'/tablename/partitionkey=value/segment0/.carbondata',  even have no keywork 
'/Part0'.
   For non-partition table, it is also meaningless to do this work.
   If there are a huge amount of blocklets, such as 400 million blocklets are 
going to be prunned, the truncation work hampers the query performance heavily.
    
    ### What changes were proposed in this PR?
   Remove the filepath truncation.
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No
   
       
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to