nichunen created KYLIN-3271:

             Summary: Optimize sub-path check of ResourceTool
                 Key: KYLIN-3271
             Project: Kylin
          Issue Type: Improvement
          Components: Metadata
    Affects Versions: v2.2.0
            Reporter: nichunen
            Assignee: nichunen
             Fix For: v2.4.0

kylin uses class org.apache.kylin.common.persistence.ResourceTool to do 
metadata download, upload, remove, etc. The algorithm for resource transversal 
is not very effective. For instance, for an "execute_output" with key 
"/execute_output/\{uuid}", the algorithm will try to check whether it's a 
folder with sub-resources, this makes un-necessary time cost, and in cases of 
metadata with lots of jobs, it may last for a long time before the finish.

This message was sent by Atlassian JIRA

Reply via email to