[jira] [Commented] (KYLIN-4841) Spark RDD cache is invalid when building with spark engine

[ASF GitHub Bot (Jira)]

    [ 
https://issues.apache.org/jira/browse/KYLIN-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248811#comment-17248811
 ] 

ASF GitHub Bot commented on KYLIN-4841:
---------------------------------------

zzcclp commented on pull request #1507:
URL: https://github.com/apache/kylin/pull/1507#issuecomment-744278051


   ## Test Result
   
   ### Before this patch
   
![image](https://user-images.githubusercontent.com/9430290/102057877-99368380-3e29-11eb-9c4d-f416a853b72c.png)
   
   As shown as above, every 'flatMapToPair' operation executes 'shuffle read'.
   
   
   ### After this patch
   
![image](https://user-images.githubusercontent.com/9430290/102057882-9cca0a80-3e29-11eb-9a25-4955192daaf4.png)
   
   After this patch, the time of every 'flatMapToPair' operation took is 
smaller than before, and it directly reads cached data and doesn't do 'shuffle 
read'.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Spark RDD cache is invalid when building with spark engine
> ----------------------------------------------------------
>
>                 Key: KYLIN-4841
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4841
>             Project: Kylin
>          Issue Type: Bug
>          Components: Spark Engine
>    Affects Versions: v3.1.1
>            Reporter: Zhichao  Zhang
>            Assignee: Zhichao  Zhang
>            Priority: Minor
>             Fix For: v3.1.2
>
>
> Spark RDD cache is invalid when building with spark engine



--
This message was sent by Atlassian Jira
(v8.3.4#803005)