lshmouse opened a new pull request #543: KYLIN-3885: Build dimension dictionary job costs too long when using Spark fact distinct URL: https://github.com/apache/kylin/pull/543 See: https://issues.apache.org/jira/browse/KYLIN-3893 The issue is that the ColumnDFSFile generated by Spark fact distinct is not sorted, which cause too many write/delete/read slice files when building global dictionary.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
