[
https://issues.apache.org/jira/browse/KYLIN-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112849#comment-17112849
]
wangrupeng edited comment on KYLIN-4450 at 5/21/20, 6:53 AM:
-------------------------------------------------------------
Auto adujust spark driver memory is belong to the feature "Auto adjust spark
parameters" of Kylin on Parquet. See more about thie feature from [GitHub
Wiki]([https://github.com/Kyligence/kylin-on-parquet-v2/wiki)|https://github.com/Kyligence/kylin-on-parquet-v2/wiki]
was (Author: wangrupeng):
Auto adujust spark driver memory is belong to the feature "Auto adjust spark
parameters" of Kylin on Parquet. See more about thie feature from [GitHub
Wiki|[https://github.com/Kyligence/kylin-on-parquet-v2/wiki]]
> Add the feature that adjusting spark driver memory adaptively
> -------------------------------------------------------------
>
> Key: KYLIN-4450
> URL: https://issues.apache.org/jira/browse/KYLIN-4450
> Project: Kylin
> Issue Type: Improvement
> Components: Storage - Parquet
> Reporter: xuekaiqi
> Assignee: wangrupeng
> Priority: Major
> Fix For: v4.0.0-beta
>
> Original Estimate: 16h
> Remaining Estimate: 16h
>
> For now the cubing job can adaptively adjust the following spark properties
> to use of resources retionally, but the driver memory of the spark job
> uploaded to cluster haven't been done.
>
> {code:java}
> spark.executor.memory
> spark.executor.cores
> spark.executor.memoryOverhead
> spark.executor.instances
> spark.sql.shuffle.partitions
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
