[
https://issues.apache.org/jira/browse/KYLIN-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135748#comment-17135748
]
ASF subversion and git services commented on KYLIN-4450:
--------------------------------------------------------
Commit 2ed1d08465f8176def975a8aa1869f361763ac26 in kylin's branch
refs/heads/kylin-on-parquet-v2 from rupengwang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2ed1d08 ]
KYLIN-4450 Add the feature that adjusting spark driver memory adaptively
> Add the feature that adjusting spark driver memory adaptively
> -------------------------------------------------------------
>
> Key: KYLIN-4450
> URL: https://issues.apache.org/jira/browse/KYLIN-4450
> Project: Kylin
> Issue Type: Improvement
> Components: Storage - Parquet
> Reporter: xuekaiqi
> Assignee: wangrupeng
> Priority: Major
> Fix For: v4.0.0-beta
>
> Original Estimate: 16h
> Remaining Estimate: 16h
>
> For now the cubing job can adaptively adjust the following spark properties
> to use of resources retionally, but the driver memory of the spark job
> uploaded to cluster haven't been done.
>
> {code:java}
> spark.executor.memory
> spark.executor.cores
> spark.executor.memoryOverhead
> spark.executor.instances
> spark.sql.shuffle.partitions
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
