[
https://issues.apache.org/jira/browse/KYLIN-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tianhui updated KYLIN-4895:
---------------------------
Description:
In cloud native environment, the memory of pod is quite limited. But the
spark Driver can use a huge amount of memory, in job engine pod, which is quite
difficult to manage when there are more and more projects.
So it's better to put spark driver on yarn, and kylin only maintain its
status.
was:In cloud native environment, the memory of pod is quite limited. But the
spark Driver can use a huge amount of memory, in job engine pod, which is quite
difficult to manage when there are more and more projects.
> change spark deploy mode of kylin4.0 engine from local to cluster
> -----------------------------------------------------------------
>
> Key: KYLIN-4895
> URL: https://issues.apache.org/jira/browse/KYLIN-4895
> Project: Kylin
> Issue Type: New Feature
> Components: Job Engine
> Affects Versions: v4.0.0-alpha
> Reporter: tianhui
> Priority: Major
> Fix For: Future
>
>
> In cloud native environment, the memory of pod is quite limited. But the
> spark Driver can use a huge amount of memory, in job engine pod, which is
> quite difficult to manage when there are more and more projects.
> So it's better to put spark driver on yarn, and kylin only maintain its
> status.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)