[
https://issues.apache.org/jira/browse/DATALAB-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Kulynych updated DATALAB-2482:
-------------------------------------
Description:
Spark driver/executor memory is allocated according to the ticket
https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it
does not work.
*Preconditions:*
# Zeppelin is in running status
*Steps to reproduce:*
# Run Playbook on Zeppelin
# Run on notebook sudo ps aux | grep java
# Calculate the memory by formula Spark executor memory = total executor
memory * 0/85
*Actual result:*
# Calculation is not equal to spark memory (sudo ps aux | grep java)
*Expected result:*
# Calculation is equal to spark memory (sudo ps aux | grep java)
was:
Spark driver/executor memory is allocated according to the ticket
https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it
does not work.
*Preconditions:*
# Zeppelin is in running status
*Steps to reproduce:*
# Run Playbook on Zeppelin
# Run on notebook sudo ps aux | grep java
# Calculate the memory by formula Spark executor memory = total executor
memory * 0/90
*Actual result:*
# Calculation is not equal to spark memory (sudo ps aux | grep java)
*Expected result:*
# Calculation is equal to spark memory (sudo ps aux | grep java)
> [Apache Zeppelin] Spark drivers/executors memory are not allocated according
> to best practice
> ---------------------------------------------------------------------------------------------
>
> Key: DATALAB-2482
> URL: https://issues.apache.org/jira/browse/DATALAB-2482
> Project: Apache DataLab
> Issue Type: Bug
> Security Level: Public(Regular Issues)
> Components: DataLab Main
> Reporter: Vira Vitanska
> Assignee: Leonid Frolov
> Priority: Minor
> Labels: AWS, AZURE, Debian, DevOps, GCP, RedHat
> Attachments: spark_memory.png, spark_memory1.png
>
>
> Spark driver/executor memory is allocated according to the ticket
> https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin
> it does not work.
> *Preconditions:*
> # Zeppelin is in running status
> *Steps to reproduce:*
> # Run Playbook on Zeppelin
> # Run on notebook sudo ps aux | grep java
> # Calculate the memory by formula Spark executor memory = total executor
> memory * 0/85
> *Actual result:*
> # Calculation is not equal to spark memory (sudo ps aux | grep java)
> *Expected result:*
> # Calculation is equal to spark memory (sudo ps aux | grep java)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
