[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-10-07 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Description: After upgrading from Spark 1.6.3 to 2.3.0 our jobs started to need about 50% more

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Component/s: Java API > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Originally found in an AWS Kubernetes environment with Spark Embedded. Also

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Original found in an AWS Kubernetes environment with Spark Embedded.   Also

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Original found in an AWS Kubernetes environment with Spark Embedded. Also happens

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Environment: Originally found in an AWS Kubernetes environment with Spark Embedded. Also

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Description: After upgrading from Spark 1.6.3 to 2.3.0 our jobs started to need about 50% more

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Attachment: Spark2.3-70GB.png > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Attachment: Spark1.6-50GB.png > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about

[jira] [Updated] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuno Azevedo updated SPARK-25552: - Attachment: Spark2.3-50GB.png > Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about

[jira] [Created] (SPARK-25552) Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory

2018-09-27 Thread Nuno Azevedo (JIRA)
Nuno Azevedo created SPARK-25552: Summary: Upgrade from Spark 1.6.3 to 2.3.0 seems to make jobs use about 50% more memory Key: SPARK-25552 URL: https://issues.apache.org/jira/browse/SPARK-25552