[jira] [Commented] (SPARK-15348) Hive ACID

[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959185#comment-16959185 ] Georg Heiler commented on SPARK-15348: -- To my best knowledge, EXTERNAL tables are not faster - they

[jira] [Commented] (SPARK-15348) Hive ACID

[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958225#comment-16958225 ] Georg Heiler commented on SPARK-15348: -- Another workaround could be external tables 

[jira] [Commented] (SPARK-23899) Built-in SQL Function Improvement

[ https://issues.apache.org/jira/browse/SPARK-23899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620230#comment-16620230 ] Georg Heiler commented on SPARK-23899: -- What about repartitioning by complex types, i.e. size of

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424549#comment-16424549 ] Georg Heiler commented on SPARK-22918: --  +1 same issue > sbt test (spark - local) fail after

[jira] [Updated] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException

[ https://issues.apache.org/jira/browse/SPARK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Georg Heiler updated SPARK-20389: - Indeed kryo 4. > Upgrade kryo to fix NegativeArraySizeException >

[jira] [Created] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException

Georg Heiler created SPARK-20389: Summary: Upgrade kryo to fix NegativeArraySizeException Key: SPARK-20389 URL: https://issues.apache.org/jira/browse/SPARK-20389 Project: Spark Issue Type:

[jira] [Created] (SPARK-18887) Executor OOM due to tungsten memory leak in external sorter

Georg Heiler created SPARK-18887: Summary: Executor OOM due to tungsten memory leak in external sorter Key: SPARK-18887 URL: https://issues.apache.org/jira/browse/SPARK-18887 Project: Spark

[jira] [Commented] (SPARK-18532) Code generation memory issue

[ https://issues.apache.org/jira/browse/SPARK-18532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687083#comment-15687083 ] Georg Heiler commented on SPARK-18532: -- But isn't the `.cache()` statement required more than once

[jira] [Commented] (SPARK-18532) Code generation memory issue

[ https://issues.apache.org/jira/browse/SPARK-18532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687007#comment-15687007 ] Georg Heiler commented on SPARK-18532: -- [~rchukh] thanks for the gist. I will change the code to

[jira] [Commented] (SPARK-18532) Code generation memory issue

[ https://issues.apache.org/jira/browse/SPARK-18532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685920#comment-15685920 ] Georg Heiler commented on SPARK-18532: -- Please find a minimal example here:

[jira] [Created] (SPARK-18532) Code generation memory issue

Georg Heiler created SPARK-18532: Summary: Code generation memory issue Key: SPARK-18532 URL: https://issues.apache.org/jira/browse/SPARK-18532 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17804) Pandas dtypes are not correctly inferred by pyspark

Georg Heiler created SPARK-17804: Summary: Pandas dtypes are not correctly inferred by pyspark Key: SPARK-17804 URL: https://issues.apache.org/jira/browse/SPARK-17804 Project: Spark Issue

[jira] [Created] (SPARK-14431) Local vs. Docker Spark parquet schema not found

Georg Heiler created SPARK-14431: Summary: Local vs. Docker Spark parquet schema not found Key: SPARK-14431 URL: https://issues.apache.org/jira/browse/SPARK-14431 Project: Spark Issue Type:

[jira] [Closed] (SPARK-14250) Parquet import failure: No predefined schema found

[ https://issues.apache.org/jira/browse/SPARK-14250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Georg Heiler closed SPARK-14250. Resolution: Won't Fix > Parquet import failure: No predefined schema found >

[jira] [Commented] (SPARK-14250) Parquet import failure: No predefined schema found

[ https://issues.apache.org/jira/browse/SPARK-14250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216740#comment-15216740 ] Georg Heiler commented on SPARK-14250: -- The local file seems to have been corrupted trying to read

[jira] [Created] (SPARK-14250) Parquet import failure: No predefined schema found

Georg Heiler created SPARK-14250: Summary: Parquet import failure: No predefined schema found Key: SPARK-14250 URL: https://issues.apache.org/jira/browse/SPARK-14250 Project: Spark Issue