[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-20 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585554#comment-16585554 ] Ayoub Benali commented on SPARK-25144: -- [~jerryshao] according the comments above this bug doesn't

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-17 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584042#comment-16584042 ] Ayoub Benali commented on SPARK-25144: -- [~viirya] I haven't tried on master branch, is there any

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-17 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584021#comment-16584021 ] Ayoub Benali commented on SPARK-25144: -- Somehow adding cache before calling "isEmpty" avoids the

[jira] [Updated] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-17 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayoub Benali updated SPARK-25144: - Description: The following code example:  {code} case class Foo(bar: Option[String]) val ds =

[jira] [Commented] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-17 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583990#comment-16583990 ] Ayoub Benali commented on SPARK-25144: -- [~viirya] the same happens with spark 2.2.1 I assume that

[jira] [Created] (SPARK-25144) distinct on Dataset leads to exception due to Managed memory leak detected

2018-08-17 Thread Ayoub Benali (JIRA)
Ayoub Benali created SPARK-25144: Summary: distinct on Dataset leads to exception due to Managed memory leak detected Key: SPARK-25144 URL: https://issues.apache.org/jira/browse/SPARK-25144

[jira] [Commented] (SPARK-5508) [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0

2015-02-21 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14330234#comment-14330234 ] Ayoub Benali commented on SPARK-5508: - The current work around is to use the LOAD

[jira] [Updated] (SPARK-5508) [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0

2015-02-21 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayoub Benali updated SPARK-5508: Description: When the table is saved as parquet, we cannot query a field which is an array of

[jira] [Updated] (SPARK-5508) [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0

2015-02-21 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayoub Benali updated SPARK-5508: Summary: [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 (was: [hive

[jira] [Comment Edited] (SPARK-5508) [hive context] Unable to query array once saved as parquet

2015-02-12 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301349#comment-14301349 ] Ayoub Benali edited comment on SPARK-5508 at 2/12/15 9:53 AM: --

[jira] [Created] (SPARK-5775) GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

2015-02-12 Thread Ayoub Benali (JIRA)
Ayoub Benali created SPARK-5775: --- Summary: GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table Key: SPARK-5775 URL: https://issues.apache.org/jira/browse/SPARK-5775

[jira] [Commented] (SPARK-5508) [hive context] Unable to query array once saved as parquet

2015-02-02 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301349#comment-14301349 ] Ayoub Benali commented on SPARK-5508: - I narrowed down the problem, the issue seems to

[jira] [Created] (SPARK-5508) [hive context] Unable to query array once saved as parquet

2015-01-31 Thread Ayoub Benali (JIRA)
Ayoub Benali created SPARK-5508: --- Summary: [hive context] Unable to query array once saved as parquet Key: SPARK-5508 URL: https://issues.apache.org/jira/browse/SPARK-5508 Project: Spark Issue

[jira] [Updated] (SPARK-5508) [hive context] Unable to query array once saved as parquet

2015-01-31 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayoub Benali updated SPARK-5508: Description: When the table is saved as parquet, we cannot query a field which is an array of

[jira] [Updated] (SPARK-5508) [hive context] Unable to query array once saved as parquet

2015-01-31 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayoub Benali updated SPARK-5508: Description: When the table is saved as parquet, we cannot query a field which is an array of