[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12824: - Description: Below is a simple {{pyspark}} script that tries to split an RDD into a dictionary c

[jira] [Created] (SPARK-12825) Spark-submit Jar URL loading fails on redirect

2016-01-14 Thread Alex Nederlof (JIRA)
Alex Nederlof created SPARK-12825: - Summary: Spark-submit Jar URL loading fails on redirect Key: SPARK-12825 URL: https://issues.apache.org/jira/browse/SPARK-12825 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12824: - Affects Version/s: 1.5.2 > Failure to maintain consistent RDD references in pyspark > ---

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12824: - Description: Below is a simple {{pyspark}} script that tries to split an RDD into a dictionary c

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12824: - Description: Below is a simple {{pyspark}} script that tries to split an RDD into a dictionary c

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12824: -- Component/s: PySpark > Failure to maintain consistent RDD references in pyspark > -

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12824: - Description: Below is a simple `pyspark` script that tries to split an RDD into a dictionary con

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12824: -- Description: Below is a simple `pyspark` script that tries to split an RDD into a dictionary containin

[jira] [Updated] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Shearer updated SPARK-12824: - Description: Below is a simple `pyspark` script that tries to split an RDD into a dictionary con

[jira] [Created] (SPARK-12824) Failure to maintain consistent RDD references in pyspark

2016-01-14 Thread Paul Shearer (JIRA)
Paul Shearer created SPARK-12824: Summary: Failure to maintain consistent RDD references in pyspark Key: SPARK-12824 URL: https://issues.apache.org/jira/browse/SPARK-12824 Project: Spark Issu

[jira] [Created] (SPARK-12823) Cannot create UDF with StructType input

2016-01-14 Thread Frank Rosner (JIRA)
Frank Rosner created SPARK-12823: Summary: Cannot create UDF with StructType input Key: SPARK-12823 URL: https://issues.apache.org/jira/browse/SPARK-12823 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12262) describe extended doesn't return table on detail info tabled stored as PARQUET format

2016-01-14 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15098027#comment-15098027 ] Jayadevan M commented on SPARK-12262: - Yea Agreed. This workaround is working fine. B

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15098011#comment-15098011 ] Daniel Darabos commented on SPARK-11293: > so add 1.6.0 as affected version... D

[jira] [Updated] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos updated SPARK-11293: --- Affects Version/s: 1.6.0 > Spillable collections leak shuffle memory > --

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Romi Kuntsman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15098008#comment-15098008 ] Romi Kuntsman commented on SPARK-11293: --- so add 1.6.0 as affected version... > Spi

[jira] [Resolved] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9844. -- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 Resolved by https://github.com/ap

[jira] [Updated] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9844: - Assignee: Bryan Cutler > File appender race condition during SparkWorker shutdown > --

[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql

2016-01-14 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097992#comment-15097992 ] Ajesh Kumar commented on SPARK-12497: - I think this should be treated as a hive issue

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097987#comment-15097987 ] Daniel Darabos commented on SPARK-11293: > so should be reopened or not? is there

[jira] [Reopened] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos reopened SPARK-11293: > Spillable collections leak shuffle memory > - > >

[jira] [Commented] (SPARK-11570) ambiguous hostname resolving during startup

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097941#comment-15097941 ] Sean Owen commented on SPARK-11570: --- No, I meant SPARK_LOCAL_HOSTNAME. Have a look at t

[jira] [Commented] (SPARK-12822) Change default build to Hadoop 2.7

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097935#comment-15097935 ] Sean Owen commented on SPARK-12822: --- At least 2.6, yes. I support this. Though the risk

[jira] [Commented] (SPARK-12803) Consider adding ability to profile specific instances of executors in spark

2016-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097933#comment-15097933 ] Sean Owen commented on SPARK-12803: --- You wouldn't know which task executes on which exe

[jira] [Commented] (SPARK-12803) Consider adding ability to profile specific instances of executors in spark

2016-01-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097836#comment-15097836 ] Rajesh Balamohan commented on SPARK-12803: -- Letting the profiler agent run on al

<    1   2