[jira] [Commented] (SPARK-23650) Slow SparkR udf (dapply)

2018-04-01 Thread Deepansh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421933#comment-16421933 ] Deepansh commented on SPARK-23650: -- @[~felixcheung] following up on above discussion. > Slow SparkR udf

[jira] [Assigned] (SPARK-23841) NodeIdCache should unpersist the last cached nodeIdsForInstances

2018-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23841: Assignee: Apache Spark > NodeIdCache should unpersist the last cached nodeIdsForInstances

[jira] [Assigned] (SPARK-23841) NodeIdCache should unpersist the last cached nodeIdsForInstances

2018-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23841: Assignee: (was: Apache Spark) > NodeIdCache should unpersist the last cached

[jira] [Commented] (SPARK-23841) NodeIdCache should unpersist the last cached nodeIdsForInstances

2018-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421919#comment-16421919 ] Apache Spark commented on SPARK-23841: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-23841) NodeIdCache should unpersist the last cached nodeIdsForInstances

2018-04-01 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-23841: Summary: NodeIdCache should unpersist the last cached nodeIdsForInstances Key: SPARK-23841 URL: https://issues.apache.org/jira/browse/SPARK-23841 Project: Spark

[jira] [Commented] (SPARK-23840) PySpark error when converting a DataFrame to rdd

2018-04-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421912#comment-16421912 ] Hyukjin Kwon commented on SPARK-23840: -- Can you give me the full error messages? and .. does this

[jira] [Resolved] (SPARK-23814) Couldn't read file with colon in name and new line character in one of the field.

2018-04-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23814. -- Resolution: Duplicate I think this duplicates SPARK-23148. I am resolving this but please

[jira] [Commented] (SPARK-23839) consider bucket join in cost-based JoinReorder rule

2018-04-01 Thread Wang, Gang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421906#comment-16421906 ] Wang, Gang commented on SPARK-23839: Good point! Currently, Spark just take data size into

[jira] [Commented] (SPARK-19276) FetchFailures can be hidden by user (or sql) exception handling

2018-04-01 Thread chen xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421879#comment-16421879 ] chen xiao commented on SPARK-19276: --- I believe it cause another bug. If the task is killed with reason

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

2018-04-01 Thread Gabor Barna (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421700#comment-16421700 ] Gabor Barna commented on SPARK-12823: - Hi, I created a library to address this issue:

[jira] [Updated] (SPARK-23040) BlockStoreShuffleReader's return Iterator isn't interruptible if aggregator or ordering is specified

2018-04-01 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-23040: Fix Version/s: 2.3.1 > BlockStoreShuffleReader's return Iterator isn't interruptible if aggregator

[jira] [Created] (SPARK-23840) PySpark error when converting a DataFrame to rdd

2018-04-01 Thread Uri Goren (JIRA)
Uri Goren created SPARK-23840: - Summary: PySpark error when converting a DataFrame to rdd Key: SPARK-23840 URL: https://issues.apache.org/jira/browse/SPARK-23840 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23839) consider bucket join in cost-based JoinReorder rule

2018-04-01 Thread Xiaoju Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421613#comment-16421613 ] Xiaoju Wu commented on SPARK-23839: --- Any discussion or ticket already related to this topic please let

[jira] [Created] (SPARK-23839) consider bucket join in cost-based JoinReorder rule

2018-04-01 Thread Xiaoju Wu (JIRA)
Xiaoju Wu created SPARK-23839: - Summary: consider bucket join in cost-based JoinReorder rule Key: SPARK-23839 URL: https://issues.apache.org/jira/browse/SPARK-23839 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-23838) SparkUI: Running SQL query displayed as "completed" in SQL tab

2018-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23838: Assignee: (was: Apache Spark) > SparkUI: Running SQL query displayed as "completed"

[jira] [Assigned] (SPARK-23838) SparkUI: Running SQL query displayed as "completed" in SQL tab

2018-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23838: Assignee: Apache Spark > SparkUI: Running SQL query displayed as "completed" in SQL tab >

[jira] [Commented] (SPARK-23838) SparkUI: Running SQL query displayed as "completed" in SQL tab

2018-04-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421600#comment-16421600 ] Apache Spark commented on SPARK-23838: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-23838) SparkUI: Running SQL query displayed as "completed" in SQL tab

2018-04-01 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-23838: --- Description: On [^image1.png] one can see the query in "Completed queries" !image1.png! ,

[jira] [Updated] (SPARK-23838) SparkUI: Running SQL query displayed as "completed" in SQL tab

2018-04-01 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-23838: --- Attachment: image1.png image3.png image2.png > SparkUI:

[jira] [Created] (SPARK-23838) SparkUI: Running SQL query displayed as "completed" in SQL tab

2018-04-01 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-23838: -- Summary: SparkUI: Running SQL query displayed as "completed" in SQL tab Key: SPARK-23838 URL: https://issues.apache.org/jira/browse/SPARK-23838 Project: Spark