[jira] [Resolved] (SPARK-20708) Make `addExclusionRules` up-to-date

[ https://issues.apache.org/jira/browse/SPARK-20708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-20708. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > Make `addExclusi

[jira] [Commented] (SPARK-20708) Make `addExclusionRules` up-to-date

[ https://issues.apache.org/jira/browse/SPARK-20708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032475#comment-16032475 ] Burak Yavuz commented on SPARK-20708: - Resolved by https://github.com/apache/spark/pu

[jira] [Assigned] (SPARK-20244) Incorrect input size in UI with pyspark

[ https://issues.apache.org/jira/browse/SPARK-20244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20244: --- Assignee: Saisai Shao > Incorrect input size in UI with pyspark > --

[jira] [Resolved] (SPARK-20244) Incorrect input size in UI with pyspark

[ https://issues.apache.org/jira/browse/SPARK-20244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20244. - Resolution: Fixed Fix Version/s: 2.2.0 > Incorrect input size in UI with pyspark > ---

[jira] [Assigned] (SPARK-20946) simplify the config setting logic in SparkSession.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20946: Assignee: Apache Spark (was: Wenchen Fan) > simplify the config setting logic in SparkSes

[jira] [Assigned] (SPARK-20946) simplify the config setting logic in SparkSession.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20946: Assignee: Wenchen Fan (was: Apache Spark) > simplify the config setting logic in SparkSes

[jira] [Commented] (SPARK-20946) simplify the config setting logic in SparkSession.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032460#comment-16032460 ] Apache Spark commented on SPARK-20946: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-20946) simplify the config setting logic in SparkSession.getOrCreate

Wenchen Fan created SPARK-20946: --- Summary: simplify the config setting logic in SparkSession.getOrCreate Key: SPARK-20946 URL: https://issues.apache.org/jira/browse/SPARK-20946 Project: Spark

[jira] [Assigned] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20945: Assignee: Apache Spark > NoSuchElementException key not found in TaskSchedulerImpl > -

[jira] [Assigned] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20945: Assignee: (was: Apache Spark) > NoSuchElementException key not found in TaskSchedulerI

[jira] [Commented] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032437#comment-16032437 ] Apache Spark commented on SPARK-20945: -- User 'liupc' has created a pull request for

[jira] [Updated] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20942: --- Issue Type: Improvement (was: Bug) > The title style about field is error in the history ser

[jira] [Updated] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20942: --- Issue Type: Bug (was: Improvement) > The title style about field is error in the history ser

[jira] [Updated] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20942: --- Description: 1.The title style about field is error. 2.Title text description, 'the applicat

[jira] [Updated] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-20945: --- Labels: (was: scheduler) > NoSuchElementException key not found in TaskSchedulerImpl >

[jira] [Updated] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-20945: --- Component/s: (was: Spark Core) Scheduler > NoSuchElementException key not found

[jira] [Commented] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032400#comment-16032400 ] liupengcheng commented on SPARK-20945: -- https://github.com/apache/spark/pull/18171

[jira] [Comment Edited] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032392#comment-16032392 ] liupengcheng edited comment on SPARK-20945 at 6/1/17 3:47 AM: -

[jira] [Commented] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032392#comment-16032392 ] liupengcheng commented on SPARK-20945: -- I finally find out this bug may caused by so

[jira] [Created] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

liupengcheng created SPARK-20945: Summary: NoSuchElementException key not found in TaskSchedulerImpl Key: SPARK-20945 URL: https://issues.apache.org/jira/browse/SPARK-20945 Project: Spark Iss

[jira] [Assigned] (SPARK-20898) spark.blacklist.killBlacklistedExecutors doesn't work in YARN

[ https://issues.apache.org/jira/browse/SPARK-20898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20898: Assignee: Apache Spark > spark.blacklist.killBlacklistedExecutors doesn't work in YARN > -

[jira] [Commented] (SPARK-20898) spark.blacklist.killBlacklistedExecutors doesn't work in YARN

[ https://issues.apache.org/jira/browse/SPARK-20898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032352#comment-16032352 ] Apache Spark commented on SPARK-20898: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-20898) spark.blacklist.killBlacklistedExecutors doesn't work in YARN

[ https://issues.apache.org/jira/browse/SPARK-20898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20898: Assignee: (was: Apache Spark) > spark.blacklist.killBlacklistedExecutors doesn't work

[jira] [Updated] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20942: --- Attachment: fix1.png fix.png before.png > The title style abo

[jira] [Updated] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20942: --- Description: 1.The title style about field is error. 2.Title text description, 'the applicat

[jira] [Assigned] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20942: Assignee: (was: Apache Spark) > The title style about field is error in the history se

[jira] [Assigned] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20942: Assignee: Apache Spark > The title style about field is error in the history server web ui

[jira] [Commented] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032336#comment-16032336 ] Apache Spark commented on SPARK-20942: -- User 'guoxiaolongzte' has created a pull req

[jira] [Created] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

CanBin Zheng created SPARK-20944: Summary: Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager Key: SPARK-20944 URL: https://issues.apache.org/jira/browse/SPARK-20944 Project: Spark

[jira] [Created] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

CanBin Zheng created SPARK-20943: Summary: Correct BypassMergeSortShuffleWriter's comment Key: SPARK-20943 URL: https://issues.apache.org/jira/browse/SPARK-20943 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-20942) The title style about field is error in the history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-20942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20942: --- Summary: The title style about field is error in the history server web ui. (was: The title

[jira] [Created] (SPARK-20942) The title style about field is error and the search field should not contain ''Event Log ' field in the history server web ui.

guoxiaolongzte created SPARK-20942: -- Summary: The title style about field is error and the search field should not contain ''Event Log ' field in the history server web ui. Key: SPARK-20942 URL: https://issues.ap

[jira] [Assigned] (SPARK-20936) Lack of an important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20936: Assignee: (was: Apache Spark) > Lack of an important case about the test of resolveURI

[jira] [Assigned] (SPARK-20936) Lack of an important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20936: Assignee: Apache Spark > Lack of an important case about the test of resolveURI >

[jira] [Commented] (SPARK-20936) Lack of an important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032300#comment-16032300 ] Apache Spark commented on SPARK-20936: -- User 'zuotingbing' has created a pull reques

[jira] [Updated] (SPARK-20936) Lack of an important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-20936: Summary: Lack of an important case about the test of resolveURI (was: Lack of the most important c

[jira] [Updated] (SPARK-20936) Lack of the most important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-20936: Description: Lack of an important case about the test of resolveURI in UtilsSuite, and add it as n

[jira] [Resolved] (SPARK-20940) AccumulatorV2 should not throw IllegalAccessError

[ https://issues.apache.org/jira/browse/SPARK-20940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20940. -- Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 2.0.3

[jira] [Assigned] (SPARK-20941) Subquery Reuse does not work

[ https://issues.apache.org/jira/browse/SPARK-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20941: Assignee: Apache Spark (was: Xiao Li) > Subquery Reuse does not work > --

[jira] [Commented] (SPARK-20941) Subquery Reuse does not work

[ https://issues.apache.org/jira/browse/SPARK-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032089#comment-16032089 ] Apache Spark commented on SPARK-20941: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-20941) Subquery Reuse does not work

[ https://issues.apache.org/jira/browse/SPARK-20941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20941: Assignee: Xiao Li (was: Apache Spark) > Subquery Reuse does not work > --

[jira] [Created] (SPARK-20941) Subquery Reuse does not work

Xiao Li created SPARK-20941: --- Summary: Subquery Reuse does not work Key: SPARK-20941 URL: https://issues.apache.org/jira/browse/SPARK-20941 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-20940) AccumulatorV2 should not throw IllegalAccessError

[ https://issues.apache.org/jira/browse/SPARK-20940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-20940: - Target Version/s: 2.2.0 > AccumulatorV2 should not throw IllegalAccessError > ---

[jira] [Assigned] (SPARK-20940) AccumulatorV2 should not throw IllegalAccessError

[ https://issues.apache.org/jira/browse/SPARK-20940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20940: Assignee: Shixiong Zhu (was: Apache Spark) > AccumulatorV2 should not throw IllegalAccess

[jira] [Assigned] (SPARK-20940) AccumulatorV2 should not throw IllegalAccessError

[ https://issues.apache.org/jira/browse/SPARK-20940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20940: Assignee: Apache Spark (was: Shixiong Zhu) > AccumulatorV2 should not throw IllegalAccess

[jira] [Commented] (SPARK-20940) AccumulatorV2 should not throw IllegalAccessError

[ https://issues.apache.org/jira/browse/SPARK-20940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031981#comment-16031981 ] Apache Spark commented on SPARK-20940: -- User 'zsxwing' has created a pull request fo

[jira] [Created] (SPARK-20940) AccumulatorV2 should not throw IllegalAccessError

Shixiong Zhu created SPARK-20940: Summary: AccumulatorV2 should not throw IllegalAccessError Key: SPARK-20940 URL: https://issues.apache.org/jira/browse/SPARK-20940 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20939) Do not duplicate user-defined functions while optimizing logical query plans

[ https://issues.apache.org/jira/browse/SPARK-20939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lovasoa updated SPARK-20939: Description: Currently, while optimizing a query plan, spark pushes filters down the query plan tree, so t

[jira] [Updated] (SPARK-20939) Do not duplicate user-defined functions while optimizing logical query plans

[ https://issues.apache.org/jira/browse/SPARK-20939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lovasoa updated SPARK-20939: Description: Currently, while optimizing a query plan, spark pushes filters down the query plan tree, so t

[jira] [Updated] (SPARK-20939) Do not duplicate user-defined functions while optimizing logical query plans

[ https://issues.apache.org/jira/browse/SPARK-20939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lovasoa updated SPARK-20939: Description: Currently, while optimizing a query plan, spark pushes filters down the query plan tree, so t

[jira] [Created] (SPARK-20939) Do not duplicate user-defined functions while optimizing logical query plans

Lovasoa created SPARK-20939: --- Summary: Do not duplicate user-defined functions while optimizing logical query plans Key: SPARK-20939 URL: https://issues.apache.org/jira/browse/SPARK-20939 Project: Spark

[jira] [Updated] (SPARK-17436) dataframe.write sometimes does not keep sorting

[ https://issues.apache.org/jira/browse/SPARK-17436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-17436: -- Target Version/s: (was: 2.1.0) > dataframe.write sometimes does not keep sorting > --

[jira] [Commented] (SPARK-20853) spark.ui.reverseProxy=true leads to hanging communication to master

[ https://issues.apache.org/jira/browse/SPARK-20853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031795#comment-16031795 ] Trevor McKay commented on SPARK-20853: -- I may be seeing a similar issue, fyi. If I

[jira] [Commented] (SPARK-19236) Add createOrReplaceGlobalTempView

[ https://issues.apache.org/jira/browse/SPARK-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031642#comment-16031642 ] Apache Spark commented on SPARK-19236: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20922: Assignee: Apache Spark > Unsafe deserialization in Spark LauncherConnection >

[jira] [Assigned] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20922: Assignee: (was: Apache Spark) > Unsafe deserialization in Spark LauncherConnection > -

[jira] [Commented] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031594#comment-16031594 ] Apache Spark commented on SPARK-20922: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-19732) DataFrame.fillna() does not work for bools in PySpark

[ https://issues.apache.org/jira/browse/SPARK-19732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19732: Assignee: (was: Apache Spark) > DataFrame.fillna() does not work for bools in PySpark

[jira] [Assigned] (SPARK-19732) DataFrame.fillna() does not work for bools in PySpark

[ https://issues.apache.org/jira/browse/SPARK-19732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19732: Assignee: Apache Spark > DataFrame.fillna() does not work for bools in PySpark > -

[jira] [Commented] (SPARK-19732) DataFrame.fillna() does not work for bools in PySpark

[ https://issues.apache.org/jira/browse/SPARK-19732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031421#comment-16031421 ] Apache Spark commented on SPARK-19732: -- User 'rberenguel' has created a pull request

[jira] [Commented] (SPARK-20633) FileFormatWriter wrap the FetchFailedException which breaks job's failover

[ https://issues.apache.org/jira/browse/SPARK-20633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031414#comment-16031414 ] Imran Rashid commented on SPARK-20633: -- This is no longer strictly necessary after S

[jira] [Commented] (SPARK-20925) Out of Memory Issues With org.apache.spark.sql.DataFrameWriter#partitionBy

[ https://issues.apache.org/jira/browse/SPARK-20925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031412#comment-16031412 ] Jeffrey Quinn commented on SPARK-20925: --- Yes you are correct, the iterator seems to

[jira] [Commented] (SPARK-20921) While reading from oracle database, it converts to wrong type.

[ https://issues.apache.org/jira/browse/SPARK-20921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031416#comment-16031416 ] Yuming Wang commented on SPARK-20921: - I'm working on it. > While reading from oracl

[jira] [Assigned] (SPARK-20633) FileFormatWriter wrap the FetchFailedException which breaks job's failover

[ https://issues.apache.org/jira/browse/SPARK-20633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20633: Assignee: Liu Shaohui > FileFormatWriter wrap the FetchFailedException which breaks job's

[jira] [Resolved] (SPARK-20633) FileFormatWriter wrap the FetchFailedException which breaks job's failover

[ https://issues.apache.org/jira/browse/SPARK-20633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20633. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18145 [https://git

[jira] [Assigned] (SPARK-20288) Improve BasicSchedulerIntegrationSuite "multi-stage job"

[ https://issues.apache.org/jira/browse/SPARK-20288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20288: Assignee: Imran Rashid > Improve BasicSchedulerIntegrationSuite "multi-stage job" > --

[jira] [Assigned] (SPARK-20288) Improve BasicSchedulerIntegrationSuite "multi-stage job"

[ https://issues.apache.org/jira/browse/SPARK-20288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20288: Assignee: jin xing (was: Imran Rashid) > Improve BasicSchedulerIntegrationSuite "multi-st

[jira] [Resolved] (SPARK-20288) Improve BasicSchedulerIntegrationSuite "multi-stage job"

[ https://issues.apache.org/jira/browse/SPARK-20288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20288. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17603 [https://git

[jira] [Assigned] (SPARK-20923) TaskMetrics._updatedBlockStatuses uses a lot of memory

[ https://issues.apache.org/jira/browse/SPARK-20923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20923: Assignee: Apache Spark > TaskMetrics._updatedBlockStatuses uses a lot of memory >

[jira] [Assigned] (SPARK-20923) TaskMetrics._updatedBlockStatuses uses a lot of memory

[ https://issues.apache.org/jira/browse/SPARK-20923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20923: Assignee: (was: Apache Spark) > TaskMetrics._updatedBlockStatuses uses a lot of memory

[jira] [Commented] (SPARK-20923) TaskMetrics._updatedBlockStatuses uses a lot of memory

[ https://issues.apache.org/jira/browse/SPARK-20923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031262#comment-16031262 ] Apache Spark commented on SPARK-20923: -- User 'tgravescs' has created a pull request

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031219#comment-16031219 ] Georgi Danov commented on SPARK-19870: -- We hit that bug as well while migrating to s

[jira] [Commented] (SPARK-19606) Support constraints in spark-dispatcher

[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031146#comment-16031146 ] Laurent Hoss commented on SPARK-19606: -- +1 hopefully this PR gets comitter attention

[jira] [Comment Edited] (SPARK-19606) Support constraints in spark-dispatcher

[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031146#comment-16031146 ] Laurent Hoss edited comment on SPARK-19606 at 5/31/17 1:28 PM:

[jira] [Commented] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

[ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031143#comment-16031143 ] Laurent Hoss commented on SPARK-15142: -- +1 to get this solved ! (ps: We are calling

[jira] [Assigned] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20790: - Assignee: David Eis > ALS with implicit feedback ignores negative values > -

[jira] [Resolved] (SPARK-20790) ALS with implicit feedback ignores negative values

[ https://issues.apache.org/jira/browse/SPARK-20790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20790. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 18022 [https://github.co

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031083#comment-16031083 ] Nick Pentreath commented on SPARK-16365: Databricks has also indicated some work

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030997#comment-16030997 ] Nick Pentreath commented on SPARK-16365: [~akrim] thanks for the thoughts and doc

[jira] [Commented] (SPARK-20925) Out of Memory Issues With org.apache.spark.sql.DataFrameWriter#partitionBy

[ https://issues.apache.org/jira/browse/SPARK-20925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030948#comment-16030948 ] Sean Owen commented on SPARK-20925: --- You might be onto something, but, I believe that i

[jira] [Assigned] (SPARK-20938) explain() for datasources implementing CatalystScan does not show pushed predicates correctly

[ https://issues.apache.org/jira/browse/SPARK-20938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20938: Assignee: (was: Apache Spark) > explain() for datasources implementing CatalystScan do

[jira] [Assigned] (SPARK-20938) explain() for datasources implementing CatalystScan does not show pushed predicates correctly

[ https://issues.apache.org/jira/browse/SPARK-20938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20938: Assignee: Apache Spark > explain() for datasources implementing CatalystScan does not show

[jira] [Commented] (SPARK-20938) explain() for datasources implementing CatalystScan does not show pushed predicates correctly

[ https://issues.apache.org/jira/browse/SPARK-20938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030925#comment-16030925 ] Apache Spark commented on SPARK-20938: -- User 'HyukjinKwon' has created a pull reques

[jira] [Updated] (SPARK-20938) explain() for datasources implementing CatalystScan does not show pushed predicates correctly

[ https://issues.apache.org/jira/browse/SPARK-20938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20938: - Description: Actual pushed-down catalyst predicate expressions look not being represented correc

[jira] [Created] (SPARK-20938) explain() for datasources implementing CatalystScan does not show pushed predicates correctly

Hyukjin Kwon created SPARK-20938: Summary: explain() for datasources implementing CatalystScan does not show pushed predicates correctly Key: SPARK-20938 URL: https://issues.apache.org/jira/browse/SPARK-20938

[jira] [Updated] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-20937: Description: As a follow-up to SPARK-20297 (and SPARK-10400) in which {{spark.sql.parquet.

[jira] [Created] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

Jacek Laskowski created SPARK-20937: --- Summary: Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide Key: SPARK-20937 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamingContext.

[ https://issues.apache.org/jira/browse/SPARK-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terence Yim updated SPARK-20935: Summary: A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamingCon

[jira] [Commented] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamContext.

[ https://issues.apache.org/jira/browse/SPARK-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030879#comment-16030879 ] Sean Owen commented on SPARK-20935: --- CC [~tdas] and [~hyukjin.kwon] who touched this co

[jira] [Updated] (SPARK-20936) Lack of the most important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-20936: Description: Lack of the most important case about the test of resolveURI in UtilsSuite, and add i

[jira] [Commented] (SPARK-20703) Add an operator for writing data out

[ https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030854#comment-16030854 ] Apache Spark commented on SPARK-20703: -- User 'viirya' has created a pull request for

[jira] [Updated] (SPARK-20936) Lack of the most important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-20936: Description: Lack of the most important case about the test of resolveURI in UtilsSuite, and add i

[jira] [Resolved] (SPARK-20934) Task is hung at inner join, would work with other kind of joins

[ https://issues.apache.org/jira/browse/SPARK-20934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20934. --- Resolution: Invalid This doesn't provide any information on what you're executing or what is stuck o

[jira] [Created] (SPARK-20936) Lack of the most important case about the test of resolveURI

zuotingbing created SPARK-20936: --- Summary: Lack of the most important case about the test of resolveURI Key: SPARK-20936 URL: https://issues.apache.org/jira/browse/SPARK-20936 Project: Spark I

[jira] [Created] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamContext.

Terence Yim created SPARK-20935: --- Summary: A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamContext. Key: SPARK-20935 URL: https://issues.apache.org/jira/browse/SPARK-20935

[jira] [Updated] (SPARK-20931) ABS Function support string type

[ https://issues.apache.org/jira/browse/SPARK-20931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-20931: Summary: ABS Function support string type (was: Built-in SQL Function - ABS support string type)

[jira] [Commented] (SPARK-20865) caching dataset throws "Queries with streaming sources must be executed with writeStream.start()"

[ https://issues.apache.org/jira/browse/SPARK-20865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030760#comment-16030760 ] Martin Brišiak commented on SPARK-20865: then the exception should be "not suppor

[jira] [Issue Comment Deleted] (SPARK-20865) caching dataset throws "Queries with streaming sources must be executed with writeStream.start()"

[ https://issues.apache.org/jira/browse/SPARK-20865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Brišiak updated SPARK-20865: --- Comment: was deleted (was: then the exception should be "not supported" right? ) > caching d