[jira] [Commented] (SPARK-19644) Memory leak in Spark Streaming

2017-06-18 Thread Deenbandhu Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053502#comment-16053502 ] Deenbandhu Agarwal commented on SPARK-19644: And the spark cassandra connector is also not

[jira] [Commented] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

2017-06-18 Thread Dayou Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053501#comment-16053501 ] Dayou Zhou commented on SPARK-21101: Hi [~q79969786], thank you kindly for your response. I was not

[jira] [Comment Edited] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

2017-06-18 Thread Dayou Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053501#comment-16053501 ] Dayou Zhou edited comment on SPARK-21101 at 6/19/17 5:54 AM: - Hi

[jira] [Commented] (SPARK-19644) Memory leak in Spark Streaming

2017-06-18 Thread Deenbandhu Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053498#comment-16053498 ] Deenbandhu Agarwal commented on SPARK-19644: yes i can try but is there any report of such

[jira] [Commented] (SPARK-19644) Memory leak in Spark Streaming

2017-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053494#comment-16053494 ] Dongjoon Hyun commented on SPARK-19644: --- Hi, [~deenbandhu]. Could you try this with the latest

[jira] [Comment Edited] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

2017-06-18 Thread Deenbandhu Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053488#comment-16053488 ] Deenbandhu Agarwal edited comment on SPARK-17381 at 6/19/17 5:33 AM: -

[jira] [Commented] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

2017-06-18 Thread Deenbandhu Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053488#comment-16053488 ] Deenbandhu Agarwal commented on SPARK-17381: [~joaomaiaduarte] I am facing a similar kind of

[jira] [Resolved] (SPARK-19824) Standalone master JSON not showing cores for running applications

2017-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19824. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.3.0 Target

[jira] [Commented] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053468#comment-16053468 ] Apache Spark commented on SPARK-20927: -- User 'ZiyueHuang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20927: Assignee: (was: Apache Spark) > Add cache operator to Unsupported Operations in

[jira] [Assigned] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20927: Assignee: Apache Spark > Add cache operator to Unsupported Operations in Structured

[jira] [Updated] (SPARK-21090) Optimize the unified memory manager code

2017-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21090: Fix Version/s: (was: 2.3.0) 2.2.0 > Optimize the unified memory manager

[jira] [Assigned] (SPARK-21090) Optimize the unified memory manager code

2017-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21090: --- Assignee: liuxian > Optimize the unified memory manager code >

[jira] [Resolved] (SPARK-21090) Optimize the unified memory manager code

2017-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21090. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18296

[jira] [Resolved] (SPARK-20948) Built-in SQL Function UnaryMinus/UnaryPositive support string type

2017-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20948. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Built-in SQL Function

[jira] [Commented] (SPARK-21120) Increasing the master's metric is conducive to the spark cluster management system monitoring.

2017-06-18 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053426#comment-16053426 ] guoxiaolongzte commented on SPARK-21120: Sorry, the last two or three days I did not deal with my

[jira] [Commented] (SPARK-21120) Increasing the master's metric is conducive to the spark cluster management system monitoring.

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053424#comment-16053424 ] Apache Spark commented on SPARK-21120: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Updated] (SPARK-21120) Increasing the master's metric is conducive to the spark cluster management system monitoring.

2017-06-18 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21120: --- Attachment: 1.png > Increasing the master's metric is conducive to the spark cluster

[jira] [Updated] (SPARK-21120) Increasing the master's metric is conducive to the spark cluster management system monitoring.

2017-06-18 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21120: --- Description: The current number of master metric is very small, unable to meet the needs of

[jira] [Commented] (SPARK-20599) ConsoleSink should work with write (batch)

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053413#comment-16053413 ] Apache Spark commented on SPARK-20599: -- User 'lubozhan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20599) ConsoleSink should work with write (batch)

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20599: Assignee: Apache Spark > ConsoleSink should work with write (batch) >

[jira] [Assigned] (SPARK-20599) ConsoleSink should work with write (batch)

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20599: Assignee: (was: Apache Spark) > ConsoleSink should work with write (batch) >

[jira] [Assigned] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21134: Assignee: (was: Apache Spark) > Codegen-only expressions should not be collapsed with

[jira] [Commented] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053404#comment-16053404 ] Apache Spark commented on SPARK-21134: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21134: Assignee: Apache Spark > Codegen-only expressions should not be collapsed with upper

[jira] [Created] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

2017-06-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-21134: --- Summary: Codegen-only expressions should not be collapsed with upper CodegenFallback expression Key: SPARK-21134 URL: https://issues.apache.org/jira/browse/SPARK-21134

[jira] [Closed] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

2017-06-18 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] poseidon closed SPARK-20896. Resolution: Fixed Fix Version/s: 1.6.4 Target Version/s: 1.6.2 No a issue > spark

[jira] [Commented] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

2017-06-18 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053386#comment-16053386 ] poseidon commented on SPARK-20896: -- It is related to Zeppelin, so this issue can be closed . > spark

[jira] [Resolved] (SPARK-20892) Add SQL trunc function to SparkR

2017-06-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20892. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20520) R streaming tests failed on Windows

2017-06-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20520. -- Resolution: Cannot Reproduce Fix Version/s: 2.2.0 tested no longer repo on windows with

[jira] [Resolved] (SPARK-21128) Running R tests multiple times failed due to pre-exiting "spark-warehouse" / "metastore_db"

2017-06-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21128. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-15799) Release SparkR on CRAN

2017-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15799: -- Target Version/s: (was: 2.2.0) > Release SparkR on CRAN > -- > >

[jira] [Updated] (SPARK-20520) R streaming tests failed on Windows

2017-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20520: -- Affects Version/s: 2.1.1 Target Version/s: (was: 2.2.0) > R streaming tests failed on Windows >

[jira] [Commented] (SPARK-18267) Distribute PySpark via Python Package Index (pypi)

2017-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053253#comment-16053253 ] Sean Owen commented on SPARK-18267: --- [~holdenk] is all of this basically done? for 2.2? > Distribute

[jira] [Updated] (SPARK-21125) PySpark context missing function to set Job Description.

2017-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21125: -- Target Version/s: (was: 2.2.0) Fix Version/s: (was: 2.2.0) Issue Type:

[jira] [Commented] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

2017-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053145#comment-16053145 ] Yuming Wang commented on SPARK-21101: - [~dyzhou], Can you try to override

[jira] [Assigned] (SPARK-21123) Options for file stream source are in a wrong table

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21123: Assignee: (was: Apache Spark) > Options for file stream source are in a wrong table >

[jira] [Assigned] (SPARK-21123) Options for file stream source are in a wrong table

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21123: Assignee: Apache Spark > Options for file stream source are in a wrong table >

[jira] [Commented] (SPARK-21123) Options for file stream source are in a wrong table

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053125#comment-16053125 ] Apache Spark commented on SPARK-21123: -- User 'assafmendelson' has created a pull request for this

[jira] [Issue Comment Deleted] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

2017-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-21133: Comment: was deleted (was: I'll create a PR later.) > HighlyCompressedMapStatus#writeExternal

[jira] [Assigned] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21133: Assignee: (was: Apache Spark) > HighlyCompressedMapStatus#writeExternal throws NPE >

[jira] [Commented] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053093#comment-16053093 ] Apache Spark commented on SPARK-21133: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

2017-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21133: Assignee: Apache Spark > HighlyCompressedMapStatus#writeExternal throws NPE >

[jira] [Assigned] (SPARK-21126) The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

2017-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21126: - Assignee: liuzhaokun > The configuration which named "spark.core.connection.auth.wait.timeout"

[jira] [Resolved] (SPARK-21126) The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

2017-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21126. --- Resolution: Fixed Fix Version/s: 2.2.1 Issue resolved by pull request 18333

[jira] [Created] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

2017-06-18 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-21133: --- Summary: HighlyCompressedMapStatus#writeExternal throws NPE Key: SPARK-21133 URL: https://issues.apache.org/jira/browse/SPARK-21133 Project: Spark Issue Type:

[jira] [Commented] (SPARK-21133) HighlyCompressedMapStatus#writeExternal throws NPE

2017-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053091#comment-16053091 ] Yuming Wang commented on SPARK-21133: - I'll create a PR later. >