[jira] [Resolved] (SPARK-16757) Set up caller context to HDFS and Yarn

[ https://issues.apache.org/jira/browse/SPARK-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-16757. --- Resolution: Fixed Assignee: Weiqing Yang Fix Version/s: 2.1.0 > Set up

[jira] [Created] (SPARK-17691) Add aggregate function to collect list with maximum number of elements

Assaf Mendelson created SPARK-17691: --- Summary: Add aggregate function to collect list with maximum number of elements Key: SPARK-17691 URL: https://issues.apache.org/jira/browse/SPARK-17691

[jira] [Closed] (SPARK-17407) Unable to update structured stream from CSV

[ https://issues.apache.org/jira/browse/SPARK-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath closed SPARK-17407. -- Resolution: Not A Problem > Unable to update structured stream from CSV >

[jira] [Resolved] (SPARK-17428) SparkR executors/workers support virtualenv

[ https://issues.apache.org/jira/browse/SPARK-17428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-17428. - Resolution: Done Assignee: Yanbo Liang > SparkR executors/workers support virtualenv >

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525924#comment-15525924 ] Venkatakrishna Tirumala commented on SPARK-13747: - Looks like it still exists in 2.0.0?

[jira] [Created] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

Prashant Sharma created SPARK-17689: --- Summary: _temporary files breaks the Spark SQL streaming job. Key: SPARK-17689 URL: https://issues.apache.org/jira/browse/SPARK-17689 Project: Spark

[jira] [Commented] (SPARK-16356) Add testImplicits for ML unit tests and promote toDF()

[ https://issues.apache.org/jira/browse/SPARK-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525810#comment-15525810 ] Apache Spark commented on SPARK-16356: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-16292) Failed to create spark client

[ https://issues.apache.org/jira/browse/SPARK-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525855#comment-15525855 ] Alpha commented on SPARK-16292: --- Hi Arcflash ， I also face this problem, could you tell me the solution??

[jira] [Created] (SPARK-17690) Mini dfs cluster based HDFS tests for FileStreamSourceSuite.

Prashant Sharma created SPARK-17690: --- Summary: Mini dfs cluster based HDFS tests for FileStreamSourceSuite. Key: SPARK-17690 URL: https://issues.apache.org/jira/browse/SPARK-17690 Project: Spark

[jira] [Updated] (SPARK-17688) xception in thread "main" java.lang.NoSuchMethodError: javax.servlet.ServletContext.getInitParameter(Ljava/lang/String;)Ljava/lang/String;

[ https://issues.apache.org/jira/browse/SPARK-17688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishore K updated SPARK-17688: -- Description: SparkConf conf = new

[jira] [Commented] (SPARK-16292) Failed to create spark client

[ https://issues.apache.org/jira/browse/SPARK-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525854#comment-15525854 ] Alpha commented on SPARK-16292: --- Hi Arcflash ， I also face this problem, could you tell me the solution??

[jira] [Issue Comment Deleted] (SPARK-16292) Failed to create spark client

[ https://issues.apache.org/jira/browse/SPARK-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alpha updated SPARK-16292: -- Comment: was deleted (was: Hi Arcflash ， I also face this problem, could you tell me the solution?? thank

[jira] [Assigned] (SPARK-17690) Mini dfs cluster based HDFS tests for FileStreamSourceSuite.

[ https://issues.apache.org/jira/browse/SPARK-17690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17690: Assignee: Apache Spark > Mini dfs cluster based HDFS tests for FileStreamSourceSuite. >

[jira] [Assigned] (SPARK-17690) Mini dfs cluster based HDFS tests for FileStreamSourceSuite.

[ https://issues.apache.org/jira/browse/SPARK-17690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17690: Assignee: (was: Apache Spark) > Mini dfs cluster based HDFS tests for

[jira] [Assigned] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

[ https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17689: Assignee: Apache Spark > _temporary files breaks the Spark SQL streaming job. >

[jira] [Commented] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

[ https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525759#comment-15525759 ] Apache Spark commented on SPARK-17689: -- User 'ScrapCodes' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

[ https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17689: Assignee: (was: Apache Spark) > _temporary files breaks the Spark SQL streaming job.

[jira] [Assigned] (SPARK-17685) WholeStageCodegenExec throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-17685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17685: Assignee: Apache Spark > WholeStageCodegenExec throws IndexOutOfBoundsException >

[jira] [Assigned] (SPARK-17685) WholeStageCodegenExec throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-17685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17685: Assignee: (was: Apache Spark) > WholeStageCodegenExec throws

[jira] [Commented] (SPARK-17685) WholeStageCodegenExec throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-17685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525796#comment-15525796 ] Apache Spark commented on SPARK-17685: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-17690) Mini dfs cluster based HDFS tests for FileStreamSourceSuite.

[ https://issues.apache.org/jira/browse/SPARK-17690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525948#comment-15525948 ] Apache Spark commented on SPARK-17690: -- User 'ScrapCodes' has created a pull request for this issue:

[jira] [Updated] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

[ https://issues.apache.org/jira/browse/SPARK-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-17696: --- Description: There's a race in the shutdown path of CoarseGrainedExecutorBackend that may

[jira] [Updated] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

[ https://issues.apache.org/jira/browse/SPARK-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-17696: --- Affects Version/s: (was: 2.0.0) > Race in CoarseGrainedExecutorBackend shutdown can lead

[jira] [Commented] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

[ https://issues.apache.org/jira/browse/SPARK-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527600#comment-15527600 ] Marcelo Vanzin commented on SPARK-17696: This is actually fixed in 2.0 by SPARK-12330 (I was

[jira] [Commented] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528038#comment-15528038 ] Apache Spark commented on SPARK-17666: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528145#comment-15528145 ] Eric Liang commented on SPARK-17673: Russell, could you try applying this patch (wip) to see if it

[jira] [Commented] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528228#comment-15528228 ] zhangxinyu commented on SPARK-17631: The pr is still open. I want to discuss it with someone who

[jira] [Assigned] (SPARK-17702) Code generation including too many mutable states exceeds JVM size limit.

[ https://issues.apache.org/jira/browse/SPARK-17702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17702: Assignee: Apache Spark > Code generation including too many mutable states exceeds JVM

[jira] [Assigned] (SPARK-17702) Code generation including too many mutable states exceeds JVM size limit.

[ https://issues.apache.org/jira/browse/SPARK-17702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17702: Assignee: (was: Apache Spark) > Code generation including too many mutable states

[jira] [Commented] (SPARK-17702) Code generation including too many mutable states exceeds JVM size limit.

[ https://issues.apache.org/jira/browse/SPARK-17702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528350#comment-15528350 ] Apache Spark commented on SPARK-17702: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528403#comment-15528403 ] Frederick Reiss commented on SPARK-17631: - I can think of two use cases where one might want to

[jira] [Created] (SPARK-17701) Refactor DataSourceScanExec so its sameResult call does not compare strings

Eric Liang created SPARK-17701: -- Summary: Refactor DataSourceScanExec so its sameResult call does not compare strings Key: SPARK-17701 URL: https://issues.apache.org/jira/browse/SPARK-17701 Project:

[jira] [Updated] (SPARK-17701) Refactor DataSourceScanExec so its sameResult call does not compare strings

[ https://issues.apache.org/jira/browse/SPARK-17701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-17701: --- Component/s: SQL > Refactor DataSourceScanExec so its sameResult call does not compare strings >

[jira] [Updated] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Description: Streaming query results can be sinked to http server through http post request was:

[jira] [Commented] (SPARK-17694) convert DataFrame to DataSet should check columns match

[ https://issues.apache.org/jira/browse/SPARK-17694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528295#comment-15528295 ] Hyukjin Kwon commented on SPARK-17694: -- FWIW, this reminds me of SPARK-15918 > convert DataFrame to

[jira] [Created] (SPARK-17702) Code generation including too many mutable states exceeds JVM size limit.

Takuya Ueshin created SPARK-17702: - Summary: Code generation including too many mutable states exceeds JVM size limit. Key: SPARK-17702 URL: https://issues.apache.org/jira/browse/SPARK-17702 Project:

[jira] [Commented] (SPARK-14301) Java examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527702#comment-15527702 ] Sean Owen commented on SPARK-14301: --- It's an example; this is OK. > Java examples code merge and clean

[jira] [Commented] (SPARK-17695) Deserialization error when using DataFrameReader.json on JSON line that contains an empty JSON object

[ https://issues.apache.org/jira/browse/SPARK-17695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527900#comment-15527900 ] Hyukjin Kwon commented on SPARK-17695: -- Related with SPARK-8093. It seems empty struct type is not

[jira] [Created] (SPARK-17697) BinaryLogisticRegressionSummary should handle non-Double numeric types

Joseph K. Bradley created SPARK-17697: - Summary: BinaryLogisticRegressionSummary should handle non-Double numeric types Key: SPARK-17697 URL: https://issues.apache.org/jira/browse/SPARK-17697

[jira] [Assigned] (SPARK-17698) Join predicates should not contain filter clauses

[ https://issues.apache.org/jira/browse/SPARK-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17698: Assignee: (was: Apache Spark) > Join predicates should not contain filter clauses >

[jira] [Assigned] (SPARK-17698) Join predicates should not contain filter clauses

[ https://issues.apache.org/jira/browse/SPARK-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17698: Assignee: Apache Spark > Join predicates should not contain filter clauses >

[jira] [Commented] (SPARK-17698) Join predicates should not contain filter clauses

[ https://issues.apache.org/jira/browse/SPARK-17698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528057#comment-15528057 ] Apache Spark commented on SPARK-17698: -- User 'tejasapatil' has created a pull request for this

[jira] [Created] (SPARK-17699) from_json function for parsing json Strings into Structs

Michael Armbrust created SPARK-17699: Summary: from_json function for parsing json Strings into Structs Key: SPARK-17699 URL: https://issues.apache.org/jira/browse/SPARK-17699 Project: Spark

[jira] [Created] (SPARK-17695) Deserialization error when using DataFrameReader.json on JSON line that contains an empty JSON object

Jonathan Simozar created SPARK-17695: Summary: Deserialization error when using DataFrameReader.json on JSON line that contains an empty JSON object Key: SPARK-17695 URL:

[jira] [Resolved] (SPARK-17687) Structured Streaming - Does anyone need kafka sink

[ https://issues.apache.org/jira/browse/SPARK-17687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17687. --- Resolution: Invalid This sounds like a question for user@ > Structured Streaming - Does anyone need

[jira] [Resolved] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17631. --- Resolution: Invalid Not sure what's going on with this, because it sounds like a question for

[jira] [Commented] (SPARK-17694) convert DataFrame to DataSet should check columns match

[ https://issues.apache.org/jira/browse/SPARK-17694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527887#comment-15527887 ] Chenliang Xu commented on SPARK-17694: -- It returns a DataSet, for example {noformat}

[jira] [Comment Edited] (SPARK-17694) convert DataFrame to DataSet should check columns match

[ https://issues.apache.org/jira/browse/SPARK-17694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527887#comment-15527887 ] Chenliang Xu edited comment on SPARK-17694 at 9/28/16 12:20 AM: It

[jira] [Created] (SPARK-17700) org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create spark client

Alpha created SPARK-17700: - Summary: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create spark client Key: SPARK-17700 URL: https://issues.apache.org/jira/browse/SPARK-17700 Project: Spark

[jira] [Assigned] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

[ https://issues.apache.org/jira/browse/SPARK-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17696: Assignee: (was: Apache Spark) > Race in CoarseGrainedExecutorBackend shutdown can

[jira] [Commented] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

[ https://issues.apache.org/jira/browse/SPARK-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527698#comment-15527698 ] Apache Spark commented on SPARK-12330: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

[ https://issues.apache.org/jira/browse/SPARK-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17696: Assignee: Apache Spark > Race in CoarseGrainedExecutorBackend shutdown can lead to wrong

[jira] [Commented] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

[ https://issues.apache.org/jira/browse/SPARK-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527696#comment-15527696 ] Apache Spark commented on SPARK-17696: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528142#comment-15528142 ] Apache Spark commented on SPARK-17673: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17673: Assignee: (was: Apache Spark) > Reused Exchange Aggregations Produce Incorrect

[jira] [Assigned] (SPARK-17673) Reused Exchange Aggregations Produce Incorrect Results

[ https://issues.apache.org/jira/browse/SPARK-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17673: Assignee: Apache Spark > Reused Exchange Aggregations Produce Incorrect Results >

[jira] [Assigned] (SPARK-17699) from_json function for parsing json Strings into Structs

[ https://issues.apache.org/jira/browse/SPARK-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17699: Assignee: Apache Spark (was: Michael Armbrust) > from_json function for parsing json

[jira] [Commented] (SPARK-14301) Java examples code merge and clean up

[ https://issues.apache.org/jira/browse/SPARK-14301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527557#comment-15527557 ] Suman Somasundar commented on SPARK-14301: -- This merge removed the generic JavaKMeans.java code

[jira] [Resolved] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17666. - Resolution: Fixed Fix Version/s: 2.1.0 > take() or isEmpty() on dataset leaks s3a

[jira] [Commented] (SPARK-17666) take() or isEmpty() on dataset leaks s3a connections

[ https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527994#comment-15527994 ] Reynold Xin commented on SPARK-17666: - This still needs to be backported to branch-2.0. > take() or

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528029#comment-15528029 ] Dongjoon Hyun commented on SPARK-17549: --- Hi, All. Could we add this into RC4 or remove `2.0.1` from

[jira] [Commented] (SPARK-17699) from_json function for parsing json Strings into Structs

[ https://issues.apache.org/jira/browse/SPARK-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528201#comment-15528201 ] Apache Spark commented on SPARK-17699: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17699) from_json function for parsing json Strings into Structs

[ https://issues.apache.org/jira/browse/SPARK-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17699: Assignee: Michael Armbrust (was: Apache Spark) > from_json function for parsing json

[jira] [Created] (SPARK-17694) convert DataFrame to DataSet should check columns match

Chenliang Xu created SPARK-17694: Summary: convert DataFrame to DataSet should check columns match Key: SPARK-17694 URL: https://issues.apache.org/jira/browse/SPARK-17694 Project: Spark

[jira] [Commented] (SPARK-17694) convert DataFrame to DataSet should check columns match

[ https://issues.apache.org/jira/browse/SPARK-17694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527653#comment-15527653 ] Sean Owen commented on SPARK-17694: --- Here what do you mean that it succeeds? it's a lazy transformation

[jira] [Updated] (SPARK-17056) Fix a wrong assert in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17056: --- Component/s: (was: Spark Core) Block Manager > Fix a wrong assert in

[jira] [Updated] (SPARK-17056) Fix a wrong assert in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17056: --- Assignee: Liang-Chi Hsieh > Fix a wrong assert in MemoryStore > - >

[jira] [Resolved] (SPARK-17056) Fix a wrong assert in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17056. Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 Issue resolved by pull

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528040#comment-15528040 ] Dongjoon Hyun commented on SPARK-17549: --- Thank you, [~vanzin]! > InMemoryRelation doesn't scale to

[jira] [Created] (SPARK-17696) Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status

Marcelo Vanzin created SPARK-17696: -- Summary: Race in CoarseGrainedExecutorBackend shutdown can lead to wrong exit status Key: SPARK-17696 URL: https://issues.apache.org/jira/browse/SPARK-17696

[jira] [Created] (SPARK-17698) Join predicates should not contain filter clauses

Tejas Patil created SPARK-17698: --- Summary: Join predicates should not contain filter clauses Key: SPARK-17698 URL: https://issues.apache.org/jira/browse/SPARK-17698 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-17549: --- Fix Version/s: (was: 2.0.1) > InMemoryRelation doesn't scale to large tables >

[jira] [Updated] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-17549: --- Fix Version/s: (was: 2.1.0) > InMemoryRelation doesn't scale to large tables >

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528035#comment-15528035 ] Marcelo Vanzin commented on SPARK-17549: Done. Forgot to update the bug after the patch was

[jira] [Created] (SPARK-17686) Propose to print Scala version in "spark-submit --version" command

Saisai Shao created SPARK-17686: --- Summary: Propose to print Scala version in "spark-submit --version" command Key: SPARK-17686 URL: https://issues.apache.org/jira/browse/SPARK-17686 Project: Spark

[jira] [Updated] (SPARK-17631) Structured Streaming - Do we need to output results through http API?

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Summary: Structured Streaming - Do we need to output results through http API? (was: Structured

[jira] [Updated] (SPARK-17631) Structured Streaming - Do we need to output result through http API?

[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxinyu updated SPARK-17631: --- Summary: Structured Streaming - Do we need to output result through http API? (was: Structured

[jira] [Assigned] (SPARK-17667) Make locking fine grained in YarnAllocator#enqueueGetLossReasonRequest

[ https://issues.apache.org/jira/browse/SPARK-17667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17667: Assignee: Apache Spark > Make locking fine grained in

[jira] [Updated] (SPARK-17154) Wrong result can be returned or AnalysisException can be thrown after self-join or similar operations

[ https://issues.apache.org/jira/browse/SPARK-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-17154: Attachment: Name-conflicts-2.pdf @nsyca's alternative proposal to the solution >

[jira] [Commented] (SPARK-17667) Make locking fine grained in YarnAllocator#enqueueGetLossReasonRequest

[ https://issues.apache.org/jira/browse/SPARK-17667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527128#comment-15527128 ] Apache Spark commented on SPARK-17667: -- User 'ashwinshankar77' has created a pull request for this

[jira] [Assigned] (SPARK-17598) User-friendly name for Spark Thrift Server in web UI

[ https://issues.apache.org/jira/browse/SPARK-17598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17598: Assignee: (was: Apache Spark) > User-friendly name for Spark Thrift Server in web UI

[jira] [Assigned] (SPARK-17598) User-friendly name for Spark Thrift Server in web UI

[ https://issues.apache.org/jira/browse/SPARK-17598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17598: Assignee: Apache Spark > User-friendly name for Spark Thrift Server in web UI >

[jira] [Commented] (SPARK-17598) User-friendly name for Spark Thrift Server in web UI

[ https://issues.apache.org/jira/browse/SPARK-17598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527167#comment-15527167 ] Apache Spark commented on SPARK-17598: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Resolved] (SPARK-16777) Parquet schema converter depends on deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16777. Resolution: Fixed Fix Version/s: (was: 2.0.2) (was: 2.1.0)

[jira] [Updated] (SPARK-16777) Parquet schema converter depends on deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16777: --- Fix Version/s: 2.1.0 2.0.2 > Parquet schema converter depends on deprecated APIs

[jira] [Updated] (SPARK-16516) Support for pushing down filters for decimal and timestamp types in ORC

[ https://issues.apache.org/jira/browse/SPARK-16516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16516: --- Fix Version/s: 2.1.0 > Support for pushing down filters for decimal and timestamp types in ORC >

[jira] [Updated] (SPARK-16516) Support for pushing down filters for decimal and timestamp types in ORC

[ https://issues.apache.org/jira/browse/SPARK-16516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16516: --- Assignee: Hyukjin Kwon > Support for pushing down filters for decimal and timestamp types in ORC >

[jira] [Updated] (SPARK-16777) Parquet schema converter depends on deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16777: --- Assignee: Hyukjin Kwon > Parquet schema converter depends on deprecated APIs >

[jira] [Updated] (SPARK-16777) Parquet schema converter depends on deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16777: --- Fix Version/s: (was: 2.2.0) 2.1.0 > Parquet schema converter depends on

[jira] [Updated] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17692: Description: This JIRA records behavior changes of ML/MLlib between 2.0 and 2.1, so we can note

[jira] [Commented] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526510#comment-15526510 ] Yanbo Liang commented on SPARK-17692: - cc [~mengxr] [~josephkb] [~dbtsai] [~mlnick] [~srowen] >

[jira] [Resolved] (SPARK-16516) Support for pushing down filters for decimal and timestamp types in ORC

[ https://issues.apache.org/jira/browse/SPARK-16516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16516. Resolution: Fixed Issue resolved by pull request 14172

[jira] [Updated] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17692: Description: This JIRA records behavior changes of ML/MLlib between 2.0 and 2.1, so we can note

[jira] [Updated] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17692: Labels: 2.1.0 (was: ) > Document ML/MLlib behavior changes in Spark 2.1 >

[jira] [Commented] (SPARK-17649) Log how many Spark events got dropped in LiveListenerBus

[ https://issues.apache.org/jira/browse/SPARK-17649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526426#comment-15526426 ] Dhruve Ashar commented on SPARK-17649: -- [~zsxwing] Since we are logging the drop event count, it

[jira] [Commented] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526449#comment-15526449 ] Apache Spark commented on SPARK-14525: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17692: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.1. So we can remember to

[jira] [Created] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

Yanbo Liang created SPARK-17692: --- Summary: Document ML/MLlib behavior changes in Spark 2.1 Key: SPARK-17692 URL: https://issues.apache.org/jira/browse/SPARK-17692 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17692: Description: This JIRA records behavior changes of ML/MLlib between 2.0 and 2.1, so we can note

[jira] [Resolved] (SPARK-15962) Introduce additonal implementation with a dense format for UnsafeArrayData

[ https://issues.apache.org/jira/browse/SPARK-15962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15962. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 13680

  1   2   >