[jira] [Commented] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

[ https://issues.apache.org/jira/browse/SPARK-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986884#comment-14986884 ] Charles Yeh commented on SPARK-11218: - Created a pull request

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986939#comment-14986939 ] Sean Owen commented on SPARK-11472: --- I don't believe you can do this in the shell. You are not intended

[jira] [Updated] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Beauvois updated SPARK-11472: Priority: Major (was: Critical) > SparkContext creation error after sc.stop() when Spark

[jira] [Created] (SPARK-11473) R-like summary statistics with intercept for OLS via normal equation solver

Yanbo Liang created SPARK-11473: --- Summary: R-like summary statistics with intercept for OLS via normal equation solver Key: SPARK-11473 URL: https://issues.apache.org/jira/browse/SPARK-11473 Project:

[jira] [Created] (SPARK-11471) Improve the way that we plan shuffled join

Yin Huai created SPARK-11471: Summary: Improve the way that we plan shuffled join Key: SPARK-11471 URL: https://issues.apache.org/jira/browse/SPARK-11471 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-11469) Initial implementation

[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986938#comment-14986938 ] Sean Owen commented on SPARK-11469: --- Retroactively, initial implementation of what? I get that this is

[jira] [Created] (SPARK-11474) Options to jdbc load are lower cased

Stephen Samuel created SPARK-11474: -- Summary: Options to jdbc load are lower cased Key: SPARK-11474 URL: https://issues.apache.org/jira/browse/SPARK-11474 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Beauvois updated SPARK-11472: Description: Spark 1.5.1 has been compiled with the following command : {noformat} mvn

[jira] [Created] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

Pierre Beauvois created SPARK-11472: --- Summary: SparkContext creation error after sc.stop() when Spark is compiled for Hive Key: SPARK-11472 URL: https://issues.apache.org/jira/browse/SPARK-11472

[jira] [Resolved] (SPARK-9859) Aggregation: Determine the number of reducers at runtime

[ https://issues.apache.org/jira/browse/SPARK-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9859. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9276

[jira] [Resolved] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9858. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9276

[jira] [Resolved] (SPARK-9861) Join: Determine the number of reducers used by a shuffle join operator at runtime

[ https://issues.apache.org/jira/browse/SPARK-9861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9861. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9276

[jira] [Closed] (SPARK-11346) Spark EventLog for completed applications

[ https://issues.apache.org/jira/browse/SPARK-11346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Brna closed SPARK-11346. -- Resolution: Fixed > Spark EventLog for completed applications >

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986984#comment-14986984 ] Pierre Beauvois commented on SPARK-11472: - Hi Sean, thanks for you quick reply. Sorry to say

[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986985#comment-14986985 ] Pierre Beauvois commented on SPARK-11472: - Hi Sean, thanks for you quick reply. Sorry to say

[jira] [Issue Comment Deleted] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Beauvois updated SPARK-11472: Comment: was deleted (was: Hi Sean, thanks for you quick reply. Sorry to say that but

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987412#comment-14987412 ] Disha Shrivastava commented on SPARK-5575: -- I wanted to know if anyone is working on distributed

[jira] [Resolved] (SPARK-11256) Mark all Stage/ResultStage/ShuffleMapStage internal state as private.

[ https://issues.apache.org/jira/browse/SPARK-11256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11256. - Resolution: Fixed Fix Version/s: 1.6.0 > Mark all Stage/ResultStage/ShuffleMapStage

[jira] [Updated] (SPARK-2973) Use LocalRelation for all ExecutedCommands, avoid job for take/collect()

[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2973: Target Version/s: (was: 1.6.0) > Use LocalRelation for all ExecutedCommands, avoid job

[jira] [Updated] (SPARK-4131) Support "Writing data into the filesystem from queries"

[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4131: Target Version/s: (was: 1.6.0) > Support "Writing data into the filesystem from queries"

[jira] [Updated] (SPARK-9988) Create local (external) sort operator

[ https://issues.apache.org/jira/browse/SPARK-9988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9988: Target Version/s: (was: 1.6.0) > Create local (external) sort operator >

[jira] [Updated] (SPARK-9989) Create local sort-merge join operator

[ https://issues.apache.org/jira/browse/SPARK-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9989: Target Version/s: (was: 1.6.0) > Create local sort-merge join operator >

[jira] [Updated] (SPARK-9987) Create local aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-9987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9987: Target Version/s: (was: 1.6.0) > Create local aggregate operator >

[jira] [Updated] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9689: Target Version/s: (was: 1.6.0) > Cache doesn't refresh for HadoopFsRelation based table >

[jira] [Commented] (SPARK-11447) Null comparison requires type information but type extraction fails for complex types

[ https://issues.apache.org/jira/browse/SPARK-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987096#comment-14987096 ] Kapil Singh commented on SPARK-11447: - On second look, I seem to have identified the issue. Take a

[jira] [Updated] (SPARK-9879) OOM in LIMIT clause with large number

[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9879: Target Version/s: (was: 1.6.0) > OOM in LIMIT clause with large number >

[jira] [Updated] (SPARK-7549) Support aggregating over nested fields

[ https://issues.apache.org/jira/browse/SPARK-7549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7549: Target Version/s: (was: 1.6.0) > Support aggregating over nested fields >

[jira] [Commented] (SPARK-9697) Project Tungsten (Spark 1.6)

[ https://issues.apache.org/jira/browse/SPARK-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987094#comment-14987094 ] Michael Armbrust commented on SPARK-9697: - [~rxin] can you update this now that we are past code

[jira] [Updated] (SPARK-9860) Join: Determine the join strategy (broadcast join or shuffle join) at runtime

[ https://issues.apache.org/jira/browse/SPARK-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9860: Target Version/s: (was: 1.6.0) > Join: Determine the join strategy (broadcast join or

[jira] [Assigned] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11460: Assignee: Apache Spark > Locality waits should be based on task set creation time, not

[jira] [Updated] (SPARK-11344) ApplicationDescription should be immutable case class

[ https://issues.apache.org/jira/browse/SPARK-11344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11344: -- Assignee: Jacek Lewandowski > ApplicationDescription should be immutable case class >

[jira] [Resolved] (SPARK-11344) ApplicationDescription should be immutable case class

[ https://issues.apache.org/jira/browse/SPARK-11344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11344. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9299

[jira] [Updated] (SPARK-8122) ParquetRelation.enableLogForwarding() may fail to configure loggers

[ https://issues.apache.org/jira/browse/SPARK-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8122: Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-5463) >

[jira] [Resolved] (SPARK-5463) Improve Parquet support (reliability, performance, and error messages)

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5463. - Resolution: Fixed > Improve Parquet support (reliability, performance, and error

[jira] [Updated] (SPARK-5463) Improve Parquet support (reliability, performance, and error messages)

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5463: Assignee: Cheng Lian > Improve Parquet support (reliability, performance, and error

[jira] [Updated] (SPARK-9995) Create local Python evaluation operator

[ https://issues.apache.org/jira/browse/SPARK-9995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9995: Target Version/s: (was: 1.6.0) > Create local Python evaluation operator >

[jira] [Updated] (SPARK-8964) Use Exchange in limit operations (per partition limit -> exchange to one partition -> per partition limit)

[ https://issues.apache.org/jira/browse/SPARK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8964: Target Version/s: (was: 1.6.0) > Use Exchange in limit operations (per partition limit ->

[jira] [Updated] (SPARK-8745) Remove GenerateProjection

[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8745: Target Version/s: (was: 1.6.0) > Remove GenerateProjection > - >

[jira] [Updated] (SPARK-11196) Support for equality and pushdown of filters on some UDTs

[ https://issues.apache.org/jira/browse/SPARK-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11196: - Target Version/s: (was: 1.6.0) > Support for equality and pushdown of filters on some

[jira] [Updated] (SPARK-10818) Query optimization: investigate whether we need a separate optimizer from Spark SQL's

[ https://issues.apache.org/jira/browse/SPARK-10818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10818: - Target Version/s: (was: 1.6.0) > Query optimization: investigate whether we need a

[jira] [Updated] (SPARK-7970) Optimize code for SQL queries fired on Union of RDDs (closure cleaner)

[ https://issues.apache.org/jira/browse/SPARK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7970: Target Version/s: (was: 1.6.0) > Optimize code for SQL queries fired on Union of RDDs

[jira] [Updated] (SPARK-7903) PythonUDT shouldn't get serialized on the Scala side

[ https://issues.apache.org/jira/browse/SPARK-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7903: Target Version/s: (was: 1.6.0) > PythonUDT shouldn't get serialized on the Scala side >

[jira] [Updated] (SPARK-7245) Spearman correlation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7245: Target Version/s: (was: 1.6.0) > Spearman correlation for DataFrames >

[jira] [Updated] (SPARK-10815) API design: data sources and sinks

[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10815: - Target Version/s: (was: 1.6.0) > API design: data sources and sinks >

[jira] [Updated] (SPARK-8144) For PySpark SQL, automatically convert values provided in readwriter options to string

[ https://issues.apache.org/jira/browse/SPARK-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8144: Target Version/s: (was: 1.6.0) > For PySpark SQL, automatically convert values provided

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8108: Target Version/s: 2+ (was: 1.6.0) > Build Hive module by default (i.e. remove -Phive

[jira] [Updated] (SPARK-9372) For a join operator, rows with null equal join key expression can be filtered out early

[ https://issues.apache.org/jira/browse/SPARK-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9372: Target Version/s: (was: 1.6.0) > For a join operator, rows with null equal join key

[jira] [Comment Edited] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987190#comment-14987190 ] melvin mendoza edited comment on SPARK-1867 at 11/3/15 12:33 PM: -

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987190#comment-14987190 ] melvin mendoza commented on SPARK-1867: --- [~srowen] having problem with spark

[jira] [Updated] (SPARK-10297) When save data to a data source table, we should bound the size of a saved file

[ https://issues.apache.org/jira/browse/SPARK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10297: - Target Version/s: (was: 1.6.0) > When save data to a data source table, we should

[jira] [Updated] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9182: Target Version/s: (was: 1.6.0) > filter and groupBy on DataFrames are not passed through

[jira] [Updated] (SPARK-10146) Have an easy way to set data source reader/writer specific confs

[ https://issues.apache.org/jira/browse/SPARK-10146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10146: - Target Version/s: (was: 1.6.0) > Have an easy way to set data source reader/writer

[jira] [Updated] (SPARK-9139) Add backwards-compatibility tests for DataType.fromJson()

[ https://issues.apache.org/jira/browse/SPARK-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9139: Target Version/s: (was: 1.6.0) > Add backwards-compatibility tests for

[jira] [Updated] (SPARK-10343) Consider nullability of expression in codegen

[ https://issues.apache.org/jira/browse/SPARK-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10343: - Target Version/s: (was: 1.6.0) > Consider nullability of expression in codegen >

[jira] [Updated] (SPARK-9431) TimeIntervalType for for time intervals

[ https://issues.apache.org/jira/browse/SPARK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9431: Target Version/s: (was: 1.6.0) > TimeIntervalType for for time intervals >

[jira] [Resolved] (SPARK-9410) Better Multi-User Session Semantics for SQL Context

[ https://issues.apache.org/jira/browse/SPARK-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9410. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 > Better

[jira] [Commented] (SPARK-7492) Convert LocalDataFrame to LocalMatrix

[ https://issues.apache.org/jira/browse/SPARK-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987098#comment-14987098 ] Michael Armbrust commented on SPARK-7492: - Are we still trying to get this in for 1.6? > Convert

[jira] [Assigned] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

[ https://issues.apache.org/jira/browse/SPARK-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11218: Assignee: Apache Spark > `./sbin/start-slave.sh --help` should print out the help message

[jira] [Commented] (SPARK-11218) `./sbin/start-slave.sh --help` should print out the help message

[ https://issues.apache.org/jira/browse/SPARK-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987100#comment-14987100 ] Apache Spark commented on SPARK-11218: -- User 'CharlesYeh' has created a pull request for this issue:

[jira] [Updated] (SPARK-10823) API design: external state management

[ https://issues.apache.org/jira/browse/SPARK-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10823: - Target Version/s: (was: 1.6.0) > API design: external state management >

[jira] [Updated] (SPARK-10819) Logical plan: determine logical operators needed

[ https://issues.apache.org/jira/browse/SPARK-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10819: - Target Version/s: (was: 1.6.0) > Logical plan: determine logical operators needed >

[jira] [Updated] (SPARK-10820) Physical plan: determine physical operators needed

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10820: - Target Version/s: (was: 1.6.0) > Physical plan: determine physical operators needed >

[jira] [Updated] (SPARK-10814) API design: convergence of batch and streaming DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10814: - Target Version/s: (was: 1.6.0) > API design: convergence of batch and streaming

[jira] [Updated] (SPARK-10813) API design: high level class structuring regarding windowed and non-windowed streams

[ https://issues.apache.org/jira/browse/SPARK-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10813: - Target Version/s: (was: 1.6.0) > API design: high level class structuring regarding

[jira] [Updated] (SPARK-10803) Allow users to write and query Parquet user-defined key-value metadata directly

[ https://issues.apache.org/jira/browse/SPARK-10803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10803: - Target Version/s: (was: 1.6.0) > Allow users to write and query Parquet user-defined

[jira] [Updated] (SPARK-10816) API design: window and session specification

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10816: - Target Version/s: (was: 1.6.0) > API design: window and session specification >

[jira] [Updated] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9557: Target Version/s: (was: 1.6.0) > Refactor ParquetFilterSuite and remove old

[jira] [Updated] (SPARK-8682) Range Join for Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-8682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8682: Target Version/s: (was: 1.6.0) > Range Join for Spark SQL > > >

[jira] [Updated] (SPARK-8641) Native Spark Window Functions

[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8641: Target Version/s: (was: 1.6.0) > Native Spark Window Functions >

[jira] [Updated] (SPARK-2870) Thorough schema inference directly on RDDs of Python dictionaries

[ https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2870: Target Version/s: (was: 1.6.0) > Thorough schema inference directly on RDDs of Python

[jira] [Updated] (SPARK-9850) Adaptive execution in Spark

[ https://issues.apache.org/jira/browse/SPARK-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9850: Target Version/s: (was: 1.6.0) > Adaptive execution in Spark >

[jira] [Closed] (SPARK-10270) Add/Replace some Java friendly DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-10270. Resolution: Won't Fix > Add/Replace some Java friendly DataFrame API >

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987046#comment-14987046 ] Daniel Darabos commented on SPARK-1239: --- I can also add some data. I have a ShuffleMapStage with

[jira] [Updated] (SPARK-9701) allow not automatically using HiveContext with spark-shell when hive support built in

[ https://issues.apache.org/jira/browse/SPARK-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9701: Target Version/s: (was: 1.6.0) > allow not automatically using HiveContext with

[jira] [Updated] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9783: Target Version/s: (was: 1.6.0) > Use SqlNewHadoopRDD in JSONRelation to eliminate extra

[jira] [Updated] (SPARK-9876) Upgrade parquet-mr to 1.8.1

[ https://issues.apache.org/jira/browse/SPARK-9876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9876: Target Version/s: (was: 1.6.0) > Upgrade parquet-mr to 1.8.1 >

[jira] [Updated] (SPARK-10621) Audit function names in FunctionRegistry and corresponding method names shown in functions.scala and functions.py

[ https://issues.apache.org/jira/browse/SPARK-10621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10621: - Priority: Critical (was: Major) > Audit function names in FunctionRegistry and

[jira] [Resolved] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10429. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9422

[jira] [Commented] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987113#comment-14987113 ] Apache Spark commented on SPARK-11460: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11460: Assignee: (was: Apache Spark) > Locality waits should be based on task set creation

[jira] [Updated] (SPARK-11412) Support merge schema for ORC

[ https://issues.apache.org/jira/browse/SPARK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11412: - Summary: Support merge schema for ORC (was: mergeSchema option not working for orc

[jira] [Updated] (SPARK-11412) Support merge schema for ORC

[ https://issues.apache.org/jira/browse/SPARK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11412: - Issue Type: New Feature (was: Bug) > Support merge schema for ORC >

[jira] [Updated] (SPARK-9357) Remove JoinedRow

[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9357: Target Version/s: (was: 1.6.0) > Remove JoinedRow > > >

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9487: Target Version/s: (was: 1.6.0) > Use the same num. worker threads in Scala/Python unit

[jira] [Resolved] (SPARK-11436) we should rebind right encoder when join 2 datasets

[ https://issues.apache.org/jira/browse/SPARK-11436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11436. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9391

[jira] [Updated] (SPARK-11436) we should rebind right encoder when join 2 datasets

[ https://issues.apache.org/jira/browse/SPARK-11436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11436: - Assignee: Wenchen Fan > we should rebind right encoder when join 2 datasets >

[jira] [Commented] (SPARK-10681) DateTimeUtils needs a method to parse string to SQL's timestamp value

[ https://issues.apache.org/jira/browse/SPARK-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987067#comment-14987067 ] Michael Armbrust commented on SPARK-10681: -- Can we bump this from 1.6? > DateTimeUtils needs a

[jira] [Updated] (SPARK-9604) Unsafe ArrayData and MapData is very very slow

[ https://issues.apache.org/jira/browse/SPARK-9604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9604: Target Version/s: (was: 1.6.0) > Unsafe ArrayData and MapData is very very slow >

[jira] [Updated] (SPARK-5517) Add input types for Java UDFs

[ https://issues.apache.org/jira/browse/SPARK-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5517: Target Version/s: (was: 1.6.0) > Add input types for Java UDFs >

[jira] [Updated] (SPARK-4366) Aggregation Improvement

[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4366: Target Version/s: (was: 1.6.0) > Aggregation Improvement > --- > >

[jira] [Updated] (SPARK-10129) math function: stddev_samp

[ https://issues.apache.org/jira/browse/SPARK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10129: - Target Version/s: (was: 1.6.0) > math function: stddev_samp >

[jira] [Updated] (SPARK-9218) Falls back to getAllPartitions when getPartitionsByFilter fails

[ https://issues.apache.org/jira/browse/SPARK-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9218: Target Version/s: (was: 1.6.0) > Falls back to getAllPartitions when

[jira] [Updated] (SPARK-3864) Specialize join for tables with unique integer keys

[ https://issues.apache.org/jira/browse/SPARK-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3864: Target Version/s: (was: 1.6.0) > Specialize join for tables with unique integer keys >

[jira] [Updated] (SPARK-3863) Cache broadcasted tables and reuse them across queries

[ https://issues.apache.org/jira/browse/SPARK-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3863: Target Version/s: (was: 1.6.0) > Cache broadcasted tables and reuse them across queries >

[jira] [Commented] (SPARK-6377) Set the number of shuffle partitions for Exchange operator automatically based on the size of input tables and the reduce-side operation.

[ https://issues.apache.org/jira/browse/SPARK-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987104#comment-14987104 ] Michael Armbrust commented on SPARK-6377: - How does this relate to what we have done? Are we

[jira] [Updated] (SPARK-3860) Improve dimension joins

[ https://issues.apache.org/jira/browse/SPARK-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3860: Target Version/s: (was: 1.6.0) > Improve dimension joins > --- > >

[jira] [Updated] (SPARK-11328) Correctly propagate error message in the case of failures when writing parquet

[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11328: - Target Version/s: (was: 1.6.0) > Correctly propagate error message in the case of

[jira] [Updated] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8513: Target Version/s: (was: 1.6.0) > _temporary may be left undeleted when a write job

[jira] [Updated] (SPARK-10345) Flaky test: HiveCompatibilitySuite.nonblock_op_deduplicate

[ https://issues.apache.org/jira/browse/SPARK-10345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10345: - Target Version/s: (was: 1.6.0) > Flaky test:

[jira] [Commented] (SPARK-11412) Support merge schema for ORC

[ https://issues.apache.org/jira/browse/SPARK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987127#comment-14987127 ] Michael Armbrust commented on SPARK-11412: -- This is only currently supported for parquet. >

  1   2   3   4   >