[jira] [Resolved] (SPARK-9549) minor bug fix in expressions

[ https://issues.apache.org/jira/browse/SPARK-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9549. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 minor bug fix in

[jira] [Resolved] (SPARK-9240) Hybrid aggregate operator using unsafe row

[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9240. Resolution: Fixed Assignee: Yin Huai Fix Version/s: 1.5.0 Hybrid aggregate

[jira] [Assigned] (SPARK-9553) remove the createCode and createStructCode, and replace the usage of them by createStructCode

[ https://issues.apache.org/jira/browse/SPARK-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9553: --- Assignee: (was: Apache Spark) remove the createCode and createStructCode, and replace

[jira] [Assigned] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9552: --- Assignee: (was: Apache Spark) Add force control for killExecutors to avoid false

[jira] [Commented] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651505#comment-14651505 ] Apache Spark commented on SPARK-9552: - User 'GraceH' has created a pull request for

[jira] [Commented] (SPARK-3727) Trees and ensembles: More prediction functionality

[ https://issues.apache.org/jira/browse/SPARK-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651520#comment-14651520 ] Max Kaznady commented on SPARK-3727: I am currently away from the office and will

[jira] [Updated] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

[ https://issues.apache.org/jira/browse/SPARK-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9550: -- Description: This ticket tracks configurations which need to be renamed, deprecated, or have their

[jira] [Commented] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

[ https://issues.apache.org/jira/browse/SPARK-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651612#comment-14651612 ] Sean Owen commented on SPARK-9550: -- https://issues.apache.org/jira/browse/SPARK-9056

[jira] [Created] (SPARK-9554) Turn on in-memory relation partition pruning by default

Cheng Lian created SPARK-9554: - Summary: Turn on in-memory relation partition pruning by default Key: SPARK-9554 URL: https://issues.apache.org/jira/browse/SPARK-9554 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7871) Improve the outputPartitioning for HashOuterJoin(full outer join)

[ https://issues.apache.org/jira/browse/SPARK-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651484#comment-14651484 ] Apache Spark commented on SPARK-7871: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9512) Fix the bug introduced by the pr for SPARK-9251

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9512: --- Assignee: Apache Spark Fix the bug introduced by the pr for SPARK-9251

[jira] [Commented] (SPARK-9512) Fix the bug introduced by the pr for SPARK-9251

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651495#comment-14651495 ] Apache Spark commented on SPARK-9512: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9512) Fix the bug introduced by the pr for SPARK-9251

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9512: --- Assignee: (was: Apache Spark) Fix the bug introduced by the pr for SPARK-9251

[jira] [Assigned] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9552: --- Assignee: Apache Spark Add force control for killExecutors to avoid false killing for those

[jira] [Commented] (SPARK-8839) Thrift Sever will throw `java.util.NoSuchElementException: key not found` exception when many clients connect it

[ https://issues.apache.org/jira/browse/SPARK-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651502#comment-14651502 ] Apache Spark commented on SPARK-8839: - User 'SaintBacchus' has created a pull request

[jira] [Created] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

Jie Huang created SPARK-9552: Summary: Add force control for killExecutors to avoid false killing for those busy executors Key: SPARK-9552 URL: https://issues.apache.org/jira/browse/SPARK-9552 Project:

[jira] [Commented] (SPARK-3727) Trees and ensembles: More prediction functionality

[ https://issues.apache.org/jira/browse/SPARK-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651512#comment-14651512 ] Yanbo Liang commented on SPARK-3727: [~josephkb] 1, What is the definition of

[jira] [Commented] (SPARK-9403) Implement code generation for In / InSet

[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651540#comment-14651540 ] Apache Spark commented on SPARK-9403: - User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-8861) Add basic instrumentation to each SparkPlan operator

[ https://issues.apache.org/jira/browse/SPARK-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651553#comment-14651553 ] Apache Spark commented on SPARK-8861: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-9553) remove the no-longer-necessary createCode and createStructCode, and replace the usage of them by createStructCode

Wenchen Fan created SPARK-9553: -- Summary: remove the no-longer-necessary createCode and createStructCode, and replace the usage of them by createStructCode Key: SPARK-9553 URL:

[jira] [Updated] (SPARK-9553) remove the createCode and createStructCode, and replace the usage of them by createStructCode

[ https://issues.apache.org/jira/browse/SPARK-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9553: --- Summary: remove the createCode and createStructCode, and replace the usage of them by

[jira] [Closed] (SPARK-8873) Support cleaning up shuffle files when using shuffle service in Mesos

[ https://issues.apache.org/jira/browse/SPARK-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8873. Resolution: Fixed Fix Version/s: 1.5.0 Support cleaning up shuffle files when using shuffle service

[jira] [Updated] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5992: - Affects Version/s: (was: 1.4.0) Locality Sensitive Hashing (LSH) for MLlib

[jira] [Updated] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5992: - Target Version/s: 1.6.0 (was: 1.5.0) Locality Sensitive Hashing (LSH) for MLlib

[jira] [Commented] (SPARK-9553) remove the createCode and createStructCode, and replace the usage of them by createStructCode

[ https://issues.apache.org/jira/browse/SPARK-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651559#comment-14651559 ] Apache Spark commented on SPARK-9553: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9553) remove the createCode and createStructCode, and replace the usage of them by createStructCode

[ https://issues.apache.org/jira/browse/SPARK-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9553: --- Assignee: Apache Spark remove the createCode and createStructCode, and replace the usage of

[jira] [Commented] (SPARK-9559) Worker redundancy/failover in spark stand-alone mode

[ https://issues.apache.org/jira/browse/SPARK-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651965#comment-14651965 ] partha bishnu commented on SPARK-9559: -- Hi Yes..I requested 1 executor like I

[jira] [Commented] (SPARK-9559) Worker redundancy/failover in spark stand-alone mode

[ https://issues.apache.org/jira/browse/SPARK-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651968#comment-14651968 ] Sean Owen commented on SPARK-9559: -- total-executor-cores isn't the same as num-executors

[jira] [Created] (SPARK-9569) Spark streaming 1.5.0 testing umbrella

Reynold Xin created SPARK-9569: -- Summary: Spark streaming 1.5.0 testing umbrella Key: SPARK-9569 URL: https://issues.apache.org/jira/browse/SPARK-9569 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-5133) Feature Importance for Random Forests

[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5133: - Shepherd: Yanbo Liang (was: Manish Amde) Feature Importance for Random Forests

[jira] [Commented] (SPARK-8244) string function: find_in_set

[ https://issues.apache.org/jira/browse/SPARK-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652233#comment-14652233 ] Apache Spark commented on SPARK-8244: - User 'davies' has created a pull request for

[jira] [Updated] (SPARK-9131) Python UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9131: --- Summary: Python UDFs change data values (was: UDFs change data values) Python UDFs change data

[jira] [Updated] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8118: --- Target Version/s: 1.6.0 (was: 1.5.0) Turn off noisy log output produced by Parquet 1.7.0

[jira] [Updated] (SPARK-5463) Improve Parquet support (reliability, performance, and error messages)

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5463: --- Target Version/s: 1.6.0 (was: 1.5.0) Improve Parquet support (reliability, performance, and error

[jira] [Resolved] (SPARK-5251) Using `tableIdentifier` in hive metastore

[ https://issues.apache.org/jira/browse/SPARK-5251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5251. - Resolution: Fixed We've refactored this code so I think this is done. Using

[jira] [Updated] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7148: Target Version/s: 1.6.0 (was: 1.5.0) Configure Parquet block size (row group size) for ML

[jira] [Updated] (SPARK-4302) Support fixed precision decimal type in JsonParser

[ https://issues.apache.org/jira/browse/SPARK-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4302: Target Version/s: 1.6.0 (was: 1.5.0) Support fixed precision decimal type in JsonParser

[jira] [Updated] (SPARK-7544) pyspark.sql.types.Row should implement __getitem__

[ https://issues.apache.org/jira/browse/SPARK-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7544: Target Version/s: 1.6.0 (was: 1.5.0) pyspark.sql.types.Row should implement __getitem__

[jira] [Updated] (SPARK-9287) Speedup unit test of Date expressions

[ https://issues.apache.org/jira/browse/SPARK-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9287: Target Version/s: 1.6.0 (was: 1.5.0) Speedup unit test of Date expressions

[jira] [Updated] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9078: Target Version/s: 1.6.0 (was: 1.3.2, 1.4.2, 1.5.0) Use of non-standard LIMIT keyword in

[jira] [Updated] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7505: Target Version/s: 1.6.0 (was: 1.5.0) Update PySpark DataFrame docs: encourage

[jira] [Commented] (SPARK-9568) Spark MLlib 1.5.0 testing umbrella

[ https://issues.apache.org/jira/browse/SPARK-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652290#comment-14652290 ] Sean Owen commented on SPARK-9568: -- I'm just picking on one of these [~rxin] but do these

[jira] [Updated] (SPARK-4684) Add a script to run JDBC server on Windows

[ https://issues.apache.org/jira/browse/SPARK-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4684: Target Version/s: 1.6.0 (was: 1.5.0) Add a script to run JDBC server on Windows

[jira] [Updated] (SPARK-6413) For data source tables, we should provide better output for DESCRIBE FORMATTED

[ https://issues.apache.org/jira/browse/SPARK-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6413: Target Version/s: 1.6.0 (was: 1.5.0) For data source tables, we should provide better

[jira] [Updated] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9557: Target Version/s: 1.6.0 (was: 1.5.0) Refactor ParquetFilterSuite and remove old

[jira] [Updated] (SPARK-6914) DataFrame.withColumn should take metadata

[ https://issues.apache.org/jira/browse/SPARK-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6914: Target Version/s: 1.6.0 (was: 1.5.0) DataFrame.withColumn should take metadata

[jira] [Updated] (SPARK-3147) Implement A/B testing

[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-3147: - Target Version/s: 1.6.0 (was: 1.5.0) Implement A/B testing -

[jira] [Updated] (SPARK-9512) RemoveEvaluationFromSort reorders sort order

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9512: Summary: RemoveEvaluationFromSort reorders sort order (was: Fix the bug introduced by the

[jira] [Resolved] (SPARK-9444) RemoveEvaluationFromSort reorders sort order

[ https://issues.apache.org/jira/browse/SPARK-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9444. - Resolution: Duplicate RemoveEvaluationFromSort reorders sort order

[jira] [Commented] (SPARK-6467) Override QueryPlan.missingInput when necessary and rely on it CheckAnalysis

[ https://issues.apache.org/jira/browse/SPARK-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652305#comment-14652305 ] Michael Armbrust commented on SPARK-6467: - Is this still a problem? Override

[jira] [Updated] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7550: Priority: Blocker (was: Major) Support setting the right schema serde when writing to

[jira] [Created] (SPARK-9567) Setup branch-1.5 testing on Jenkins

Reynold Xin created SPARK-9567: -- Summary: Setup branch-1.5 testing on Jenkins Key: SPARK-9567 URL: https://issues.apache.org/jira/browse/SPARK-9567 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-8735) Expose metrics for runtime memory usage

[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8735: - Priority: Blocker (was: Major) Expose metrics for runtime memory usage

[jira] [Updated] (SPARK-8735) Expose metrics for runtime memory usage

[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8735: - Component/s: SQL Expose metrics for runtime memory usage ---

[jira] [Created] (SPARK-9570) Improvement to spark-submit

Neelesh Srinivas Salian created SPARK-9570: -- Summary: Improvement to spark-submit Key: SPARK-9570 URL: https://issues.apache.org/jira/browse/SPARK-9570 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8122) ParquetRelation.enableLogForwarding() may fail to configure loggers

[ https://issues.apache.org/jira/browse/SPARK-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8122: --- Target Version/s: 1.6.0 ParquetRelation.enableLogForwarding() may fail to configure loggers

[jira] [Updated] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2551: --- Target Version/s: 1.6.0 (was: 1.5.0) Cleanup FilteringParquetRowInputFormat

[jira] [Updated] (SPARK-8602) Shared cached DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8602: Target Version/s: (was: 1.5.0) Shared cached DataFrames

[jira] [Updated] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8288: Issue Type: Improvement (was: Bug) ScalaReflection should also try apply methods defined

[jira] [Updated] (SPARK-5463) Improve Parquet support (reliability, performance, and error messages)

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5463: Issue Type: Improvement (was: Bug) Improve Parquet support (reliability, performance, and

[jira] [Updated] (SPARK-9287) Speedup unit test of Date expressions

[ https://issues.apache.org/jira/browse/SPARK-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9287: Issue Type: Improvement (was: Bug) Speedup unit test of Date expressions

[jira] [Updated] (SPARK-9293) Analysis should detect when set operations are performed on tables with different numbers of columns

[ https://issues.apache.org/jira/browse/SPARK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9293: --- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-8947) Analysis should

[jira] [Resolved] (SPARK-9554) Turn on in-memory relation partition pruning by default

[ https://issues.apache.org/jira/browse/SPARK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9554. Resolution: Fixed Fix Version/s: 1.5.0 Turn on in-memory relation partition pruning by

[jira] [Updated] (SPARK-9554) Turn on in-memory relation partition pruning by default

[ https://issues.apache.org/jira/browse/SPARK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9554: --- Labels: releasenotes (was: ) Turn on in-memory relation partition pruning by default

[jira] [Resolved] (SPARK-8947) Improve expression type coercion, casting checking

[ https://issues.apache.org/jira/browse/SPARK-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8947. - Resolution: Fixed Fix Version/s: 1.5.0 Improve expression type coercion, casting

[jira] [Updated] (SPARK-8144) For PySpark SQL, automatically convert values provided in readwriter options to string

[ https://issues.apache.org/jira/browse/SPARK-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8144: Issue Type: Improvement (was: Bug) For PySpark SQL, automatically convert values provided

[jira] [Updated] (SPARK-9299) percentile and percentile_approx aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9299: Target Version/s: 1.6.0 (was: 1.5.0) percentile and percentile_approx aggregate functions

[jira] [Updated] (SPARK-8382) Improve Analysis Unit test framework

[ https://issues.apache.org/jira/browse/SPARK-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8382: Target Version/s: 1.6.0 (was: 1.5.0) Improve Analysis Unit test framework

[jira] [Updated] (SPARK-9300) histogram_numeric aggregate function

[ https://issues.apache.org/jira/browse/SPARK-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9300: Target Version/s: 1.6.0 (was: 1.5.0) histogram_numeric aggregate function

[jira] [Updated] (SPARK-7119) ScriptTransform doesn't consider the output data type

[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7119: Target Version/s: 1.6.0 (was: 1.5.0) ScriptTransform doesn't consider the output data

[jira] [Updated] (SPARK-9297) covar_pop and covar_samp aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9297: Target Version/s: 1.6.0 (was: 1.5.0) covar_pop and covar_samp aggregate functions

[jira] [Updated] (SPARK-9241) Supporting multiple DISTINCT columns

[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9241: Target Version/s: 1.6.0 (was: 1.5.0) Supporting multiple DISTINCT columns

[jira] [Updated] (SPARK-8036) Ignores files whose name starts with . while enumerating files in HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8036: Target Version/s: 1.6.0 (was: 1.4.2, 1.5.0) Ignores files whose name starts with . while

[jira] [Updated] (SPARK-4561) PySparkSQL's Row.asDict() should convert nested rows to dictionaries

[ https://issues.apache.org/jira/browse/SPARK-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4561: Target Version/s: 1.6.0 (was: 1.5.0) PySparkSQL's Row.asDict() should convert nested rows

[jira] [Updated] (SPARK-8632) Poor Python UDF performance because of RDD caching

[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8632: Target Version/s: 1.6.0 (was: 1.5.0) Poor Python UDF performance because of RDD caching

[jira] [Updated] (SPARK-3863) Cache broadcasted tables and reuse them across queries

[ https://issues.apache.org/jira/browse/SPARK-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3863: Target Version/s: 1.6.0 (was: 1.5.0) Cache broadcasted tables and reuse them across

[jira] [Updated] (SPARK-9455) Remove InternalRow's generic getter (the one without data type)

[ https://issues.apache.org/jira/browse/SPARK-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9455: Target Version/s: 1.6.0 (was: 1.5.0) Remove InternalRow's generic getter (the one without

[jira] [Updated] (SPARK-9392) Dataframe drop should work on unresolved columns

[ https://issues.apache.org/jira/browse/SPARK-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9392: Target Version/s: 1.6.0 (was: 1.5.0) Dataframe drop should work on unresolved columns

[jira] [Updated] (SPARK-9400) Implement code generation for StringLocate

[ https://issues.apache.org/jira/browse/SPARK-9400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9400: Target Version/s: 1.6.0 (was: 1.5.0) Implement code generation for StringLocate

[jira] [Updated] (SPARK-8887) Explicitly define which data types can be used as dynamic partition columns

[ https://issues.apache.org/jira/browse/SPARK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8887: Target Version/s: 1.6.0 (was: 1.5.0) Explicitly define which data types can be used as

[jira] [Updated] (SPARK-4131) Support Writing data into the filesystem from queries

[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4131: Target Version/s: 1.6.0 (was: 1.5.0) Support Writing data into the filesystem from

[jira] [Updated] (SPARK-6795) Avoid reading Parquet footers on driver side when an global arbitrative schema is available

[ https://issues.apache.org/jira/browse/SPARK-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6795: Target Version/s: 1.6.0 (was: 1.5.0) Avoid reading Parquet footers on driver side when an

[jira] [Updated] (SPARK-9450) HashedRelation.get() could return an Iterator[Row] instead of Seq[Row]

[ https://issues.apache.org/jira/browse/SPARK-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9450: Target Version/s: 1.6.0 (was: 1.5.0) HashedRelation.get() could return an Iterator[Row]

[jira] [Updated] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8513: Target Version/s: 1.6.0 (was: 1.5.0) _temporary may be left undeleted when a write job

[jira] [Created] (SPARK-9568) Spark MLlib 1.5.0 testing umbrella

Reynold Xin created SPARK-9568: -- Summary: Spark MLlib 1.5.0 testing umbrella Key: SPARK-9568 URL: https://issues.apache.org/jira/browse/SPARK-9568 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-9570) Improvement to spark-submit

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9570: - Priority: Minor (was: Major) I think this is more specifically about consistently recommending

[jira] [Resolved] (SPARK-8775) Move expression specific type coercion into expression themselves

[ https://issues.apache.org/jira/browse/SPARK-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8775. - Resolution: Won't Fix Move expression specific type coercion into expression themselves

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652289#comment-14652289 ] Michael Armbrust commented on SPARK-9557: - Is this done now? Refactor

[jira] [Resolved] (SPARK-5133) Feature Importance for Random Forests

[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5133. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7838

[jira] [Commented] (SPARK-9568) Spark MLlib 1.5.0 testing umbrella

[ https://issues.apache.org/jira/browse/SPARK-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652313#comment-14652313 ] Reynold Xin commented on SPARK-9568: [~srowen] we have been doing these test umbrellas

[jira] [Closed] (SPARK-9255) SQL codegen fails with value is not a member of TimestampType.this.InternalType

[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9255. -- Resolution: Fixed Fix Version/s: 1.5.0 SQL codegen fails with value is not a member of

[jira] [Commented] (SPARK-9255) SQL codegen fails with value is not a member of TimestampType.this.InternalType

[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652323#comment-14652323 ] Reynold Xin commented on SPARK-9255: Closing this one for now since I believe it's

[jira] [Updated] (SPARK-9218) Falls back to getAllPartitions when getPartitionsByFilter fails

[ https://issues.apache.org/jira/browse/SPARK-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9218: Target Version/s: 1.6.0 (was: 1.5.0) Falls back to getAllPartitions when

[jira] [Updated] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7768: Target Version/s: 1.6.0 (was: 1.5.0) Make user-defined type (UDT) API public

[jira] [Updated] (SPARK-8233) misc function: hash

[ https://issues.apache.org/jira/browse/SPARK-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8233: Target Version/s: 1.6.0 (was: 1.5.0) misc function: hash ---

[jira] [Updated] (SPARK-9272) Persist information of individual partitions when persisting partitioned data source tables to metastore

[ https://issues.apache.org/jira/browse/SPARK-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9272: Target Version/s: 1.6.0 (was: 1.5.0) Persist information of individual partitions when

[jira] [Updated] (SPARK-7200) Tungsten test suites should fail if memory leak is detected

[ https://issues.apache.org/jira/browse/SPARK-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7200: Target Version/s: 1.6.0 (was: 1.5.0) Tungsten test suites should fail if memory leak is

[jira] [Updated] (SPARK-9329) Bring UnsafeRow up to feature parity with other InternalRow implementations

[ https://issues.apache.org/jira/browse/SPARK-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9329: Target Version/s: 1.6.0 (was: 1.5.0) Bring UnsafeRow up to feature parity with other

[jira] [Updated] (SPARK-9301) collect_set and collect_list aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9301: Target Version/s: 1.6.0 (was: 1.5.0) collect_set and collect_list aggregate functions

[jira] [Updated] (SPARK-3865) Dimension table broadcast shouldn't be eager

[ https://issues.apache.org/jira/browse/SPARK-3865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3865: Target Version/s: 1.6.0 (was: 1.5.0) Dimension table broadcast shouldn't be eager

<    1   2   3   4   5   >