[jira] [Created] (SPARK-29140) Flaky test: org.apache.spark.sql.hive.execution.ObjectHashAggregateSuite.randomized aggregation test - [with partial + unsafe, with distinct] - with grouping keys

Jungtaek Lim created SPARK-29140: Summary: Flaky test: org.apache.spark.sql.hive.execution.ObjectHashAggregateSuite.randomized aggregation test - [with partial + unsafe, with distinct] - with grouping keys Key: SPARK-29140

[jira] [Updated] (SPARK-29139) Flaky test: org.apache.spark.SparkContextSuite.test gpu driver resource files and discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-29139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29139: - Summary: Flaky test: org.apache.spark.SparkContextSuite.test gpu driver resource files and

[jira] [Created] (SPARK-29139) Flaky tests: org.apache.spark.SparkContextSuite.test gpu driver resource files and discovery under local-cluster mode

Jungtaek Lim created SPARK-29139: Summary: Flaky tests: org.apache.spark.SparkContextSuite.test gpu driver resource files and discovery under local-cluster mode Key: SPARK-29139 URL:

[jira] [Updated] (SPARK-29137) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_train_prediction

[ https://issues.apache.org/jira/browse/SPARK-29137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29137: - Environment: (was:

[jira] [Updated] (SPARK-29137) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_train_prediction

[ https://issues.apache.org/jira/browse/SPARK-29137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29137: - Description:

[jira] [Created] (SPARK-29138) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLogisticRegressionWithSGDTests.test_parameter_accuracy

Jungtaek Lim created SPARK-29138: Summary: Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLogisticRegressionWithSGDTests.test_parameter_accuracy Key: SPARK-29138 URL:

[jira] [Created] (SPARK-29137) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_train_prediction

Jungtaek Lim created SPARK-29137: Summary: Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_train_prediction Key: SPARK-29137 URL:

[jira] [Created] (SPARK-29136) Flaky test: Kafka test suites - metadata not propagated

Jungtaek Lim created SPARK-29136: Summary: Flaky test: Kafka test suites - metadata not propagated Key: SPARK-29136 URL: https://issues.apache.org/jira/browse/SPARK-29136 Project: Spark

[jira] [Created] (SPARK-29135) Flaky Test: o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly

Jungtaek Lim created SPARK-29135: Summary: Flaky Test: o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly Key: SPARK-29135 URL:

[jira] [Created] (SPARK-29134) Flaky test: org.apache.spark.sql.execution.SQLExecutionSuite.concurrent query execution with fork-join pool (SPARK-13747)

Jungtaek Lim created SPARK-29134: Summary: Flaky test: org.apache.spark.sql.execution.SQLExecutionSuite.concurrent query execution with fork-join pool (SPARK-13747) Key: SPARK-29134 URL:

[jira] [Created] (SPARK-29133) Flaky test: org.apache.spark.sql.execution.datasources.orc.OrcV1SchemaPruningSuite

Jungtaek Lim created SPARK-29133: Summary: Flaky test: org.apache.spark.sql.execution.datasources.orc.OrcV1SchemaPruningSuite Key: SPARK-29133 URL: https://issues.apache.org/jira/browse/SPARK-29133

[jira] [Created] (SPARK-29132) Flaky test: org.apache.spark.sql.execution.SQLJsonProtocolSuite.SparkListenerSQLExecutionEnd backward compatibility

Jungtaek Lim created SPARK-29132: Summary: Flaky test: org.apache.spark.sql.execution.SQLJsonProtocolSuite.SparkListenerSQLExecutionEnd backward compatibility Key: SPARK-29132 URL:

[jira] [Created] (SPARK-29131) Flaky test: org.apache.spark.sql.execution.datasources.parquet.ParquetV1PartitionDiscoverySuite

Jungtaek Lim created SPARK-29131: Summary: Flaky test: org.apache.spark.sql.execution.datasources.parquet.ParquetV1PartitionDiscoverySuite Key: SPARK-29131 URL: https://issues.apache.org/jira/browse/SPARK-29131

[jira] [Updated] (SPARK-29130) Flay test: org.apache.spark.scheduler.BasicSchedulerIntegrationSuite."multi-stage job"

[ https://issues.apache.org/jira/browse/SPARK-29130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29130: - Component/s: (was: SQL) Spark Core > Flay test: >

[jira] [Created] (SPARK-29130) Flay test: org.apache.spark.scheduler.BasicSchedulerIntegrationSuite."multi-stage job"

Jungtaek Lim created SPARK-29130: Summary: Flay test: org.apache.spark.scheduler.BasicSchedulerIntegrationSuite."multi-stage job" Key: SPARK-29130 URL: https://issues.apache.org/jira/browse/SPARK-29130

[jira] [Created] (SPARK-29129) Flaky test: org.apache.spark.sql.hive.JavaDataFrameSuite

Jungtaek Lim created SPARK-29129: Summary: Flaky test: org.apache.spark.sql.hive.JavaDataFrameSuite Key: SPARK-29129 URL: https://issues.apache.org/jira/browse/SPARK-29129 Project: Spark

[jira] [Updated] (SPARK-29128) Split predicate code in OR expressions

[ https://issues.apache.org/jira/browse/SPARK-29128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29128: - Environment: (was: When I checked if method bytecode size in  {{BenchmarkQueryTest}} 

[jira] [Updated] (SPARK-29128) Split predicate code in OR expressions

[ https://issues.apache.org/jira/browse/SPARK-29128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29128: - Description: When I checked if method bytecode size in  {{BenchmarkQueryTest}} went over

[jira] [Created] (SPARK-29128) Split predicate code in OR expressions

Takeshi Yamamuro created SPARK-29128: Summary: Split predicate code in OR expressions Key: SPARK-29128 URL: https://issues.apache.org/jira/browse/SPARK-29128 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29113) Some annotation errors in ApplicationCache.scala

[ https://issues.apache.org/jira/browse/SPARK-29113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29113. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed at

[jira] [Assigned] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28930: Assignee: Sujith Chacko > Spark DESC FORMATTED TABLENAME information display issues >

[jira] [Resolved] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28930. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25720

[jira] [Commented] (SPARK-28793) Document CREATE FUNCTION in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931996#comment-16931996 ] Sandeep Katta commented on SPARK-28793: --- [~dkbiswal] if you are busy I can handle this > Document

[jira] [Resolved] (SPARK-28143) Missing attribute name in `IN` expressions throws java.lang.UnsupportedOperationException: empty.init

[ https://issues.apache.org/jira/browse/SPARK-28143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28143. -- Resolution: Later > Missing attribute name in `IN` expressions throws >

[jira] [Resolved] (SPARK-21646) Add new type coercion rules to compatible with Hive

[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21646. -- Resolution: Won't Fix > Add new type coercion rules to compatible with Hive >

[jira] [Assigned] (SPARK-29124) Use MurmurHash3 `bytesHash(data, seed)` instead of `bytesHash(data)`

[ https://issues.apache.org/jira/browse/SPARK-29124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29124: Assignee: Dongjoon Hyun > Use MurmurHash3 `bytesHash(data, seed)` instead of

[jira] [Resolved] (SPARK-29124) Use MurmurHash3 `bytesHash(data, seed)` instead of `bytesHash(data)`

[ https://issues.apache.org/jira/browse/SPARK-29124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29124. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25821

[jira] [Created] (SPARK-29127) Support partitioning for DataSource V2 tables in DataFrameWriter.save

Burak Yavuz created SPARK-29127: --- Summary: Support partitioning for DataSource V2 tables in DataFrameWriter.save Key: SPARK-29127 URL: https://issues.apache.org/jira/browse/SPARK-29127 Project: Spark

[jira] [Created] (SPARK-29126) Add usage guide for cogroup Pandas UDF

Bryan Cutler created SPARK-29126: Summary: Add usage guide for cogroup Pandas UDF Key: SPARK-29126 URL: https://issues.apache.org/jira/browse/SPARK-29126 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27463) Support Dataframe Cogroup via Pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-27463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-27463. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24981

[jira] [Assigned] (SPARK-27463) Support Dataframe Cogroup via Pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-27463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-27463: Assignee: Chris Martin > Support Dataframe Cogroup via Pandas UDFs >

[jira] [Resolved] (SPARK-29125) Add Hadoop 2.7 combination to GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-29125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29125. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25824

[jira] [Assigned] (SPARK-29125) Add Hadoop 2.7 combination to GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-29125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29125: - Assignee: Dongjoon Hyun > Add Hadoop 2.7 combination to GitHub Action >

[jira] [Created] (SPARK-29125) Add Hadoop 2.7 combination to GitHub Action

Dongjoon Hyun created SPARK-29125: - Summary: Add Hadoop 2.7 combination to GitHub Action Key: SPARK-29125 URL: https://issues.apache.org/jira/browse/SPARK-29125 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29027) KafkaDelegationTokenSuite fails

[ https://issues.apache.org/jira/browse/SPARK-29027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-29027. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25803

[jira] [Assigned] (SPARK-29027) KafkaDelegationTokenSuite fails

[ https://issues.apache.org/jira/browse/SPARK-29027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-29027: -- Assignee: Gabor Somogyi > KafkaDelegationTokenSuite fails >

[jira] [Resolved] (SPARK-28792) Document CREATE DATABASE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28792. - Fix Version/s: 3.0.0 Resolution: Fixed > Document CREATE DATABASE statement in SQL Reference. >

[jira] [Assigned] (SPARK-28792) Document CREATE DATABASE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28792: --- Assignee: Sharanabasappa G Keriwaddi > Document CREATE DATABASE statement in SQL Reference. >

[jira] [Resolved] (SPARK-28814) Document SET/RESET in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28814. - Fix Version/s: 3.0.0 Resolution: Fixed > Document SET/RESET in SQL Reference. >

[jira] [Assigned] (SPARK-28814) Document SET/RESET in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28814: --- Assignee: Sharanabasappa G Keriwaddi > Document SET/RESET in SQL Reference. >

[jira] [Updated] (SPARK-29124) Use MurmurHash3 `bytesHash(data, seed)` instead of `bytesHash(data)`

[ https://issues.apache.org/jira/browse/SPARK-29124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29124: -- Summary: Use MurmurHash3 `bytesHash(data, seed)` instead of `bytesHash(data)` (was: Use

[jira] [Commented] (SPARK-29122) Propagate all the SQL conf to executors in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931796#comment-16931796 ] Takeshi Yamamuro commented on SPARK-29122: -- ok, I'll look into this today~ > Propagate all the

[jira] [Created] (SPARK-29124) Use `bytesHash(data, seed)` instead of `bytesHash(data)`

Dongjoon Hyun created SPARK-29124: - Summary: Use `bytesHash(data, seed)` instead of `bytesHash(data)` Key: SPARK-29124 URL: https://issues.apache.org/jira/browse/SPARK-29124 Project: Spark

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 7:05 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 7:04 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 7:00 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 7:00 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 6:58 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 6:57 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 6:55 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 6:53 PM: --- okl 

[jira] [Comment Edited] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave edited comment on SPARK-13446 at 9/17/19 6:53 PM: --- okl 

[jira] [Commented] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931751#comment-16931751 ] JP Bordenave commented on SPARK-13446: -- okl  thanks for your help first solution,  i restore all

[jira] [Commented] (SPARK-29116) Refactor py classes related to DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-29116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931715#comment-16931715 ] Huaxin Gao commented on SPARK-29116: Yes, I am happy to work on this. Thanks! [~podongfeng] >

[jira] [Resolved] (SPARK-28950) [SPARK-28351] FollowingUp: Change whereClause to be optional in DELETE

[ https://issues.apache.org/jira/browse/SPARK-28950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28950. - Fix Version/s: 3.0.0 Assignee: Xianyin Xin Resolution: Fixed > [SPARK-28351]

[jira] [Updated] (SPARK-29123) DecimalType multiplication precision loss

[ https://issues.apache.org/jira/browse/SPARK-29123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benny Lu updated SPARK-29123: - Summary: DecimalType multiplication precision loss (was: DecimalType multiplication precision scale

[jira] [Created] (SPARK-29123) DecimalType multiplication precision scale loss

Benny Lu created SPARK-29123: Summary: DecimalType multiplication precision scale loss Key: SPARK-29123 URL: https://issues.apache.org/jira/browse/SPARK-29123 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-29101) CSV datasource returns incorrect .count() from file with malformed records

[ https://issues.apache.org/jira/browse/SPARK-29101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931585#comment-16931585 ] Sandeep Katta commented on SPARK-29101: --- I found the reason, soon I will raise PR for this > CSV

[jira] [Commented] (SPARK-29122) Propagate all the SQL conf to executors in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931582#comment-16931582 ] Gengliang Wang commented on SPARK-29122: [~maropu] Could you help on this one? I met it in the

[jira] [Created] (SPARK-29122) Propagate all the SQL conf to executors in SQLQueryTestSuite

Gengliang Wang created SPARK-29122: -- Summary: Propagate all the SQL conf to executors in SQLQueryTestSuite Key: SPARK-29122 URL: https://issues.apache.org/jira/browse/SPARK-29122 Project: Spark

[jira] [Comment Edited] (SPARK-29051) Spark Application UI search is not working for some fields

[ https://issues.apache.org/jira/browse/SPARK-29051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931548#comment-16931548 ] Aman Omer edited comment on SPARK-29051 at 9/17/19 3:09 PM: cc [~vanzin]

[jira] [Updated] (SPARK-29121) Support Dot Product for Vectors

[ https://issues.apache.org/jira/browse/SPARK-29121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Pisciuneri updated SPARK-29121: --- Fix Version/s: (was: 3.0.0) > Support Dot Product for Vectors >

[jira] [Commented] (SPARK-29051) Spark Application UI search is not working for some fields

[ https://issues.apache.org/jira/browse/SPARK-29051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931548#comment-16931548 ] Aman Omer commented on SPARK-29051: --- cc [~vanzin] > Spark Application UI search is not working for

[jira] [Commented] (SPARK-29051) Spark Application UI search is not working for some fields

[ https://issues.apache.org/jira/browse/SPARK-29051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931530#comment-16931530 ] Sean Owen commented on SPARK-29051: --- I don't know, I think it's because the text is formatted in

[jira] [Commented] (SPARK-29051) Spark Application UI search is not working for some fields

[ https://issues.apache.org/jira/browse/SPARK-29051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931522#comment-16931522 ] Aman Omer commented on SPARK-29051: --- Changes done for History UI performance fix 

[jira] [Created] (SPARK-29121) Support Dot Product for Vectors

Patrick Pisciuneri created SPARK-29121: -- Summary: Support Dot Product for Vectors Key: SPARK-29121 URL: https://issues.apache.org/jira/browse/SPARK-29121 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28929: -- Priority: Trivial (was: Minor) > Spark Logging level should be INFO instead of Debug in Executor

[jira] [Commented] (SPARK-22865) Publish Official Apache Spark Docker images

[ https://issues.apache.org/jira/browse/SPARK-22865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931464#comment-16931464 ] Prashant Sharma commented on SPARK-22865: - Hi, what is the update on this issue? Do we have

[jira] [Commented] (SPARK-22842) Support consuming oauth token and certs through environment variables

[ https://issues.apache.org/jira/browse/SPARK-22842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931462#comment-16931462 ] Prashant Sharma commented on SPARK-22842: - Fabric8 client supports exporting Env vars for

[jira] [Commented] (SPARK-29120) Add create_view.sql

[ https://issues.apache.org/jira/browse/SPARK-29120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931378#comment-16931378 ] Aman Omer commented on SPARK-29120: --- I will work on this. > Add create_view.sql > ---

[jira] [Updated] (SPARK-28264) Revisiting Python / pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28264: -- Priority: Critical (was: Major) > Revisiting Python / pandas UDF > -- >

[jira] [Created] (SPARK-29120) Add create_view.sql

ABHISHEK KUMAR GUPTA created SPARK-29120: Summary: Add create_view.sql Key: SPARK-29120 URL: https://issues.apache.org/jira/browse/SPARK-29120 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-29104) Fix Flaky Test - PipedRDDSuite. stdin_writer_thread_should_be_exited_when_task_is_finished

[ https://issues.apache.org/jira/browse/SPARK-29104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29104. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25808

[jira] [Assigned] (SPARK-29104) Fix Flaky Test - PipedRDDSuite. stdin_writer_thread_should_be_exited_when_task_is_finished

[ https://issues.apache.org/jira/browse/SPARK-29104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29104: Assignee: Dongjoon Hyun > Fix Flaky Test - PipedRDDSuite. >

[jira] [Created] (SPARK-29119) DEFAULT option is not supported in Spark

ABHISHEK KUMAR GUPTA created SPARK-29119: Summary: DEFAULT option is not supported in Spark Key: SPARK-29119 URL: https://issues.apache.org/jira/browse/SPARK-29119 Project: Spark

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931313#comment-16931313 ] Steve Loughran commented on SPARK-6305: --- only log4j CVE AFAIK is 2.x, and then iff you are

[jira] [Updated] (SPARK-29114) Dataset.coalesce(10) throw ChunkFetchFailureException when original Dataset partition size is big

[ https://issues.apache.org/jira/browse/SPARK-29114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhanxiongWang updated SPARK-29114: -- Description: I create a Dataset df with 200 partitions. I applied for 100 executors for my

[jira] [Updated] (SPARK-29114) Dataset.coalesce(10) throw ChunkFetchFailureException when original Dataset partition size is big

[ https://issues.apache.org/jira/browse/SPARK-29114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhanxiongWang updated SPARK-29114: -- Description: I create a Dataset df with 200 partitions. I applied for 100 executors for my

[jira] [Updated] (SPARK-29114) Dataset.coalesce(10) throw ChunkFetchFailureException when original Dataset partition size is big

[ https://issues.apache.org/jira/browse/SPARK-29114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhanxiongWang updated SPARK-29114: -- Summary: Dataset.coalesce(10) throw ChunkFetchFailureException when original Dataset

[jira] [Updated] (SPARK-29118) Avoid redundant computation in GMM.transform && GLR.transform

[ https://issues.apache.org/jira/browse/SPARK-29118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-29118: - Description: In SPARK-27944, the computation for output columns with empty name is skipped.

[jira] [Updated] (SPARK-29118) Avoid redundant computation in GMM.transform && GLR.transform

[ https://issues.apache.org/jira/browse/SPARK-29118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-29118: - Summary: Avoid redundant computation in GMM.transform && GLR.transform (was: Avoid redundant

[jira] [Created] (SPARK-29118) Avoid redundant computation in GMM.transform

zhengruifeng created SPARK-29118: Summary: Avoid redundant computation in GMM.transform Key: SPARK-29118 URL: https://issues.apache.org/jira/browse/SPARK-29118 Project: Spark Issue Type:

[jira] [Created] (SPARK-29117) char data type should support in Spark

ABHISHEK KUMAR GUPTA created SPARK-29117: Summary: char data type should support in Spark Key: SPARK-29117 URL: https://issues.apache.org/jira/browse/SPARK-29117 Project: Spark Issue

[jira] [Updated] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28467: - Description: We ran unit tests on arm64 instance, and there are tests failed due to the

[jira] [Reopened] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reopened SPARK-28467: -- Reopening since it's also occurred from Amplab CI. > Flaky test:

[jira] [Updated] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28467: - Summary: Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under

[jira] [Commented] (SPARK-28467) Tests failed if there are not enough executors up before running

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931189#comment-16931189 ] Jungtaek Lim commented on SPARK-28467: -- Thanks for guiding. I'll reopen this with updating the

[jira] [Commented] (SPARK-29116) Refactor py classes related to DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-29116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931179#comment-16931179 ] zhengruifeng commented on SPARK-29116: -- friendly ping [~huaxingao] , are you willing to work on

[jira] [Created] (SPARK-29116) Refactor py classes related to DecisionTree

zhengruifeng created SPARK-29116: Summary: Refactor py classes related to DecisionTree Key: SPARK-29116 URL: https://issues.apache.org/jira/browse/SPARK-29116 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931160#comment-16931160 ] Dongjoon Hyun commented on SPARK-28929: --- Thank you for your first contribution, [~rakson]. You are

[jira] [Assigned] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28929: - Assignee: Rakesh Raushan > Spark Logging level should be INFO instead of Debug in

[jira] [Resolved] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28929. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25634

[jira] [Created] (SPARK-29115) Add benchmarks for make_date() and make_timestamp()

Maxim Gekk created SPARK-29115: -- Summary: Add benchmarks for make_date() and make_timestamp() Key: SPARK-29115 URL: https://issues.apache.org/jira/browse/SPARK-29115 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-28842) Cleanup the formatting/trailing spaces in resource-managers/kubernetes/integration-tests/README.md

[ https://issues.apache.org/jira/browse/SPARK-28842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28842: --- Comment: was deleted (was: [~holdenk] Can i work on this ..) > Cleanup the

[jira] [Updated] (SPARK-29046) Possible NPE on SQLConf.get when SparkContext is stopping in another thread

[ https://issues.apache.org/jira/browse/SPARK-29046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29046: -- Fix Version/s: 2.4.5 > Possible NPE on SQLConf.get when SparkContext is stopping in another

[jira] [Resolved] (SPARK-29074) Optimize `date_format` for foldable `fmt`

[ https://issues.apache.org/jira/browse/SPARK-29074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29074. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25782

[jira] [Assigned] (SPARK-29074) Optimize `date_format` for foldable `fmt`

[ https://issues.apache.org/jira/browse/SPARK-29074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29074: Assignee: Maxim Gekk > Optimize `date_format` for foldable `fmt` >

[jira] [Resolved] (SPARK-28996) Add tests regarding username of HiveClient

[ https://issues.apache.org/jira/browse/SPARK-28996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28996. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25696

[jira] [Assigned] (SPARK-28996) Add tests regarding username of HiveClient

[ https://issues.apache.org/jira/browse/SPARK-28996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28996: --- Assignee: Jungtaek Lim > Add tests regarding username of HiveClient >

[jira] [Commented] (SPARK-22796) Add multiple column support to PySpark QuantileDiscretizer

[ https://issues.apache.org/jira/browse/SPARK-22796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931125#comment-16931125 ] zhengruifeng commented on SPARK-22796: -- [~huaxingao]  

  1   2   >