[jira] [Resolved] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25626. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0 > HiveClientSuites:

[jira] [Updated] (SPARK-20845) Support specification of column names in INSERT INTO

[ https://issues.apache.org/jira/browse/SPARK-20845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20845: Target Version/s: 3.0.0 > Support specification of column names in INSERT INTO >

[jira] [Created] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

Xiao Li created SPARK-25655: --- Summary: Add Pspark-ganglia-lgpl to the scala style check Key: SPARK-25655 URL: https://issues.apache.org/jira/browse/SPARK-25655 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-25606) DateExpressionsSuite: Hour 1 min

[ https://issues.apache.org/jira/browse/SPARK-25606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25606. - Resolution: Fixed Fix Version/s: 3.0.0 > DateExpressionsSuite: Hour 1 min >

[jira] [Resolved] (SPARK-25609) DataFrameSuite: SPARK-22226: splitExpressions should not generate codes beyond 64KB 49 seconds

[ https://issues.apache.org/jira/browse/SPARK-25609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25609. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 3.0.0 > DataFrameSuite:

[jira] [Resolved] (SPARK-25605) CastSuite: cast string to timestamp 2 mins 31 sec

[ https://issues.apache.org/jira/browse/SPARK-25605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25605. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 3.0.0 > CastSuite: cast string

[jira] [Assigned] (SPARK-25606) DateExpressionsSuite: Hour 1 min

[ https://issues.apache.org/jira/browse/SPARK-25606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25606: --- Assignee: Yuming Wang > DateExpressionsSuite: Hour 1 min > > >

[jira] [Created] (SPARK-25632) KafkaRDDSuite: compacted topic 2 min 5 sec.

Xiao Li created SPARK-25632: --- Summary: KafkaRDDSuite: compacted topic 2 min 5 sec. Key: SPARK-25632 URL: https://issues.apache.org/jira/browse/SPARK-25632 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25631) KafkaRDDSuite: basic usage 2 min 4 sec

Xiao Li created SPARK-25631: --- Summary: KafkaRDDSuite: basic usage2 min 4 sec Key: SPARK-25631 URL: https://issues.apache.org/jira/browse/SPARK-25631 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

Xiao Li created SPARK-25630: --- Summary: HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec Key: SPARK-25630 URL: https://issues.apache.org/jira/browse/SPARK-25630

[jira] [Created] (SPARK-25629) ParquetFilterSuite: filter pushdown - decimal 16 sec

Xiao Li created SPARK-25629: --- Summary: ParquetFilterSuite: filter pushdown - decimal 16 sec Key: SPARK-25629 URL: https://issues.apache.org/jira/browse/SPARK-25629 Project: Spark Issue Type:

[jira] [Created] (SPARK-25628) DistributedSuite: recover from repeated node failures during shuffle-reduce 40 seconds

Xiao Li created SPARK-25628: --- Summary: DistributedSuite: recover from repeated node failures during shuffle-reduce 40 seconds Key: SPARK-25628 URL: https://issues.apache.org/jira/browse/SPARK-25628

[jira] [Created] (SPARK-25627) ContinuousStressSuite - 8 mins 13 sec

Xiao Li created SPARK-25627: --- Summary: ContinuousStressSuite - 8 mins 13 sec Key: SPARK-25627 URL: https://issues.apache.org/jira/browse/SPARK-25627 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

Xiao Li created SPARK-25626: --- Summary: HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec Key: SPARK-25626 URL:

[jira] [Created] (SPARK-25625) LogisticRegressionSuite.binary logistic regression with intercept with ElasticNet regularization - 33 sec

Xiao Li created SPARK-25625: --- Summary: LogisticRegressionSuite.binary logistic regression with intercept with ElasticNet regularization - 33 sec Key: SPARK-25625 URL: https://issues.apache.org/jira/browse/SPARK-25625

[jira] [Created] (SPARK-25624) LogisticRegressionSuite.multinomial logistic regression with intercept with elasticnet regularization 56 seconds

Xiao Li created SPARK-25624: --- Summary: LogisticRegressionSuite.multinomial logistic regression with intercept with elasticnet regularization 56 seconds Key: SPARK-25624 URL:

[jira] [Created] (SPARK-25623) LogisticRegressionSuite: multinomial logistic regression with intercept with L1 regularization 1 min 10 sec

Xiao Li created SPARK-25623: --- Summary: LogisticRegressionSuite: multinomial logistic regression with intercept with L1 regularization 1 min 10 sec Key: SPARK-25623 URL: https://issues.apache.org/jira/browse/SPARK-25623

[jira] [Created] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

Xiao Li created SPARK-25622: --- Summary: BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds Key: SPARK-25622 URL:

[jira] [Created] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

Xiao Li created SPARK-25621: --- Summary: BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec Key: SPARK-25621 URL: https://issues.apache.org/jira/browse/SPARK-25621

[jira] [Updated] (SPARK-25619) WithAggregationKinesisStreamSuite: split and merge shards in a stream 2 min 15 sec

[ https://issues.apache.org/jira/browse/SPARK-25619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25619: Description: org.apache.spark.streaming.kinesis.WithAggregationKinesisStreamSuite.split and merge shards

[jira] [Updated] (SPARK-25620) WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds

[ https://issues.apache.org/jira/browse/SPARK-25620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25620: Description: org.apache.spark.streaming.kinesis.WithAggregationKinesisStreamSuite.failure recovery Took

[jira] [Created] (SPARK-25620) WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds

Xiao Li created SPARK-25620: --- Summary: WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds Key: SPARK-25620 URL: https://issues.apache.org/jira/browse/SPARK-25620 Project: Spark

[jira] [Created] (SPARK-25619) WithAggregationKinesisStreamSuite: split and merge shards in a stream 2 min 15 sec

Xiao Li created SPARK-25619: --- Summary: WithAggregationKinesisStreamSuite: split and merge shards in a stream 2 min 15 sec Key: SPARK-25619 URL: https://issues.apache.org/jira/browse/SPARK-25619 Project:

[jira] [Created] (SPARK-25618) KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec

Xiao Li created SPARK-25618: --- Summary: KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec Key: SPARK-25618 URL: https://issues.apache.org/jira/browse/SPARK-25618

[jira] [Created] (SPARK-25617) KafkaContinuousSinkSuite: generic - write big data with small producer buffer 56 secs

Xiao Li created SPARK-25617: --- Summary: KafkaContinuousSinkSuite: generic - write big data with small producer buffer 56 secs Key: SPARK-25617 URL: https://issues.apache.org/jira/browse/SPARK-25617 Project:

[jira] [Created] (SPARK-25616) KafkaSinkSuite: generic - write big data with small producer buffer 57 secs

Xiao Li created SPARK-25616: --- Summary: KafkaSinkSuite: generic - write big data with small producer buffer 57 secs Key: SPARK-25616 URL: https://issues.apache.org/jira/browse/SPARK-25616 Project: Spark

[jira] [Created] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

Xiao Li created SPARK-25615: --- Summary: KafkaSinkSuite: streaming - write to non-existing topic 1 min Key: SPARK-25615 URL: https://issues.apache.org/jira/browse/SPARK-25615 Project: Spark Issue

[jira] [Created] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

Xiao Li created SPARK-25614: --- Summary: HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds Key: SPARK-25614 URL: https://issues.apache.org/jira/browse/SPARK-25614

[jira] [Created] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

Xiao Li created SPARK-25613: --- Summary: HiveSparkSubmitSuite: dir 1 min 3 seconds Key: SPARK-25613 URL: https://issues.apache.org/jira/browse/SPARK-25613 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

Xiao Li created SPARK-25612: --- Summary: CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds Key: SPARK-25612 URL: https://issues.apache.org/jira/browse/SPARK-25612

[jira] [Created] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

Xiao Li created SPARK-25611: --- Summary: CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec Key: SPARK-25611 URL: https://issues.apache.org/jira/browse/SPARK-25611

[jira] [Created] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

Xiao Li created SPARK-25610: --- Summary: DatasetCacheSuite: cache UDF result correctly 25 seconds Key: SPARK-25610 URL: https://issues.apache.org/jira/browse/SPARK-25610 Project: Spark Issue Type:

[jira] [Created] (SPARK-25609) DataFrameSuite: SPARK-22226: splitExpressions should not generate codes beyond 64KB 49 seconds

Xiao Li created SPARK-25609: --- Summary: DataFrameSuite: SPARK-6: splitExpressions should not generate codes beyond 64KB 49 seconds Key: SPARK-25609 URL: https://issues.apache.org/jira/browse/SPARK-25609

[jira] [Created] (SPARK-25608) HashAggregationQueryWithControlledFallbackSuite: multiple distinct multiple columns sets 38 seconds

Xiao Li created SPARK-25608: --- Summary: HashAggregationQueryWithControlledFallbackSuite: multiple distinct multiple columns sets 38 seconds Key: SPARK-25608 URL: https://issues.apache.org/jira/browse/SPARK-25608

[jira] [Created] (SPARK-25607) HashAggregationQueryWithControlledFallbackSuite: single distinct column set 42 seconds

Xiao Li created SPARK-25607: --- Summary: HashAggregationQueryWithControlledFallbackSuite: single distinct column set 42 seconds Key: SPARK-25607 URL: https://issues.apache.org/jira/browse/SPARK-25607

[jira] [Created] (SPARK-25606) DateExpressionsSuite: Hour 1 min

Xiao Li created SPARK-25606: --- Summary: DateExpressionsSuite: Hour 1 min Key: SPARK-25606 URL: https://issues.apache.org/jira/browse/SPARK-25606 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25605) CastSuite: cast string to timestamp 2 mins 31 sec

Xiao Li created SPARK-25605: --- Summary: CastSuite: cast string to timestamp 2 mins 31 sec Key: SPARK-25605 URL: https://issues.apache.org/jira/browse/SPARK-25605 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25604) Reduce the overall time costs in Jenkins tests

Xiao Li created SPARK-25604: --- Summary: Reduce the overall time costs in Jenkins tests Key: SPARK-25604 URL: https://issues.apache.org/jira/browse/SPARK-25604 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24499: Target Version/s: 3.0.0 > Documentation improvement of Spark core and SQL >

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16635836#comment-16635836 ] Xiao Li commented on SPARK-24499: - [~XuanYuan] Yeah. Let us do the split first, and then discuss how to

[jira] [Updated] (SPARK-25414) make it clear that the numRows metrics should be counted for each scan of the source

[ https://issues.apache.org/jira/browse/SPARK-25414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25414: Fix Version/s: (was: 2.5.0) > make it clear that the numRows metrics should be counted for each scan

[jira] [Updated] (SPARK-25426) Remove the duplicate fallback logic in UnsafeProjection

[ https://issues.apache.org/jira/browse/SPARK-25426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25426: Fix Version/s: (was: 2.5.0) > Remove the duplicate fallback logic in UnsafeProjection >

[jira] [Assigned] (SPARK-25381) Stratified sampling by Column argument

[ https://issues.apache.org/jira/browse/SPARK-25381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25381: --- Assignee: Maxim Gekk > Stratified sampling by Column argument >

[jira] [Updated] (SPARK-25423) Output "dataFilters" in DataSourceScanExec.metadata

[ https://issues.apache.org/jira/browse/SPARK-25423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25423: Fix Version/s: (was: 2.5.0) > Output "dataFilters" in DataSourceScanExec.metadata >

[jira] [Updated] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf

[ https://issues.apache.org/jira/browse/SPARK-25415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25415: Fix Version/s: (was: 2.5.0) > Make plan change log in RuleExecutor configurable by SQLConf >

[jira] [Updated] (SPARK-25449) Don't send zero accumulators in heartbeats

[ https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25449: Fix Version/s: (was: 2.5.0) 3.0.0 > Don't send zero accumulators in heartbeats >

[jira] [Updated] (SPARK-25472) Structured Streaming query.stop() doesn't always stop gracefully

[ https://issues.apache.org/jira/browse/SPARK-25472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25472: Fix Version/s: (was: 2.5.0) 3.0.0 > Structured Streaming query.stop() doesn't

[jira] [Updated] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25458: Fix Version/s: (was: 2.5.0) 3.0.0 > Support FOR ALL COLUMNS in ANALYZE TABLE >

[jira] [Updated] (SPARK-25457) IntegralDivide (div) should not always return long

[ https://issues.apache.org/jira/browse/SPARK-25457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25457: Fix Version/s: (was: 2.5.0) 3.0.0 > IntegralDivide (div) should not always return

[jira] [Updated] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure

[ https://issues.apache.org/jira/browse/SPARK-25429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25429: Fix Version/s: (was: 2.5.0) > SparkListenerBus inefficient due to >

[jira] [Updated] (SPARK-25444) Refactor GenArrayData.genCodeToCreateArrayData() method

[ https://issues.apache.org/jira/browse/SPARK-25444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25444: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor

[jira] [Updated] (SPARK-25447) Support JSON options by schema_of_json

[ https://issues.apache.org/jira/browse/SPARK-25447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25447: Fix Version/s: (was: 2.5.0) 3.0.0 > Support JSON options by schema_of_json >

[jira] [Updated] (SPARK-25465) Refactor Parquet test suites in project Hive

[ https://issues.apache.org/jira/browse/SPARK-25465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25465: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor Parquet test suites in project Hive >

[jira] [Updated] (SPARK-25476) Refactor AggregateBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25476: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor AggregateBenchmark to use main method

[jira] [Updated] (SPARK-25473) PySpark ForeachWriter test fails on Python 3.6 and macOS High Serria

[ https://issues.apache.org/jira/browse/SPARK-25473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25473: Fix Version/s: (was: 2.5.0) 3.0.0 > PySpark ForeachWriter test fails on Python 3.6

[jira] [Updated] (SPARK-25486) Refactor SortBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25486: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor SortBenchmark to use main method >

[jira] [Updated] (SPARK-25499) Refactor BenchmarkBase and Benchmark

[ https://issues.apache.org/jira/browse/SPARK-25499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25499: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor BenchmarkBase and Benchmark >

[jira] [Updated] (SPARK-25489) Refactor UDTSerializationBenchmark

[ https://issues.apache.org/jira/browse/SPARK-25489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25489: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor UDTSerializationBenchmark >

[jira] [Updated] (SPARK-25481) Refactor ColumnarBatchBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25481: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor ColumnarBatchBenchmark to use main

[jira] [Updated] (SPARK-25485) Refactor UnsafeProjectionBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25485: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor UnsafeProjectionBenchmark to use main

[jira] [Updated] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25478: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor CompressionSchemeBenchmark to use

[jira] [Updated] (SPARK-25494) Upgrade Spark's use of Janino to 3.0.10

[ https://issues.apache.org/jira/browse/SPARK-25494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25494: Fix Version/s: (was: 2.5.0) 3.0.0 > Upgrade Spark's use of Janino to 3.0.10 >

[jira] [Updated] (SPARK-25487) Refactor PrimitiveArrayBenchmark

[ https://issues.apache.org/jira/browse/SPARK-25487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25487: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor PrimitiveArrayBenchmark >

[jira] [Updated] (SPARK-25508) Refactor OrcReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25508: Fix Version/s: (was: 2.5.0) 3.0.0 > Refactor OrcReadBenchmark to use main method >

[jira] [Updated] (SPARK-25534) Make `SQLHelper` trait

[ https://issues.apache.org/jira/browse/SPARK-25534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25534: Fix Version/s: (was: 2.5.0) 3.0.0 > Make `SQLHelper` trait >

[jira] [Updated] (SPARK-25510) Create a new trait SqlBasedBenchmark

[ https://issues.apache.org/jira/browse/SPARK-25510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25510: Fix Version/s: (was: 2.5.0) 3.0.0 > Create a new trait SqlBasedBenchmark >

[jira] [Updated] (SPARK-25514) Generating pretty JSON by to_json

[ https://issues.apache.org/jira/browse/SPARK-25514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25514: Fix Version/s: (was: 2.5.0) 3.0.0 > Generating pretty JSON by to_json >

[jira] [Updated] (SPARK-25541) CaseInsensitiveMap should be serializable after '-' operator

[ https://issues.apache.org/jira/browse/SPARK-25541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25541: Fix Version/s: (was: 2.5.0) 3.0.0 > CaseInsensitiveMap should be serializable

[jira] [Updated] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala.

[ https://issues.apache.org/jira/browse/SPARK-25540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25540: Fix Version/s: (was: 2.5.0) 3.0.0 > Make HiveContext in PySpark behave as the same

[jira] [Updated] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate.

[ https://issues.apache.org/jira/browse/SPARK-25525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25525: Fix Version/s: (was: 2.5.0) 3.0.0 > Do not update conf for existing SparkContext

[jira] [Updated] (SPARK-25551) Remove unused InSubquery expression

[ https://issues.apache.org/jira/browse/SPARK-25551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25551: Fix Version/s: (was: 2.5.0) 3.0.0 > Remove unused InSubquery expression >

[jira] [Updated] (SPARK-25559) Just remove the unsupported predicates in Parquet

[ https://issues.apache.org/jira/browse/SPARK-25559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25559: Fix Version/s: (was: 2.5.0) 3.0.0 > Just remove the unsupported predicates in

[jira] [Updated] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25565: Fix Version/s: (was: 2.5.0) 3.0.0 > Add scala style checker to check add

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25575: Fix Version/s: (was: 2.5.0) 3.0.0 > SQL tab in the spark UI doesn't have option of

[jira] [Resolved] (SPARK-25592) Bump master branch version to 3.0.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-25592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25592. - Resolution: Fixed Fix Version/s: 3.0.0 > Bump master branch version to 3.0.0-SNAPSHOT >

[jira] [Created] (SPARK-25592) Bump master branch version to 3.0.0-SNAPSHOT

Xiao Li created SPARK-25592: --- Summary: Bump master branch version to 3.0.0-SNAPSHOT Key: SPARK-25592 URL: https://issues.apache.org/jira/browse/SPARK-25592 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-23210) Introduce the concept of default value to schema

[ https://issues.apache.org/jira/browse/SPARK-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23210: Target Version/s: 3.0.0 > Introduce the concept of default value to schema >

[jira] [Resolved] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25453. - Resolution: Fixed Fix Version/s: 2.4.0 > OracleIntegrationSuite IllegalArgumentException:

[jira] [Assigned] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25453: --- Assignee: Chenxiao Mao > OracleIntegrationSuite IllegalArgumentException: Timestamp format must be

[jira] [Created] (SPARK-25576) Fix lint failure in 2.2

Xiao Li created SPARK-25576: --- Summary: Fix lint failure in 2.2 Key: SPARK-25576 URL: https://issues.apache.org/jira/browse/SPARK-25576 Project: Spark Issue Type: Improvement Components:

[jira] [Resolved] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

[ https://issues.apache.org/jira/browse/SPARK-25568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25568. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 2.2.3 >

[jira] [Created] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

Xiao Li created SPARK-25573: --- Summary: Combine resolveExpression and resolve in the rule ResolveReferences Key: SPARK-25573 URL: https://issues.apache.org/jira/browse/SPARK-25573 Project: Spark

[jira] [Resolved] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure

[ https://issues.apache.org/jira/browse/SPARK-25429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25429. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.5.0 > SparkListenerBus

[jira] [Resolved] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25458. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.5.0 > Support FOR ALL COLUMNS

[jira] [Assigned] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25505: --- Assignee: Maryann Xue > The output order of grouping columns in Pivot is different from the input

[jira] [Updated] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25505: Fix Version/s: 2.4.0 > The output order of grouping columns in Pivot is different from the input > order

[jira] [Resolved] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25505. - Resolution: Fixed > The output order of grouping columns in Pivot is different from the input > order

[jira] [Resolved] (SPARK-25454) Division between operands with negative scale can cause precision loss

[ https://issues.apache.org/jira/browse/SPARK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25454. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.4.0 2.3.3 >

[jira] [Commented] (SPARK-23839) consider bucket join in cost-based JoinReorder rule

[ https://issues.apache.org/jira/browse/SPARK-23839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628080#comment-16628080 ] Xiao Li commented on SPARK-23839: - To implement CBO in planner, we need a major change in our planner.

[jira] [Resolved] (SPARK-25465) Refactor Parquet test suites in project Hive

[ https://issues.apache.org/jira/browse/SPARK-25465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25465. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.5.0 > Refactor Parquet test

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623799#comment-16623799 ] Xiao Li commented on SPARK-24499: - ping [~XuanYuan] Any update? > Documentation improvement of Spark

[jira] [Updated] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25179: Issue Type: Sub-task (was: Documentation) Parent: SPARK-25507 > Document the features that

[jira] [Created] (SPARK-25507) Update documents for the new features in 2.4 release

Xiao Li created SPARK-25507: --- Summary: Update documents for the new features in 2.4 release Key: SPARK-25507 URL: https://issues.apache.org/jira/browse/SPARK-25507 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-25494) Upgrade Spark's use of Janino to 3.0.10

[ https://issues.apache.org/jira/browse/SPARK-25494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25494. - Resolution: Fixed Assignee: Kris Mok Fix Version/s: 2.5.0 > Upgrade Spark's use of

[jira] [Resolved] (SPARK-24777) Add write benchmark for AVRO

[ https://issues.apache.org/jira/browse/SPARK-24777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24777. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0 > Add write benchmark

[jira] [Resolved] (SPARK-25450) PushProjectThroughUnion rule uses the same exprId for project expressions in each Union child, causing mistakes in constant propagation

[ https://issues.apache.org/jira/browse/SPARK-25450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25450. - Resolution: Fixed Assignee: Maryann Xue Fix Version/s: 2.4.0 2.3.3 >

[jira] [Assigned] (SPARK-25419) Parquet predicate pushdown improvement

[ https://issues.apache.org/jira/browse/SPARK-25419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25419: --- Assignee: Yuming Wang > Parquet predicate pushdown improvement >

[jira] [Created] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

Xiao Li created SPARK-25458: --- Summary: Support FOR ALL COLUMNS in ANALYZE TABLE Key: SPARK-25458 URL: https://issues.apache.org/jira/browse/SPARK-25458 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-24151) CURRENT_DATE, CURRENT_TIMESTAMP incorrectly resolved as column names when caseSensitive is enabled

[ https://issues.apache.org/jira/browse/SPARK-24151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24151. - Resolution: Fixed Assignee: James Thompson Fix Version/s: 2.4.0 > CURRENT_DATE,

[jira] [Updated] (SPARK-25450) PushProjectThroughUnion rule uses the same exprId for project expressions in each Union child, causing mistakes in constant propagation

[ https://issues.apache.org/jira/browse/SPARK-25450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25450: Description: The problem was cause by the PushProjectThroughUnion rule, which, when creating new Project

<    6   7   8   9   10   11   12   13   14   15   >