[jira] [Resolved] (SPARK-35961) Only use local shuffle reader when REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35961. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33165

[jira] [Assigned] (SPARK-35961) Only use local shuffle reader when REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35961: --- Assignee: XiDuo You > Only use local shuffle reader when REBALANCE_PARTITIONS_BY_NONE

[jira] [Resolved] (SPARK-35960) sbt test:compile of tags is broken

2021-06-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35960. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33163

[jira] [Resolved] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35950. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33155

[jira] [Assigned] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35950: -- Assignee: Kevin Su > Failed to toggle Exec Loss Reason in the executors page >

[jira] [Updated] (SPARK-35961) Only use local shuffle reader when REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35961: -- Summary: Only use local shuffle reader when REBALANCE_PARTITIONS_BY_NONE without

[jira] [Assigned] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35961: Assignee: (was: Apache Spark) > Only use local shuffle reader for

[jira] [Commented] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372351#comment-17372351 ] Apache Spark commented on SPARK-35961: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372350#comment-17372350 ] Apache Spark commented on SPARK-35961: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35961: Assignee: Apache Spark > Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE

[jira] [Assigned] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35958: Assignee: (was: Apache Spark) > Refactor SparkError.scala to SparkThrowable.java >

[jira] [Commented] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372349#comment-17372349 ] Apache Spark commented on SPARK-35958: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35958: Assignee: Apache Spark > Refactor SparkError.scala to SparkThrowable.java >

[jira] [Updated] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35961: -- Description: After [SPARK-35725](https://issues.apache.org/jira/browse/SPARK-35725), we might expand

[jira] [Updated] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35961: -- Parent: SPARK-35793 Issue Type: Sub-task (was: Improvement) > Only use local shuffle reader

[jira] [Created] (SPARK-35961) Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec

2021-06-30 Thread XiDuo You (Jira)
XiDuo You created SPARK-35961: - Summary: Only use local shuffle reader for REBALANCE_PARTITIONS_BY_NONE without CustomShuffleReaderExec Key: SPARK-35961 URL: https://issues.apache.org/jira/browse/SPARK-35961

[jira] [Assigned] (SPARK-35065) Group exception messages in spark/sql (core)

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35065: --- Assignee: jiaan.geng > Group exception messages in spark/sql (core) >

[jira] [Resolved] (SPARK-35065) Group exception messages in spark/sql (core)

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35065. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32958

[jira] [Commented] (SPARK-35960) sbt test:compile of tags is broken

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372293#comment-17372293 ] Apache Spark commented on SPARK-35960: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35960) sbt test:compile of tags is broken

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35960: Assignee: Holden Karau (was: Apache Spark) > sbt test:compile of tags is broken >

[jira] [Assigned] (SPARK-35960) sbt test:compile of tags is broken

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35960: Assignee: Apache Spark (was: Holden Karau) > sbt test:compile of tags is broken >

[jira] [Created] (SPARK-35960) sbt test:compile of tags is broken

2021-06-30 Thread Holden Karau (Jira)
Holden Karau created SPARK-35960: Summary: sbt test:compile of tags is broken Key: SPARK-35960 URL: https://issues.apache.org/jira/browse/SPARK-35960 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-35949) working with spring boot, spark context will stopped while application is started.

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35949: - Priority: Major (was: Critical) > working with spring boot, spark context will stopped while

[jira] [Commented] (SPARK-35615) Refactor python/pyspark/pandas/base.py for better abstraction

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372288#comment-17372288 ] Apache Spark commented on SPARK-35615: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35615) Refactor python/pyspark/pandas/base.py for better abstraction

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35615: Assignee: Apache Spark > Refactor python/pyspark/pandas/base.py for better abstraction >

[jira] [Assigned] (SPARK-35615) Refactor python/pyspark/pandas/base.py for better abstraction

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35615: Assignee: (was: Apache Spark) > Refactor python/pyspark/pandas/base.py for better

[jira] [Assigned] (SPARK-35944) Introduce type aliases for names or labels.

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35944: Assignee: Takuya Ueshin > Introduce type aliases for names or labels. >

[jira] [Resolved] (SPARK-35944) Introduce type aliases for names or labels.

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35944. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33159

[jira] [Commented] (SPARK-31973) Add ability to disable Sort,Spill in Partial aggregation

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372286#comment-17372286 ] Apache Spark commented on SPARK-31973: -- User 'shipra-a' has created a pull request for this issue:

[jira] [Updated] (SPARK-35936) Deprecate Python 3.6 support

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35936: - Fix Version/s: 3.2.0 > Deprecate Python 3.6 support > > >

[jira] [Resolved] (SPARK-35939) Deprecate Python 3.6 in Spark documentation

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35939. -- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-35936) Deprecate Python 3.6 support

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35936. -- Assignee: Xinrong Meng Resolution: Done > Deprecate Python 3.6 support >

[jira] [Resolved] (SPARK-35938) Add deprecation warning for Python 3.6

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35938. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33139

[jira] [Assigned] (SPARK-35938) Add deprecation warning for Python 3.6

2021-06-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35938: Assignee: Xinrong Meng > Add deprecation warning for Python 3.6 >

[jira] [Assigned] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35959: Assignee: (was: Apache Spark) > Add a new Maven profile "no-shaded-client" for older

[jira] [Commented] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372271#comment-17372271 ] Apache Spark commented on SPARK-35959: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35959: Assignee: Apache Spark > Add a new Maven profile "no-shaded-client" for older Hadoop 3.x

[jira] [Commented] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372270#comment-17372270 ] Apache Spark commented on SPARK-35959: -- User 'sunchao' has created a pull request for this issue:

[jira] [Updated] (SPARK-35615) Refactor python/pyspark/pandas/base.py for better abstraction

2021-06-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35615: - Description: python/pyspark/pandas/data_type_ops/base.py and python/pyspark/pandas/base.py

[jira] [Updated] (SPARK-35615) Refactor python/pyspark/pandas/base.py for better abstraction

2021-06-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35615: - Description: python/pyspark/pandas/data_type_ops/base.py and python/pyspark/pandas/base.py

[jira] [Assigned] (SPARK-34859) Vectorized parquet reader needs synchronization among pages for column index

2021-06-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34859: - Assignee: Chao Sun > Vectorized parquet reader needs synchronization among pages for

[jira] [Resolved] (SPARK-34859) Vectorized parquet reader needs synchronization among pages for column index

2021-06-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34859. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32753

[jira] [Created] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

2021-06-30 Thread Chao Sun (Jira)
Chao Sun created SPARK-35959: Summary: Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions Key: SPARK-35959 URL: https://issues.apache.org/jira/browse/SPARK-35959 Project: Spark

[jira] [Created] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-06-30 Thread Karen Feng (Jira)
Karen Feng created SPARK-35958: -- Summary: Refactor SparkError.scala to SparkThrowable.java Key: SPARK-35958 URL: https://issues.apache.org/jira/browse/SPARK-35958 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-06-30 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-35958: --- Description: Following up from SPARK-34920: Error has a special meaning in Java; SparkError should

[jira] [Assigned] (SPARK-35944) Introduce type aliases for names or labels.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35944: Assignee: (was: Apache Spark) > Introduce type aliases for names or labels. >

[jira] [Commented] (SPARK-35944) Introduce type aliases for names or labels.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372165#comment-17372165 ] Apache Spark commented on SPARK-35944: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35944) Introduce type aliases for names or labels.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35944: Assignee: Apache Spark > Introduce type aliases for names or labels. >

[jira] [Updated] (SPARK-35955) Fix decimal overflow issues for Average

2021-06-30 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-35955: --- Description: Fix decimal overflow issues for decimal average in ANSI mode. Linked to SPARK-32018

[jira] [Updated] (SPARK-35957) Cannot convert Avro schema to catalyst type because schema at path is not compatible

2021-06-30 Thread Jake Dalli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jake Dalli updated SPARK-35957: --- Description: * The Apache Avro specification has a *null* primitive type. * Using

[jira] [Created] (SPARK-35957) Cannot convert Avro schema to catalyst type because schema at path is not compatible

2021-06-30 Thread Jake Dalli (Jira)
Jake Dalli created SPARK-35957: -- Summary: Cannot convert Avro schema to catalyst type because schema at path is not compatible Key: SPARK-35957 URL: https://issues.apache.org/jira/browse/SPARK-35957

[jira] [Resolved] (SPARK-35725) Support repartition expand partitions in AQE

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35725. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32883

[jira] [Assigned] (SPARK-35725) Support repartition expand partitions in AQE

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35725: --- Assignee: XiDuo You > Support repartition expand partitions in AQE >

[jira] [Commented] (SPARK-35888) Add dataSize field in CoalescedPartitionSpec

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372137#comment-17372137 ] Apache Spark commented on SPARK-35888: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-35888) Add dataSize field in CoalescedPartitionSpec

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372136#comment-17372136 ] Apache Spark commented on SPARK-35888: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-06-30 Thread Holden Karau (Jira)
Holden Karau created SPARK-35956: Summary: Support auto-assigning labels to less important pods (e.g. decommissioning pods) Key: SPARK-35956 URL: https://issues.apache.org/jira/browse/SPARK-35956

[jira] [Updated] (SPARK-35955) Fix decimal overflow issues for Average

2021-06-30 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-35955: --- Description: Return null on overflow for decimal average. Linked to SPARK-32018 and SPARK-28067,

[jira] [Created] (SPARK-35955) Fix decimal overflow issues for Average

2021-06-30 Thread Karen Feng (Jira)
Karen Feng created SPARK-35955: -- Summary: Fix decimal overflow issues for Average Key: SPARK-35955 URL: https://issues.apache.org/jira/browse/SPARK-35955 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30707) Lead/Lag window function throws AnalysisException without ORDER BY clause

2021-06-30 Thread Catalin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372127#comment-17372127 ] Catalin commented on SPARK-30707: - At Lyft we are also in the process of deprecating Hive and we hit the

[jira] [Resolved] (SPARK-35953) Support extracting date fields from timestamp without time zone

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35953. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33156

[jira] [Assigned] (SPARK-35954) [Deploy] Upgrade Apache Curator Dependency to 4.2.0

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35954: Assignee: (was: Apache Spark) > [Deploy] Upgrade Apache Curator Dependency to 4.2.0

[jira] [Assigned] (SPARK-35954) [Deploy] Upgrade Apache Curator Dependency to 4.2.0

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35954: Assignee: Apache Spark > [Deploy] Upgrade Apache Curator Dependency to 4.2.0 >

[jira] [Updated] (SPARK-35954) [Deploy] Upgrade Apache Curator Dependency to 4.2.0

2021-06-30 Thread Nikita ROUSSEAU (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita ROUSSEAU updated SPARK-35954: Summary: [Deploy] Upgrade Apache Curator Dependency to 4.2.0 (was: Upgrade Apache

[jira] [Commented] (SPARK-35954) Upgrade Apache Curator Dependency to 4.2.0

2021-06-30 Thread Nikita ROUSSEAU (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372079#comment-17372079 ] Nikita ROUSSEAU commented on SPARK-35954: - Since it is my first contribution, do not hesitate to

[jira] [Updated] (SPARK-35954) Upgrade Apache Curator Dependency to 4.2.0

2021-06-30 Thread Nikita ROUSSEAU (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita ROUSSEAU updated SPARK-35954: Target Version/s: (was: 3.2.0) > Upgrade Apache Curator Dependency to 4.2.0 >

[jira] [Created] (SPARK-35954) Upgrade Apache Curator Dependency to 4.2.0

2021-06-30 Thread Nikita ROUSSEAU (Jira)
Nikita ROUSSEAU created SPARK-35954: --- Summary: Upgrade Apache Curator Dependency to 4.2.0 Key: SPARK-35954 URL: https://issues.apache.org/jira/browse/SPARK-35954 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35953) Support extracting date fields from timestamp without time zone

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35953: Assignee: Gengliang Wang (was: Apache Spark) > Support extracting date fields from

[jira] [Assigned] (SPARK-35953) Support extracting date fields from timestamp without time zone

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35953: Assignee: Apache Spark (was: Gengliang Wang) > Support extracting date fields from

[jira] [Commented] (SPARK-35953) Support extracting date fields from timestamp without time zone

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372025#comment-17372025 ] Apache Spark commented on SPARK-35953: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-35953) Support extracting date fields from timestamp without time zone

2021-06-30 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35953: -- Summary: Support extracting date fields from timestamp without time zone Key: SPARK-35953 URL: https://issues.apache.org/jira/browse/SPARK-35953 Project: Spark

[jira] [Updated] (SPARK-35945) Unable to parse multi character row and column delimited files using Spark

2021-06-30 Thread Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandra updated SPARK-35945: Issue Type: Improvement (was: Bug) > Unable to parse multi character row and column delimited files

[jira] [Commented] (SPARK-32929) StreamSuite failure on IBM Z: - SPARK-20432: union one stream with itself

2021-06-30 Thread Simrit Kaur (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371997#comment-17371997 ] Simrit Kaur commented on SPARK-32929: - I am also facing this issue on SPARK 3.1.1 version on IBM Z.

[jira] [Resolved] (SPARK-35735) Take into account day-time interval fields in cast

2021-06-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35735. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32943

[jira] [Assigned] (SPARK-35735) Take into account day-time interval fields in cast

2021-06-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35735: Assignee: angerszhu > Take into account day-time interval fields in cast >

[jira] [Resolved] (SPARK-35952) Inclusive terminology usage in Spark

2021-06-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35952. -- Resolution: Duplicate > Inclusive terminology usage in Spark >

[jira] [Resolved] (SPARK-35932) Support extracting hour/minute/second from timestamp without time zone

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35932. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33136

[jira] [Created] (SPARK-35952) Inclusive terminology usage in Spark

2021-06-30 Thread Abhishek Rao (Jira)
Abhishek Rao created SPARK-35952: Summary: Inclusive terminology usage in Spark Key: SPARK-35952 URL: https://issues.apache.org/jira/browse/SPARK-35952 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Kevin Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SPARK-35950: - Description: When unselected the checkbox "Exec Loss Reason" on the executor page, the "Active tasks"

[jira] [Updated] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Kevin Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Su updated SPARK-35950: - Description: When Clicked the checkbox "Exec Loss Reason" on the executor page, the "Active tasks"

[jira] [Assigned] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35950: Assignee: Apache Spark > Failed to toggle Exec Loss Reason in the executors page >

[jira] [Assigned] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35950: Assignee: (was: Apache Spark) > Failed to toggle Exec Loss Reason in the executors

[jira] [Commented] (SPARK-35950) Failed to toggle Exec Loss Reason in the executors page

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371931#comment-17371931 ] Apache Spark commented on SPARK-35950: -- User 'pingsutw' has created a pull request for this issue:

[jira] [Updated] (SPARK-35949) working with spring boot, spark context will stopped while application is started.

2021-06-30 Thread SunPeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SunPeng updated SPARK-35949: Description: Spark 3.1.2 with springboot, on client mode, the spark context while stopped while the

[jira] [Updated] (SPARK-35949) working with spring boot, spark context will stopped while application is started.

2021-06-30 Thread SunPeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SunPeng updated SPARK-35949: Summary: working with spring boot, spark context will stopped while application is started. (was: On

[jira] [Resolved] (SPARK-35951) Add since versions for Avro options in Documentation

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35951. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33153

[jira] [Assigned] (SPARK-34920) Introduce SQLSTATE and ERRORCODE to SQL Exception

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34920: --- Assignee: Karen Feng > Introduce SQLSTATE and ERRORCODE to SQL Exception >

[jira] [Resolved] (SPARK-34920) Introduce SQLSTATE and ERRORCODE to SQL Exception

2021-06-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34920. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32850

[jira] [Commented] (SPARK-35949) On client mode, spark context will stopped while application is started.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371913#comment-17371913 ] Apache Spark commented on SPARK-35949: -- User 'sunpe' has created a pull request for this issue:

[jira] [Commented] (SPARK-35949) On client mode, spark context will stopped while application is started.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371912#comment-17371912 ] Apache Spark commented on SPARK-35949: -- User 'sunpe' has created a pull request for this issue:

[jira] [Commented] (SPARK-35951) Add since versions for Avro options in Documentation

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371907#comment-17371907 ] Apache Spark commented on SPARK-35951: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-35951) Add since versions for Avro options in Documentation

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371908#comment-17371908 ] Apache Spark commented on SPARK-35951: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35951) Add since versions for Avro options in Documentation

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35951: Assignee: Apache Spark (was: Gengliang Wang) > Add since versions for Avro options in

[jira] [Assigned] (SPARK-35951) Add since versions for Avro options in Documentation

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35951: Assignee: Gengliang Wang (was: Apache Spark) > Add since versions for Avro options in

[jira] [Created] (SPARK-35951) Add since versions for Avro options in Documentation

2021-06-30 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35951: -- Summary: Add since versions for Avro options in Documentation Key: SPARK-35951 URL: https://issues.apache.org/jira/browse/SPARK-35951 Project: Spark

[jira] [Updated] (SPARK-35935) REPAIR TABLE fails on table refreshing

2021-06-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35935: - Affects Version/s: 3.0.4 3.1.3 > REPAIR TABLE fails on table refreshing >

[jira] [Assigned] (SPARK-34365) Support configurable Avro schema field matching for positional or by-name

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-34365: -- Assignee: Erik Krogen > Support configurable Avro schema field matching for

[jira] [Resolved] (SPARK-34365) Support configurable Avro schema field matching for positional or by-name

2021-06-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34365. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31490

[jira] [Assigned] (SPARK-35949) On client mode, spark context will stopped while application is started.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35949: Assignee: (was: Apache Spark) > On client mode, spark context will stopped while

[jira] [Commented] (SPARK-35949) On client mode, spark context will stopped while application is started.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371871#comment-17371871 ] Apache Spark commented on SPARK-35949: -- User 'sunpe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35949) On client mode, spark context will stopped while application is started.

2021-06-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35949: Assignee: Apache Spark > On client mode, spark context will stopped while application is

  1   2   >