[jira] [Updated] (SPARK-33828) Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Target Version/s: 3.2.0 > Adaptive Query Execution QA > --- > >

[jira] [Updated] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33823: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > Use the `CastSupport.cast`

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > TPCDS Q5 fails if

[jira] [Created] (SPARK-33828) Adaptive Query Execution QA

Dongjoon Hyun created SPARK-33828: - Summary: Adaptive Query Execution QA Key: SPARK-33828 URL: https://issues.apache.org/jira/browse/SPARK-33828 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-33827) Unload State Store asap once it becomes inactive

L. C. Hsieh created SPARK-33827: --- Summary: Unload State Store asap once it becomes inactive Key: SPARK-33827 URL: https://issues.apache.org/jira/browse/SPARK-33827 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251202#comment-17251202 ] Derek Tapley edited comment on SPARK-24632 at 12/17/20, 4:57 PM: - I've

[jira] [Comment Edited] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251202#comment-17251202 ] Derek Tapley edited comment on SPARK-24632 at 12/17/20, 4:57 PM: - I've

[jira] [Comment Edited] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251202#comment-17251202 ] Derek Tapley edited comment on SPARK-24632 at 12/17/20, 4:55 PM: - I've

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251202#comment-17251202 ] Derek Tapley commented on SPARK-24632: -- I've been running into this problem as well, it seems like

[jira] [Assigned] (SPARK-33593) Parquet vector reader incorrect with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33593: Assignee: Apache Spark > Parquet vector reader incorrect with binary partition value >

[jira] [Assigned] (SPARK-33593) Parquet vector reader incorrect with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33593: Assignee: (was: Apache Spark) > Parquet vector reader incorrect with binary

[jira] [Commented] (SPARK-33593) Parquet vector reader incorrect with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251154#comment-17251154 ] Apache Spark commented on SPARK-33593: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-22769) When driver stopping, there is errors: "Could not find CoarseGrainedScheduler" and "RpcEnv already stopped"

[ https://issues.apache.org/jira/browse/SPARK-22769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-22769: Assignee: Su Qilong > When driver stopping, there is errors: "Could not find >

[jira] [Resolved] (SPARK-22769) When driver stopping, there is errors: "Could not find CoarseGrainedScheduler" and "RpcEnv already stopped"

[ https://issues.apache.org/jira/browse/SPARK-22769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-22769. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30658

[jira] [Updated] (SPARK-22769) When driver stopping, there is errors: "Could not find CoarseGrainedScheduler" and "RpcEnv already stopped"

[ https://issues.apache.org/jira/browse/SPARK-22769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-22769: - Priority: Minor (was: Major) > When driver stopping, there is errors: "Could not find >

[jira] [Resolved] (SPARK-33774) "Back to Master" returns 500 error in Standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-33774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33774. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-33774) "Back to Master" returns 500 error in Standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-33774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33774: Assignee: wuyi > "Back to Master" returns 500 error in Standalone cluster >

[jira] [Commented] (SPARK-33088) Enhance ExecutorPlugin API to include methods for task start and end events

[ https://issues.apache.org/jira/browse/SPARK-33088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251100#comment-17251100 ] Apache Spark commented on SPARK-33088: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-33088) Enhance ExecutorPlugin API to include methods for task start and end events

[ https://issues.apache.org/jira/browse/SPARK-33088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251101#comment-17251101 ] Apache Spark commented on SPARK-33088: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251097#comment-17251097 ] Apache Spark commented on SPARK-33173: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-33088) Enhance ExecutorPlugin API to include methods for task start and end events

[ https://issues.apache.org/jira/browse/SPARK-33088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251098#comment-17251098 ] Apache Spark commented on SPARK-33088: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251096#comment-17251096 ] Apache Spark commented on SPARK-33173: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Updated] (SPARK-26199) Long expressions cause mutate to fail

[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26199: - Fix Version/s: 3.1.0 > Long expressions cause mutate to fail >

[jira] [Updated] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31517: - Fix Version/s: 3.1.0 > SparkR::orderBy with multiple columns descending produces error >

[jira] [Updated] (SPARK-33819) SingleFileEventLogFileReader/RollingEventLogFilesFileReader should be `package private`

[ https://issues.apache.org/jira/browse/SPARK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33819: - Fix Version/s: 3.1.0 3.0.2 >

[jira] [Commented] (SPARK-33824) Restructure and improve Python package management page

[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250965#comment-17250965 ] Apache Spark commented on SPARK-33824: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33824) Restructure and improve Python package management page

[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33824: Assignee: (was: Apache Spark) > Restructure and improve Python package management

[jira] [Commented] (SPARK-33824) Restructure and improve Python package management page

[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250964#comment-17250964 ] Apache Spark commented on SPARK-33824: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33824) Restructure and improve Python package management page

[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33824: Assignee: Apache Spark > Restructure and improve Python package management page >

[jira] [Commented] (SPARK-33825) Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true

[ https://issues.apache.org/jira/browse/SPARK-33825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250954#comment-17250954 ] Yu.Ken commented on SPARK-33825: Dose anybody konws how to fix it? > Is Spark SQL able to auto update

[jira] [Created] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

Zhang Jianguo created SPARK-33826: - Summary: InsertIntoHiveTable generate HDFS file with invalid user Key: SPARK-33826 URL: https://issues.apache.org/jira/browse/SPARK-33826 Project: Spark

[jira] [Resolved] (SPARK-33783) Unload State Store Provider after configured keep alive time

[ https://issues.apache.org/jira/browse/SPARK-33783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33783. - Resolution: Won't Fix > Unload State Store Provider after configured keep alive time >

[jira] [Resolved] (SPARK-33816) Make stateful operations reuse previous state store

[ https://issues.apache.org/jira/browse/SPARK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33816. - Resolution: Invalid > Make stateful operations reuse previous state store >

[jira] [Created] (SPARK-33825) Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true

yang created SPARK-33825: Summary: Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true Key: SPARK-33825 URL: https://issues.apache.org/jira/browse/SPARK-33825

[jira] [Created] (SPARK-33824) Restructure and improve Python package management page

Hyukjin Kwon created SPARK-33824: Summary: Restructure and improve Python package management page Key: SPARK-33824 URL: https://issues.apache.org/jira/browse/SPARK-33824 Project: Spark Issue

[jira] [Commented] (SPARK-32185) User Guide - Monitoring

[ https://issues.apache.org/jira/browse/SPARK-32185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250924#comment-17250924 ] Hyukjin Kwon commented on SPARK-32185: -- gentle ping [~a7prasad] :-) > User Guide - Monitoring >

[jira] [Updated] (SPARK-33733) PullOutNondeterministic should check and collect deterministic field

[ https://issues.apache.org/jira/browse/SPARK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33733: Fix Version/s: 3.0.2 2.4.8 > PullOutNondeterministic should check and collect

[jira] [Resolved] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31517. -- Resolution: Fixed > SparkR::orderBy with multiple columns descending produces error >

[jira] [Commented] (SPARK-26199) Long expressions cause mutate to fail

[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250891#comment-17250891 ] Hyukjin Kwon commented on SPARK-26199: -- Fixed in https://github.com/apache/spark/pull/28386 > Long

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250892#comment-17250892 ] Hyukjin Kwon commented on SPARK-31517: -- Fixed in https://github.com/apache/spark/pull/28386 >

[jira] [Updated] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31517: - Fix Version/s: 3.2.0 > SparkR::orderBy with multiple columns descending produces error >

[jira] [Resolved] (SPARK-26199) Long expressions cause mutate to fail

[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26199. -- Fix Version/s: 3.2.0 Resolution: Fixed > Long expressions cause mutate to fail >

[jira] [Reopened] (SPARK-26199) Long expressions cause mutate to fail

[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-26199: -- > Long expressions cause mutate to fail > - > >

[jira] [Reopened] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-31517: -- > SparkR::orderBy with multiple columns descending produces error >

[jira] [Resolved] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31517. -- Resolution: Duplicate > SparkR::orderBy with multiple columns descending produces error >

[jira] [Assigned] (SPARK-26199) Long expressions cause mutate to fail

[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26199: Assignee: Michael Chirico > Long expressions cause mutate to fail >

[jira] [Updated] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33823: - Issue Type: Bug (was: Improvement) > Use the `CastSupport.cast` method in HashJoin >

<    1   2