[jira] [Commented] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609810#comment-17609810 ] Apache Spark commented on SPARK-40574: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40574: Assignee: Apache Spark > Add PURGE to DROP TABLE doc > --- > >

[jira] [Assigned] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40574: Assignee: (was: Apache Spark) > Add PURGE to DROP TABLE doc >

[jira] [Commented] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609809#comment-17609809 ] Apache Spark commented on SPARK-40574: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-40572) Executor ID sorted as lexicographical order in Task Table of Stage Tab

2022-09-26 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-40572: - Priority: Minor (was: Major) > Executor ID sorted as lexicographical order in Task Table of Stage Tab

[jira] [Updated] (SPARK-40572) Executor ID sorted as lexicographical order in Task Table of Stage Tab

2022-09-26 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-40572: - Issue Type: Improvement (was: Bug) > Executor ID sorted as lexicographical order in Task Table of

[jira] [Created] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-26 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40574: --- Summary: Add PURGE to DROP TABLE doc Key: SPARK-40574 URL: https://issues.apache.org/jira/browse/SPARK-40574 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-26254) Move delegation token providers into a separate project

2022-09-26 Thread forrest lv (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609802#comment-17609802 ] forrest lv commented on SPARK-26254: nice job > Move delegation token providers into a separate

[jira] [Assigned] (SPARK-40573) Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary integers

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40573: Assignee: Apache Spark > Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem`

[jira] [Assigned] (SPARK-40573) Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary integers

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40573: Assignee: (was: Apache Spark) > Make `ddof` in `GroupBy.std`, `GroupBy.var` and

[jira] [Commented] (SPARK-40573) Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary integers

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609791#comment-17609791 ] Apache Spark commented on SPARK-40573: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-40573) Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary integers

2022-09-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40573: - Summary: Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary integers Key: SPARK-40573 URL: https://issues.apache.org/jira/browse/SPARK-40573

[jira] [Commented] (SPARK-40572) Executor ID sorted as lexicographical order in UI Stages Tab

2022-09-26 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609785#comment-17609785 ] Qian Sun commented on SPARK-40572: -- I think the root cause is that [executorId is string in

[jira] [Updated] (SPARK-40572) Executor ID sorted as lexicographical order in Task Table of Stage Tab

2022-09-26 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-40572: - Summary: Executor ID sorted as lexicographical order in Task Table of Stage Tab (was: Executor ID

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40564: - Priority: Major (was: Blocker) > The distributed runtime has one more identical process with a

[jira] [Commented] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609784#comment-17609784 ] Hyukjin Kwon commented on SPARK-40563: -- Please go ahead. > Error at where clause, when sql case

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40563: - Fix Version/s: (was: 3.3.0) > Error at where clause, when sql case executes by else branch

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40563: - Target Version/s: (was: 3.3.0) > Error at where clause, when sql case executes by else branch

[jira] [Commented] (SPARK-40571) Construct a test case to verify fault-tolerance semantic with random python worker failures

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609780#comment-17609780 ] Apache Spark commented on SPARK-40571: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-40571) Construct a test case to verify fault-tolerance semantic with random python worker failures

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40571: Assignee: (was: Apache Spark) > Construct a test case to verify fault-tolerance

[jira] [Assigned] (SPARK-40571) Construct a test case to verify fault-tolerance semantic with random python worker failures

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40571: Assignee: Apache Spark > Construct a test case to verify fault-tolerance semantic with

[jira] [Commented] (SPARK-40571) Construct a test case to verify fault-tolerance semantic with random python worker failures

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609779#comment-17609779 ] Apache Spark commented on SPARK-40571: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Resolved] (SPARK-40557) Re-generate Spark Connect Python protos

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40557. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37993

[jira] [Assigned] (SPARK-40557) Re-generate Spark Connect Python protos

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40557: Assignee: Martin Grund > Re-generate Spark Connect Python protos >

[jira] [Resolved] (SPARK-40561) Implement `min_count` in GroupBy.min

2022-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40561. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37998

[jira] [Assigned] (SPARK-40561) Implement `min_count` in GroupBy.min

2022-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40561: - Assignee: Ruifeng Zheng > Implement `min_count` in GroupBy.min >

[jira] [Commented] (SPARK-40566) Add showIndex function

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609771#comment-17609771 ] Apache Spark commented on SPARK-40566: -- User 'huleilei' has created a pull request for this issue:

[jira] [Updated] (SPARK-40572) Executor ID sorted as lexicographical order in UI Stages Tab

2022-09-26 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-40572: - Attachment: Executor_ID_IN_STAGES_TAB.png > Executor ID sorted as lexicographical order in UI Stages

[jira] [Assigned] (SPARK-40566) Add showIndex function

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40566: Assignee: (was: Apache Spark) > Add showIndex function > --- >

[jira] [Assigned] (SPARK-40566) Add showIndex function

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40566: Assignee: Apache Spark > Add showIndex function > --- > >

[jira] [Commented] (SPARK-40566) Add showIndex function

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609770#comment-17609770 ] Apache Spark commented on SPARK-40566: -- User 'huleilei' has created a pull request for this issue:

[jira] [Created] (SPARK-40572) Executor ID sorted as lexicographical order in UI Stages Tab

2022-09-26 Thread Qian Sun (Jira)
Qian Sun created SPARK-40572: Summary: Executor ID sorted as lexicographical order in UI Stages Tab Key: SPARK-40572 URL: https://issues.apache.org/jira/browse/SPARK-40572 Project: Spark Issue

[jira] [Updated] (SPARK-40572) Executor ID sorted as lexicographical order in UI Stages Tab

2022-09-26 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-40572: - Description: As figure shows, Executor ID sorted as lexicographical order in UI Stages Tab. Better sort

[jira] [Created] (SPARK-40571) Construct a test case to verify fault-tolerance semantic with random python worker failures

2022-09-26 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-40571: Summary: Construct a test case to verify fault-tolerance semantic with random python worker failures Key: SPARK-40571 URL: https://issues.apache.org/jira/browse/SPARK-40571

[jira] [Created] (SPARK-40570) Add doc for Docker Setup in standalone mode

2022-09-26 Thread Qian Sun (Jira)
Qian Sun created SPARK-40570: Summary: Add doc for Docker Setup in standalone mode Key: SPARK-40570 URL: https://issues.apache.org/jira/browse/SPARK-40570 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40569) Expose port for spark standalone mode

2022-09-26 Thread Qian Sun (Jira)
Qian Sun created SPARK-40569: Summary: Expose port for spark standalone mode Key: SPARK-40569 URL: https://issues.apache.org/jira/browse/SPARK-40569 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35242) Support change catalog default database for spark

2022-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35242: --- Assignee: Gabor Roczei > Support change catalog default database for spark >

[jira] [Resolved] (SPARK-35242) Support change catalog default database for spark

2022-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35242. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37679

[jira] [Assigned] (SPARK-40536) Make Spark Connect port configurable.

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40536: Assignee: Apache Spark > Make Spark Connect port configurable. >

[jira] [Commented] (SPARK-40536) Make Spark Connect port configurable.

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609718#comment-17609718 ] Apache Spark commented on SPARK-40536: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40536) Make Spark Connect port configurable.

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40536: Assignee: (was: Apache Spark) > Make Spark Connect port configurable. >

[jira] [Commented] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609691#comment-17609691 ] Apache Spark commented on SPARK-40550: -- User 'aokolnychyi' has created a pull request for this

[jira] [Commented] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609690#comment-17609690 ] Apache Spark commented on SPARK-40550: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40550: Assignee: (was: Apache Spark) > DataSource V2: Handle DELETE commands for

[jira] [Assigned] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40550: Assignee: Apache Spark > DataSource V2: Handle DELETE commands for delta-based sources >

[jira] [Assigned] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40551: Assignee: Apache Spark > DataSource V2: Add APIs for delta-based row-level operations >

[jira] [Commented] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609688#comment-17609688 ] Apache Spark commented on SPARK-40551: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40551: Assignee: (was: Apache Spark) > DataSource V2: Add APIs for delta-based row-level

[jira] [Commented] (SPARK-40358) Migrate collection type check failures onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609592#comment-17609592 ] Max Gekk commented on SPARK-40358: -- [~lvshaokang] Sure, go ahead. > Migrate collection type check

[jira] [Commented] (SPARK-40358) Migrate collection type check failures onto error classes

2022-09-26 Thread Shaokang Lv (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609584#comment-17609584 ] Shaokang Lv commented on SPARK-40358: - Hi, [~maxgekk] , I will pick up this if possible. > Migrate

[jira] [Assigned] (SPARK-40357) Migrate window type check failures onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40357: Assignee: Shaokang Lv > Migrate window type check failures onto error classes >

[jira] [Resolved] (SPARK-40357) Migrate window type check failures onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40357. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37986

[jira] [Commented] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609536#comment-17609536 ] ming95 commented on SPARK-40563: I can reproduce this problem. I can try to fix this issue if no

[jira] [Created] (SPARK-40568) Spark Streaming support Debezium

2022-09-26 Thread melin (Jira)
melin created SPARK-40568: - Summary: Spark Streaming support Debezium Key: SPARK-40568 URL: https://issues.apache.org/jira/browse/SPARK-40568 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40552: - Priority: Minor (was: Major) > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Resolved] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40552. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37991

[jira] [Updated] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40552: - Component/s: Build > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Assigned] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40552: Assignee: Bjørn Jørgensen > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Resolved] (SPARK-40478) Add create datasource table options docs

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40478. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37919

[jira] [Assigned] (SPARK-40478) Add create datasource table options docs

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40478: Assignee: XiDuo You > Add create datasource table options docs >

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2022-09-26 Thread John Pellman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609507#comment-17609507 ] John Pellman edited comment on SPARK-12216 at 9/26/22 1:42 PM: --- Just as

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2022-09-26 Thread John Pellman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609507#comment-17609507 ] John Pellman edited comment on SPARK-12216 at 9/26/22 1:40 PM: --- Just as

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2022-09-26 Thread John Pellman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609507#comment-17609507 ] John Pellman commented on SPARK-12216: -- Just as another data point, it appears that a variant of

[jira] [Created] (SPARK-40567) SharedState to redact secrets when propagating them to HadoopConf

2022-09-26 Thread Steve Loughran (Jira)
Steve Loughran created SPARK-40567: -- Summary: SharedState to redact secrets when propagating them to HadoopConf Key: SPARK-40567 URL: https://issues.apache.org/jira/browse/SPARK-40567 Project: Spark

[jira] [Created] (SPARK-40566) Add showIndex function

2022-09-26 Thread KaiXinXIaoLei (Jira)
KaiXinXIaoLei created SPARK-40566: - Summary: Add showIndex function Key: SPARK-40566 URL: https://issues.apache.org/jira/browse/SPARK-40566 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40565: Assignee: Apache Spark > Non-deterministic filters shouldn't get pushed to V2 file

[jira] [Commented] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609489#comment-17609489 ] Apache Spark commented on SPARK-40565: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40565: Assignee: (was: Apache Spark) > Non-deterministic filters shouldn't get pushed to V2

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Description: When I ran my program with the Dataframe structure in Pyspark.PANDAS, there is an

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: Part of the code.png > The distributed runtime has one more identical process with a

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: Value of df.png > The distributed runtime has one more identical process with a small

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: The output of the abnormal process.png > The distributed runtime has one more identical

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: (was: 2022-09-26 20-54-37 的屏幕截图.png) > The distributed runtime has one more

[jira] [Created] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Adam Binford (Jira)
Adam Binford created SPARK-40565: Summary: Non-deterministic filters shouldn't get pushed to V2 file sources Key: SPARK-40565 URL: https://issues.apache.org/jira/browse/SPARK-40565 Project: Spark

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Remaining Estimate: (was: 672h) Original Estimate: (was: 672h) > The distributed

[jira] [Created] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
YuNing Liu created SPARK-40564: -- Summary: The distributed runtime has one more identical process with a small amount of data on the master Key: SPARK-40564 URL: https://issues.apache.org/jira/browse/SPARK-40564

[jira] [Resolved] (SPARK-40560) Rename message to messageFormat in the STANDARD format of errors

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40560. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37997

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: sql.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: sql.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: test.sql) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example-1.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: test.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: test.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example-1.txt) > Error at where clause, when sql case executes by else branch

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch >

  1   2   >