[jira] [Assigned] (SPARK-44508) Add user guide for Python UDTFs

[ https://issues.apache.org/jira/browse/SPARK-44508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44508: Assignee: Allison Wang > Add user guide for Python UDTFs >

[jira] [Resolved] (SPARK-44508) Add user guide for Python UDTFs

[ https://issues.apache.org/jira/browse/SPARK-44508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44508. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-43252) Assign a name to the error class _LEGACY_ERROR_TEMP_2016

[ https://issues.apache.org/jira/browse/SPARK-43252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762945#comment-17762945 ] Snoot.io commented on SPARK-43252: -- User 'dengziming' has created a pull request for this issue:

[jira] [Commented] (SPARK-45104) Upgrade graphlib-dot.min.js from 0.6.4 to 1.0.2

[ https://issues.apache.org/jira/browse/SPARK-45104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762938#comment-17762938 ] Snoot.io commented on SPARK-45104: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-45104) Upgrade graphlib-dot.min.js from 0.6.4 to 1.0.2

Kent Yao created SPARK-45104: Summary: Upgrade graphlib-dot.min.js from 0.6.4 to 1.0.2 Key: SPARK-45104 URL: https://issues.apache.org/jira/browse/SPARK-45104 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-44805) Data lost after union using spark.sql.parquet.enableNestedColumnVectorizedReader=true

[ https://issues.apache.org/jira/browse/SPARK-44805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762935#comment-17762935 ] Snoot.io commented on SPARK-44805: -- User 'bersprockets' has created a pull request for this issue:

[jira] [Assigned] (SPARK-45103) Update ORC to 1.8.5

[ https://issues.apache.org/jira/browse/SPARK-45103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45103: - Assignee: Dongjoon Hyun > Update ORC to 1.8.5 > --- > >

[jira] [Resolved] (SPARK-45103) Update ORC to 1.8.5

[ https://issues.apache.org/jira/browse/SPARK-45103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45103. --- Fix Version/s: 3.4.2 Resolution: Fixed Issue resolved by pull request 42851

[jira] [Commented] (SPARK-44732) Port the initial implementation of Spark XML data source

[ https://issues.apache.org/jira/browse/SPARK-44732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762891#comment-17762891 ] Ignite TC Bot commented on SPARK-44732: --- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-45103) Update ORC to 1.8.5

[ https://issues.apache.org/jira/browse/SPARK-45103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45103: -- Summary: Update ORC to 1.8.5 (was: Update ORC to 1.8.4) > Update ORC to 1.8.5 >

[jira] [Created] (SPARK-45103) Update ORC to 1.8.4

Dongjoon Hyun created SPARK-45103: - Summary: Update ORC to 1.8.4 Key: SPARK-45103 URL: https://issues.apache.org/jira/browse/SPARK-45103 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-45084) ProgressReport should include an accurate effective shuffle partition number

[ https://issues.apache.org/jira/browse/SPARK-45084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762825#comment-17762825 ] Hudson commented on SPARK-45084: User 'siying' has created a pull request for this issue:

[jira] [Updated] (SPARK-44805) Data lost after union using spark.sql.parquet.enableNestedColumnVectorizedReader=true

[ https://issues.apache.org/jira/browse/SPARK-44805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-44805: -- Affects Version/s: 3.4.1 > Data lost after union using >

[jira] [Created] (SPARK-45102) Support keyword columns on filters that interact with HMS

Steve Carlin created SPARK-45102: Summary: Support keyword columns on filters that interact with HMS Key: SPARK-45102 URL: https://issues.apache.org/jira/browse/SPARK-45102 Project: Spark

[jira] [Commented] (SPARK-44805) Data lost after union using spark.sql.parquet.enableNestedColumnVectorizedReader=true

[ https://issues.apache.org/jira/browse/SPARK-44805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762792#comment-17762792 ] Bruce Robbins commented on SPARK-44805: --- PR here: https://github.com/apache/spark/pull/42850 >

[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even when all of it's tasks are succeeded

[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Summary: Spark UI: A stage is still active even when all of it's tasks are succeeded (was: Spark UI: A

[jira] [Resolved] (SPARK-45077) Upgrade dagre-d3.js from 0.4.3 to 0.6.4

[ https://issues.apache.org/jira/browse/SPARK-45077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45077. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42815

[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even all of it's tasks are succeeded

[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Description: In the stage UI, we can see all the tasks' statuses are SUCCESS. But the stage is still

[jira] [Updated] (SPARK-45077) Upgrade dagre-d3.js from 0.4.3 to 0.6.4

[ https://issues.apache.org/jira/browse/SPARK-45077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45077: - Priority: Minor (was: Major) > Upgrade dagre-d3.js from 0.4.3 to 0.6.4 >

[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even all of it's tasks are succeeded

[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Description: Go into the stage UI, we can see all the tasks' statuses are SUCCESS. But the stage is

[jira] [Assigned] (SPARK-45077) Upgrade dagre-d3.js from 0.4.3 to 0.6.4

[ https://issues.apache.org/jira/browse/SPARK-45077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45077: Assignee: Kent Yao > Upgrade dagre-d3.js from 0.4.3 to 0.6.4 >

[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even all of it's tasks are succeeded

[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Summary: Spark UI: A stage is still active even all of it's tasks are succeeded (was: Spark UI: A killed

[jira] [Updated] (SPARK-45101) Spark UI: A killed task should not be marked as succeeded

[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Attachment: 2.png 1.png 3.png > Spark UI: A killed task should not be

[jira] [Updated] (SPARK-45101) Spark UI: A killed task should not be marked as succeeded

[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Description: A task is already killed. But it is still marked as succeeded, which causes the stage never

[jira] [Created] (SPARK-45101) Spark UI: A killed task should not be marked as succeeded

RickyMa created SPARK-45101: --- Summary: Spark UI: A killed task should not be marked as succeeded Key: SPARK-45101 URL: https://issues.apache.org/jira/browse/SPARK-45101 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45100) reflect() fails with an internal error on NULL class and method

[ https://issues.apache.org/jira/browse/SPARK-45100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-45100: - Description: The example below demonstrates the issue: {code:sql} spark-sql (default)> select

[jira] [Created] (SPARK-45100) reflect() fails with an internal error on NULL class and method

Max Gekk created SPARK-45100: Summary: reflect() fails with an internal error on NULL class and method Key: SPARK-45100 URL: https://issues.apache.org/jira/browse/SPARK-45100 Project: Spark

[jira] [Updated] (SPARK-45100) reflect() fails with an internal error on NULL class and method

[ https://issues.apache.org/jira/browse/SPARK-45100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-45100: - Fix Version/s: (was: 3.5.0) (was: 4.0.0) (was: 3.4.2)

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Priority: Minor (was: Major) > SortMergeExec with Outer using join forgets sort information >

[jira] [Created] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

Huw created SPARK-45099: --- Summary: SortMergeExec with Outer using join forgets sort information Key: SPARK-45099 URL: https://issues.apache.org/jira/browse/SPARK-45099 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762699#comment-17762699 ] Michael Negodaev commented on SPARK-34645: -- Here is the dump: [^dump.txt]. > [K8S] Driver pod

[jira] [Updated] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Negodaev updated SPARK-34645: - Attachment: dump.txt > [K8S] Driver pod stuck in Running state after job completes >

[jira] [Assigned] (SPARK-45080) Kafka DSv2 streaming source implementation calls planInputPartitions 4 times per microbatch

[ https://issues.apache.org/jira/browse/SPARK-45080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45080: Assignee: Jungtaek Lim > Kafka DSv2 streaming source implementation calls

[jira] [Resolved] (SPARK-45080) Kafka DSv2 streaming source implementation calls planInputPartitions 4 times per microbatch

[ https://issues.apache.org/jira/browse/SPARK-45080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45080. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42823

[jira] [Created] (SPARK-45098) Custom jekyll-rediect-from redirect.html template

Kent Yao created SPARK-45098: Summary: Custom jekyll-rediect-from redirect.html template Key: SPARK-45098 URL: https://issues.apache.org/jira/browse/SPARK-45098 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762581#comment-17762581 ] Michael Negodaev edited comment on SPARK-34645 at 9/7/23 9:42 AM: --

[jira] [Comment Edited] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762581#comment-17762581 ] Michael Negodaev edited comment on SPARK-34645 at 9/7/23 9:40 AM: --

[jira] [Resolved] (SPARK-45089) Remove obsolete repo of DB2 JDBC driver

[ https://issues.apache.org/jira/browse/SPARK-45089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-45089. - Fix Version/s: 4.0.0 Assignee: Cheng Pan Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-45086) Display hexadecimal for thread lock hash code

[ https://issues.apache.org/jira/browse/SPARK-45086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45086. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42826

[jira] [Assigned] (SPARK-45086) Display hexadecimal for thread lock hash code

[ https://issues.apache.org/jira/browse/SPARK-45086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45086: Assignee: Kent Yao > Display hexadecimal for thread lock hash code >

[jira] [Updated] (SPARK-45068) Make math function output column name displayed in upper-cased style

[ https://issues.apache.org/jira/browse/SPARK-45068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45068: Summary: Make math function output column name displayed in upper-cased style (was: Make

[jira] [Comment Edited] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762581#comment-17762581 ] Michael Negodaev edited comment on SPARK-34645 at 9/7/23 6:34 AM: --

[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762581#comment-17762581 ] Michael Negodaev commented on SPARK-34645: -- Faced with a similar problem with Spark 3.3.2 on