[jira] [Updated] (SPARK-47243) Correct the package name of `StateMetadataSource.scala`

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47243: --- Labels: pull-request-available (was: ) > Correct the package name of

[jira] [Created] (SPARK-47243) Correct the package name of `StateMetadataSource.scala`

2024-02-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-47243: Summary: Correct the package name of `StateMetadataSource.scala` Key: SPARK-47243 URL: https://issues.apache.org/jira/browse/SPARK-47243 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47242) Bump ap-loader 3.0(v8) to support for async-profiler 3.0

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47242: --- Labels: pull-request-available (was: ) > Bump ap-loader 3.0(v8) to support for

[jira] [Updated] (SPARK-47242) Bump ap-loader 3.0(v8) to support for async-profiler 3.0

2024-02-29 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated SPARK-47242: --- Description: ap-loader 3.0(v8) has already been released, which supports for async-profier

[jira] [Updated] (SPARK-47242) Bump ap-loader 3.0 v8 to support for async-profiler 3.0

2024-02-29 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated SPARK-47242: --- Summary: Bump ap-loader 3.0 v8 to support for async-profiler 3.0 (was: Bump ap-loader v8

[jira] [Updated] (SPARK-47242) Bump ap-loader 3.0(v8) to support for async-profiler 3.0

2024-02-29 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated SPARK-47242: --- Summary: Bump ap-loader 3.0(v8) to support for async-profiler 3.0 (was: Bump ap-loader 3.0

[jira] [Resolved] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-26494. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45337

[jira] [Assigned] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42627: Assignee: Kent Yao > Spark: Getting SQLException: Unsupported type -102 reading from Oracle >

[jira] [Assigned] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-26494: Assignee: Kent Yao > Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type >

[jira] [Resolved] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42627. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45337

[jira] [Updated] (SPARK-47241) fix rule order issues for ExtractGenerator

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47241: --- Labels: pull-request-available (was: ) > fix rule order issues for ExtractGenerator >

[jira] [Created] (SPARK-47242) Bump ap-loader v8 to support for async-profiler 3.0

2024-02-29 Thread Nicholas Jiang (Jira)
Nicholas Jiang created SPARK-47242: -- Summary: Bump ap-loader v8 to support for async-profiler 3.0 Key: SPARK-47242 URL: https://issues.apache.org/jira/browse/SPARK-47242 Project: Spark

[jira] [Created] (SPARK-47241) fix rule order issues for ExtractGenerator

2024-02-29 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47241: --- Summary: fix rule order issues for ExtractGenerator Key: SPARK-47241 URL: https://issues.apache.org/jira/browse/SPARK-47241 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-47235) Disable deleteRecursivelyUsingUnixNative in Apple Silicon test env

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47235. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45344

[jira] [Assigned] (SPARK-47235) Disable deleteRecursivelyUsingUnixNative in Apple Silicon test env

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47235: - Assignee: Dongjoon Hyun > Disable deleteRecursivelyUsingUnixNative in Apple Silicon

[jira] [Updated] (SPARK-47240) SPIP: Structured Spark Logging

2024-02-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47240: --- Description: This proposal aims to enhance Apache Spark's logging system by implementing

[jira] [Created] (SPARK-47240) SPIP: Structured Spark Logging

2024-02-29 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47240: -- Summary: SPIP: Structured Spark Logging Key: SPARK-47240 URL: https://issues.apache.org/jira/browse/SPARK-47240 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47236. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47236: - Assignee: Dongjoon Hyun > Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file

[jira] [Updated] (SPARK-47239) Support distinct window function

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47239: --- Labels: pull-request-available (was: ) > Support distinct window function >

[jira] [Created] (SPARK-47239) Support distinct window function

2024-02-29 Thread Mingliang Zhu (Jira)
Mingliang Zhu created SPARK-47239: - Summary: Support distinct window function Key: SPARK-47239 URL: https://issues.apache.org/jira/browse/SPARK-47239 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47238) Reduce executor memory usage by making generated code in WSCG a broadcast variable

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47238: --- Labels: pull-request-available (was: ) > Reduce executor memory usage by making generated

[jira] [Created] (SPARK-47238) Reduce executor memory usage by making generated code in WSCG a broadcast variable

2024-02-29 Thread Yan-Lin (Jared) Wang (Jira)
Yan-Lin (Jared) Wang created SPARK-47238: Summary: Reduce executor memory usage by making generated code in WSCG a broadcast variable Key: SPARK-47238 URL:

[jira] [Updated] (SPARK-47237) Upgrade xmlschema-core to 2.3.1

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47237: --- Labels: pull-request-available (was: ) > Upgrade xmlschema-core to 2.3.1 >

[jira] [Created] (SPARK-47237) Upgrade xmlschema-core to 2.3.1

2024-02-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47237: --- Summary: Upgrade xmlschema-core to 2.3.1 Key: SPARK-47237 URL: https://issues.apache.org/jira/browse/SPARK-47237 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47236: --- Labels: pull-request-available (was: ) > Fix `deleteRecursivelyUsingJavaIO` to skip

[jira] [Updated] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47236: -- Affects Version/s: 3.3.4 3.5.1 3.4.2

[jira] [Created] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file

2024-02-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47236: - Summary: Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file Key: SPARK-47236 URL: https://issues.apache.org/jira/browse/SPARK-47236 Project: Spark

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in stage

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Issue Type: Improvement (was: Bug) > Support Stage Isolated Executor JVM Profiling >

[jira] [Updated] (SPARK-47235) Disable deleteRecursivelyUsingUnixNative in Apple Silicon test env

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47235: --- Labels: pull-request-available (was: ) > Disable deleteRecursivelyUsingUnixNative in Apple

[jira] [Created] (SPARK-47235) Disable deleteRecursivelyUsingUnixNative in Apple Silicon test env

2024-02-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47235: - Summary: Disable deleteRecursivelyUsingUnixNative in Apple Silicon test env Key: SPARK-47235 URL: https://issues.apache.org/jira/browse/SPARK-47235 Project: Spark

[jira] [Resolved] (SPARK-47218) XML: Ignore commented Row Tags in XML tokenizer

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47218. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45325

[jira] [Assigned] (SPARK-47218) XML: Ignore commented Row Tags in XML tokenizer

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47218: Assignee: Yousof Hosny > XML: Ignore commented Row Tags in XML tokenizer >

[jira] [Assigned] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47211: Assignee: Nikola Mandic > Fix ignored PySpark Connect string collation >

[jira] [Resolved] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47211. -- Resolution: Fixed Issue resolved by pull request 45316

[jira] [Updated] (SPARK-47217) De-duplication of Relations in Joins, can result in plan resolution failure

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47217: --- Labels: Spark-SQL pull-request-available (was: Spark-SQL) > De-duplication of Relations in

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-29 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Resolved] (SPARK-47200) Handle and classify errors from ForEachBatchSink user function

2024-02-29 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47200. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45299

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Affects Version/s: 3.4.0 > Spark-UI stages and other tabs not accessible in standalone mode

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Description: When enabled reverse proxy in master and worker configOptions. We're not able

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Attachment: Screenshot 2024-02-09 at 5.13.01 PM.png > Spark-UI stages and other tabs not

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Attachment: Screenshot 2024-02-09 at 5.09.28 PM.png > Spark-UI stages and other tabs not

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Attachment: Screenshot 2024-02-09 at 5.04.49 PM.png > Spark-UI stages and other tabs not

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Attachment: Screenshot 2024-02-09 at 5.05.48 PM.png > Spark-UI stages and other tabs not

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Description: When enabled reverse proxy in master and worker configOptions. We're not able

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Environment: (was: Steps to reproduce: After installing the chart Spark Cluster(Master and

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Description: When enabled reverse proxy in master and worker configOptions. We're not able

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Description: When enabled reverse proxy in master and worker configOptions. We're not able

[jira] [Created] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
Sharad Mishra created SPARK-47232: - Summary: Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled Key: SPARK-47232 URL: https://issues.apache.org/jira/browse/SPARK-47232

[jira] [Updated] (SPARK-47232) Spark-UI stages and other tabs not accessible in standalone mode when reverse-proxy is enabled

2024-02-29 Thread Sharad Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Mishra updated SPARK-47232: -- Environment: Steps to reproduce: After installing the chart Spark Cluster(Master and worker)

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-29 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822302#comment-17822302 ] nirav patel commented on SPARK-46762: - Hi [~zhenli] I added some high level steps to reproduce that

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-29 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-29 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Commented] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

2024-02-29 Thread Dmitry Kravchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822285#comment-17822285 ] Dmitry Kravchuk commented on SPARK-45201: - Hey, I've faced same error with spark 3.5.0 at hadoop

[jira] [Assigned] (SPARK-47229) Change the never changed 'var' to 'val'

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47229: - Assignee: Yang Jie > Change the never changed 'var' to 'val' >

[jira] [Resolved] (SPARK-47229) Change the never changed 'var' to 'val'

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47229. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45338

[jira] [Closed] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47223. - > Update usage of deprecated Thread.getId() to Thread.threadId() >

[jira] [Resolved] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47223. --- Fix Version/s: (was: 3.5.1) Resolution: Invalid The minimum support JDK version

[jira] [Commented] (SPARK-47223) Update usage of deprecated Thread.getId() to Thread.threadId()

2024-02-29 Thread Neil Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1788#comment-1788 ] Neil Gupta commented on SPARK-47223: Update: Realized that the minimum Java version here is Java 17,

[jira] [Resolved] (SPARK-47015) Disable partitioning on collated columns

2024-02-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47015. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45104

[jira] [Updated] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41392: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > spark builds against hadoop

[jira] [Resolved] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41392. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45317

[jira] [Assigned] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41392: - Assignee: Yang Jie > spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in

[jira] [Assigned] (SPARK-47231) FakeTask should reference its TaskMetrics to avoid TaskMetrics accumulators being GCed before stage completion

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47231: - Assignee: Wenchen Fan > FakeTask should reference its TaskMetrics to avoid TaskMetrics

[jira] [Updated] (SPARK-47231) FakeTask should reference its TaskMetrics to avoid TaskMetrics accumulators being GCed before stage completion

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47231: --- Labels: pull-request-available (was: ) > FakeTask should reference its TaskMetrics to

[jira] [Resolved] (SPARK-47231) FakeTask should reference its TaskMetrics to avoid TaskMetrics accumulators being GCed before stage completion

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47231. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45336

[jira] [Created] (SPARK-47231) FakeTask should reference its TaskMetrics to avoid TaskMetrics accumulators being GCed before stage completion

2024-02-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47231: - Summary: FakeTask should reference its TaskMetrics to avoid TaskMetrics accumulators being GCed before stage completion Key: SPARK-47231 URL:

[jira] [Updated] (SPARK-47227) Spark Connect Documentation

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47227: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Spark Connect

[jira] [Resolved] (SPARK-47227) Spark Connect Documentation

2024-02-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47227. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45335

[jira] [Updated] (SPARK-47230) The column pruning is not working as expected for nested struct in an array

2024-02-29 Thread Ling Qin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ling Qin updated SPARK-47230: - Summary: The column pruning is not working as expected for nested struct in an array (was: The column

[jira] [Updated] (SPARK-47230) The column pruning is not working as expected for the nested struct in an array

2024-02-29 Thread Ling Qin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ling Qin updated SPARK-47230: - Description: See the code snippet below, when explode an array of struct and select one field in the

[jira] [Created] (SPARK-47230) The column pruning is not working as expected for the nested struct in an array

2024-02-29 Thread Ling Qin (Jira)
Ling Qin created SPARK-47230: Summary: The column pruning is not working as expected for the nested struct in an array Key: SPARK-47230 URL: https://issues.apache.org/jira/browse/SPARK-47230 Project:

[jira] [Updated] (SPARK-47229) Change the never changed 'var' to 'val'

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47229: --- Labels: pull-request-available (was: ) > Change the never changed 'var' to 'val' >

[jira] [Created] (SPARK-47229) Change the never changed 'var' to 'val'

2024-02-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-47229: Summary: Change the never changed 'var' to 'val' Key: SPARK-47229 URL: https://issues.apache.org/jira/browse/SPARK-47229 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47224) Split `test_split_apply_basic`

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45332

[jira] [Updated] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-02-29 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47198: -- Description: spark on k8s runs multiple spark apps at the same time. proxy/[sparkappid] path, forwarding to

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42627: --- Labels: pull-request-available (was: ) > Spark: Getting SQLException: Unsupported type

[jira] [Updated] (SPARK-47228) spark.files are not copied to Spark Executors in client session mode

2024-02-29 Thread Alexey Golovizin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Golovizin updated SPARK-47228: - Description: Hi folks! And thank you for you brilliant project. I'm using PySpark for

[jira] [Created] (SPARK-47228) spark.files are not copied to Spark Executors in client session mode

2024-02-29 Thread Alexey Golovizin (Jira)
Alexey Golovizin created SPARK-47228: Summary: spark.files are not copied to Spark Executors in client session mode Key: SPARK-47228 URL: https://issues.apache.org/jira/browse/SPARK-47228

[jira] [Updated] (SPARK-47227) Spark Connect Documentation

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47227: --- Labels: pull-request-available (was: ) > Spark Connect Documentation >

[jira] [Created] (SPARK-47227) Spark Connect Documentation

2024-02-29 Thread Martin Grund (Jira)
Martin Grund created SPARK-47227: Summary: Spark Connect Documentation Key: SPARK-47227 URL: https://issues.apache.org/jira/browse/SPARK-47227 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in

[jira] [Created] (SPARK-47226) Move DataSourceMetricsMixin from JDBC RDD to JDBC Relation

2024-02-29 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-47226: -- Summary: Move DataSourceMetricsMixin from JDBC RDD to JDBC Relation Key: SPARK-47226 URL: https://issues.apache.org/jira/browse/SPARK-47226 Project: Spark

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be ignored. Task code executed in stage

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be flooded. Task code executed in stage

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be flooded. Task code executed in stage

[jira] [Updated] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王俊博 updated SPARK-47225: Description: Different stages execute different codes, and hot spots will be flooded. Task code executed in stage

[jira] [Updated] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37932: --- Labels: pull-request-available (was: ) > Analyzer can fail when join left side and right

[jira] [Created] (SPARK-47225) Support Stage Isolated Executor JVM Profiling

2024-02-29 Thread Jira
王俊博 created SPARK-47225: --- Summary: Support Stage Isolated Executor JVM Profiling Key: SPARK-47225 URL: https://issues.apache.org/jira/browse/SPARK-47225 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: Apache Spark > Add COLLATION_ENABLED config flag >

[jira] [Assigned] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47102: -- Assignee: (was: Apache Spark) > Add COLLATION_ENABLED config flag >

  1   2   >