[jira] [Updated] (SPARK-44074) `Logging plan changes for execution` test failed

[ https://issues.apache.org/jira/browse/SPARK-44074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44074: - Affects Version/s: 3.4.2 3.3.4 > `Logging plan changes for execution` test failed

[jira] [Updated] (SPARK-44034) Add a new test group for sql module

[ https://issues.apache.org/jira/browse/SPARK-44034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44034: - Affects Version/s: 3.4.2 3.3.4 > Add a new test group for sql module > --

[jira] [Updated] (SPARK-45377) [CORE] Handle InputStream in NettyLogger

[ https://issues.apache.org/jira/browse/SPARK-45377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45377: --- Labels: pull-request-available (was: ) > [CORE] Handle InputStream in NettyLogger > ---

[jira] [Updated] (SPARK-45378) [CORE] Add convertToNettyForSsl to ManagedBuffer

[ https://issues.apache.org/jira/browse/SPARK-45378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45378: --- Labels: pull-request-available (was: ) > [CORE] Add convertToNettyForSsl to ManagedBuffer >

[jira] [Closed] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan closed SPARK-45227. --- > Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an > executo

[jira] [Assigned] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45227: --- Assignee: Bo Xiong > Fix a subtle thread-safety issue with CoarseGrainedExe

[jira] [Resolved] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45227. - Resolution: Fixed > Fix a subtle thread-safety issue with CoarseGrainedExecutorB

[jira] [Updated] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-45227: Fix Version/s: 3.4.2 4.0.0 3.5.1 > Fix a sub

[jira] [Assigned] (SPARK-45276) Replace Java 8 and Java 11 installed in the Dockerfile with Java

[ https://issues.apache.org/jira/browse/SPARK-45276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45276: Assignee: BingKun Pan > Replace Java 8 and Java 11 installed in the Dockerfile with Java > --

[jira] [Resolved] (SPARK-45276) Replace Java 8 and Java 11 installed in the Dockerfile with Java

[ https://issues.apache.org/jira/browse/SPARK-45276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45276. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43076 [https://github.com

[jira] [Assigned] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45057: --- Assignee: Zhongwei Zhu > Deadlock caused by rdd replication level of 2 > --

[jira] [Resolved] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45057. - Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Created] (SPARK-45378) [CORE] Add convertToNettyForSsl to ManagedBuffer

Hasnain Lakhani created SPARK-45378: --- Summary: [CORE] Add convertToNettyForSsl to ManagedBuffer Key: SPARK-45378 URL: https://issues.apache.org/jira/browse/SPARK-45378 Project: Spark Issue

[jira] [Created] (SPARK-45377) [CORE] Handle InputStream in NettyLogger

Hasnain Lakhani created SPARK-45377: --- Summary: [CORE] Handle InputStream in NettyLogger Key: SPARK-45377 URL: https://issues.apache.org/jira/browse/SPARK-45377 Project: Spark Issue Type: Ta

[jira] [Created] (SPARK-45376) [CORE] Add netty-tcnative-boringssl-static dependency

Hasnain Lakhani created SPARK-45376: --- Summary: [CORE] Add netty-tcnative-boringssl-static dependency Key: SPARK-45376 URL: https://issues.apache.org/jira/browse/SPARK-45376 Project: Spark I

[jira] [Created] (SPARK-45375) [CORE] Mark connection as timedOut in TransportClient.close

Hasnain Lakhani created SPARK-45375: --- Summary: [CORE] Mark connection as timedOut in TransportClient.close Key: SPARK-45375 URL: https://issues.apache.org/jira/browse/SPARK-45375 Project: Spark

[jira] [Resolved] (SPARK-45374) [CORE] Add test SSL keys

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani resolved SPARK-45374. - Resolution: Fixed Fixed by [https://github.com/apache/spark/pull/43163] [~mridul] / [~j

[jira] [Updated] (SPARK-44895) Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class

[ https://issues.apache.org/jira/browse/SPARK-44895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44895: - Priority: Minor (was: Major) > Considering 'daemon', 'priority' from higher JDKs for ThreadStac

[jira] [Resolved] (SPARK-45375) [CORE] Mark connection as timedOut in TransportClient.close

[ https://issues.apache.org/jira/browse/SPARK-45375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani resolved SPARK-45375. - Resolution: Fixed Resolved by [https://github.com/apache/spark/pull/43162] [~mridul] I'

[jira] [Updated] (SPARK-45374) [CORE] Add test keys for SSL functionality

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani updated SPARK-45374: Summary: [CORE] Add test keys for SSL functionality (was: [CORE] Add test SSL keys) > [C

[jira] [Created] (SPARK-45374) [CORE] Add test SSL keys

Hasnain Lakhani created SPARK-45374: --- Summary: [CORE] Add test SSL keys Key: SPARK-45374 URL: https://issues.apache.org/jira/browse/SPARK-45374 Project: Spark Issue Type: Task Com

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani updated SPARK-44937: Issue Type: Epic (was: New Feature) > [umbrella] Add SSL/TLS support for RPC and Shuffle

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani updated SPARK-44937: Summary: [umbrella] Add SSL/TLS support for RPC and Shuffle communications (was: Add SSL/

[jira] [Reopened] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani reopened SPARK-44937: - > Add SSL/TLS support for RPC and Shuffle communications > -

[jira] [Resolved] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44937. - Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Assigned] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44937: --- Assignee: Hasnain Lakhani > Add SSL/TLS support for RPC and Shuffle communi

[jira] [Resolved] (SPARK-44895) Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class

[ https://issues.apache.org/jira/browse/SPARK-44895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44895. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43095 [https://gi

[jira] [Assigned] (SPARK-44895) Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class

[ https://issues.apache.org/jira/browse/SPARK-44895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44895: Assignee: Kent Yao > Considering 'daemon', 'priority' from higher JDKs for ThreadStackTra

[jira] [Updated] (SPARK-42205) Remove logging of Accumulables in Task/Stage start events in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-42205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42205: --- Labels: pull-request-available (was: ) > Remove logging of Accumulables in Task/Stage start

[jira] [Resolved] (SPARK-45362) Project out PARTITION BY expressions before 'eval' method consumes input rows

[ https://issues.apache.org/jira/browse/SPARK-45362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-45362. --- Fix Version/s: 4.0.0 Assignee: Daniel Resolution: Fixed Issue resolved by pu

[jira] [Commented] (SPARK-45373) Minimizing calls to HiveMetaStore layer for getting partitions, when tables are repeated

[ https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770220#comment-17770220 ] Asif commented on SPARK-45373: -- Will be generating a PR for this. > Minimizing calls to Hi

[jira] [Created] (SPARK-45373) Minimizing calls to HiveMetaStore layer for getting partitions, when tables are repeated

Asif created SPARK-45373: Summary: Minimizing calls to HiveMetaStore layer for getting partitions, when tables are repeated Key: SPARK-45373 URL: https://issues.apache.org/jira/browse/SPARK-45373 Project: Sp

[jira] [Updated] (SPARK-43049) Use CLOB instead of VARCHAR(255) for StringType for Oracle jdbc

[ https://issues.apache.org/jira/browse/SPARK-43049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43049: --- Labels: pull-request-available (was: ) > Use CLOB instead of VARCHAR(255) for StringType fo

[jira] [Assigned] (SPARK-45365) Allow the daily tests of branch-3.4 to use the new test group tags

[ https://issues.apache.org/jira/browse/SPARK-45365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-45365: Assignee: Yang Jie > Allow the daily tests of branch-3.4 to use the new test group tags > ---

[jira] [Resolved] (SPARK-45365) Allow the daily tests of branch-3.4 to use the new test group tags

[ https://issues.apache.org/jira/browse/SPARK-45365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-45365. -- Fix Version/s: 4.0.0 Resolution: Fixed > Allow the daily tests of branch-3.4 to use the new tes

[jira] [Updated] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36112: --- Labels: pull-request-available (was: ) > Enable DecorrelateInnerQuery for IN/EXISTS subquer

[jira] [Updated] (SPARK-45372) Handle ClassNotFoundException when load extension

[ https://issues.apache.org/jira/browse/SPARK-45372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45372: --- Labels: pull-request-available (was: ) > Handle ClassNotFoundException when load extension

[jira] [Updated] (SPARK-45372) Handle ClassNotFoundException when load extension

[ https://issues.apache.org/jira/browse/SPARK-45372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-45372: - Summary: Handle ClassNotFoundException when load extension (was: Handle ClassNotFound when load

[jira] [Created] (SPARK-45372) Handle ClassNotFound when load extension

Zhongwei Zhu created SPARK-45372: Summary: Handle ClassNotFound when load extension Key: SPARK-45372 URL: https://issues.apache.org/jira/browse/SPARK-45372 Project: Spark Issue Type: Improvem

[jira] [Created] (SPARK-45371) FIx shading problem in Spark Connect

Herman van Hövell created SPARK-45371: - Summary: FIx shading problem in Spark Connect Key: SPARK-45371 URL: https://issues.apache.org/jira/browse/SPARK-45371 Project: Spark Issue Type: Ne

[jira] [Resolved] (SPARK-45266) Refactor ResolveFunctions analyzer rule to delay making lateral join when table arguments are used

[ https://issues.apache.org/jira/browse/SPARK-45266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-45266. --- Fix Version/s: 4.0.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Resolved] (SPARK-45360) Initialize spark session builder configuration from SPARK_REMOTE

[ https://issues.apache.org/jira/browse/SPARK-45360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-45360. --- Fix Version/s: 4.0.0 3.5.1 Assignee: Yihong He Res

[jira] [Updated] (SPARK-45330) Upgrade ammonite to 2.5.11

[ https://issues.apache.org/jira/browse/SPARK-45330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45330: - Summary: Upgrade ammonite to 2.5.11 (was: Upgrade ammonite to 2.6.0) > Upgrade ammonite to 2.5.11 > ---

[jira] [Updated] (SPARK-45330) Upgrade ammonite to 2.6.0

[ https://issues.apache.org/jira/browse/SPARK-45330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45330: --- Labels: pull-request-available (was: ) > Upgrade ammonite to 2.6.0 > --

[jira] [Assigned] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45364: Assignee: BingKun Pan > Clean up the unnecessary Scala 2.12 logical in SparkBuild > -

[jira] [Updated] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45364: - Priority: Trivial (was: Minor) > Clean up the unnecessary Scala 2.12 logical in SparkBuild > --

[jira] [Resolved] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45364. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43158 [https://gi

[jira] [Updated] (SPARK-45370) Fix python test when ansi mode enabled

[ https://issues.apache.org/jira/browse/SPARK-45370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45370: --- Labels: pull-request-available (was: ) > Fix python test when ansi mode enabled > -