[jira] [Commented] (SPARK-42105) Document work (Release note & Guide doc) for SPARK-40925

[ https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678114#comment-17678114 ] Jungtaek Lim commented on SPARK-42105: -- Let me set this to blocker so that I won't miss this on

[jira] [Updated] (SPARK-42105) Document work (Release note & Guide doc) for SPARK-40925

[ https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-42105: - Priority: Blocker (was: Major) > Document work (Release note & Guide doc) for SPARK-40925 >

[jira] [Created] (SPARK-42105) Document work (Release note & Guide doc) for SPARK-40925

Jungtaek Lim created SPARK-42105: Summary: Document work (Release note & Guide doc) for SPARK-40925 Key: SPARK-42105 URL: https://issues.apache.org/jira/browse/SPARK-42105 Project: Spark

[jira] [Assigned] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

[ https://issues.apache.org/jira/browse/SPARK-42100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42100: -- Assignee: Yang Jie > Protect null `SQLExecutionUIData#description` in >

[jira] [Resolved] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

[ https://issues.apache.org/jira/browse/SPARK-42100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42100. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39623

[jira] [Assigned] (SPARK-42080) Add guideline for PySpark errors.

[ https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42080: Assignee: (was: Apache Spark) > Add guideline for PySpark errors. >

[jira] [Commented] (SPARK-42080) Add guideline for PySpark errors.

[ https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678098#comment-17678098 ] Apache Spark commented on SPARK-42080: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42080) Add guideline for PySpark errors.

[ https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42080: Assignee: Apache Spark > Add guideline for PySpark errors. >

[jira] [Assigned] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42078: Assignee: Haejoon Lee > Migrate errors thrown by JVM into PySpark Exception. >

[jira] [Resolved] (SPARK-42078) Migrate errors thrown by JVM into PySpark Exception.

[ https://issues.apache.org/jira/browse/SPARK-42078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42078. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39591

[jira] [Updated] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

[ https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-40885: -- Affects Version/s: 3.4.0 > Spark will filter out data field sorting when dynamic partitions

[jira] [Commented] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH

[ https://issues.apache.org/jira/browse/SPARK-41485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678088#comment-17678088 ] Apache Spark commented on SPARK-41485: -- User 'WolverineJiang' has created a pull request for this

[jira] [Commented] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH

[ https://issues.apache.org/jira/browse/SPARK-41485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678089#comment-17678089 ] Apache Spark commented on SPARK-41485: -- User 'WolverineJiang' has created a pull request for this

[jira] [Assigned] (SPARK-41777) Add Integration Tests

[ https://issues.apache.org/jira/browse/SPARK-41777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41777: Assignee: Apache Spark > Add Integration Tests > - > >

[jira] [Commented] (SPARK-41598) Migrate the errors from `pyspark/sql/functions.py` into error class.

[ https://issues.apache.org/jira/browse/SPARK-41598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678082#comment-17678082 ] Apache Spark commented on SPARK-41598: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41598) Migrate the errors from `pyspark/sql/functions.py` into error class.

[ https://issues.apache.org/jira/browse/SPARK-41598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678084#comment-17678084 ] Apache Spark commented on SPARK-41598: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41777) Add Integration Tests

[ https://issues.apache.org/jira/browse/SPARK-41777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678083#comment-17678083 ] Apache Spark commented on SPARK-41777: -- User 'rithwik-db' has created a pull request for this

[jira] [Assigned] (SPARK-41777) Add Integration Tests

[ https://issues.apache.org/jira/browse/SPARK-41777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41777: Assignee: (was: Apache Spark) > Add Integration Tests > - > >

[jira] [Commented] (SPARK-41777) Add Integration Tests

[ https://issues.apache.org/jira/browse/SPARK-41777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678085#comment-17678085 ] Apache Spark commented on SPARK-41777: -- User 'rithwik-db' has created a pull request for this

[jira] [Commented] (SPARK-42082) Introduce `PySparkValueError` and `PySparkTypeError`

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678080#comment-17678080 ] Apache Spark commented on SPARK-42082: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41598) Migrate the errors from `pyspark/sql/functions.py` into error class.

[ https://issues.apache.org/jira/browse/SPARK-41598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678081#comment-17678081 ] Apache Spark commented on SPARK-41598: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42082) Introduce `PySparkValueError` and `PySparkTypeError`

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42082: Assignee: (was: Apache Spark) > Introduce `PySparkValueError` and `PySparkTypeError`

[jira] [Assigned] (SPARK-42082) Introduce `PySparkValueError` and `PySparkTypeError`

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42082: Assignee: Apache Spark > Introduce `PySparkValueError` and `PySparkTypeError` >

[jira] [Commented] (SPARK-42082) Introduce `PySparkValueError` and `PySparkTypeError`

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678079#comment-17678079 ] Apache Spark commented on SPARK-42082: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-42082) Introduce `PySparkValueError` and `PySparkTypeError`

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42082: Summary: Introduce `PySparkValueError` and `PySparkTypeError` (was: Add PySparkValueError and

[jira] [Updated] (SPARK-42082) Add PySparkValueError and PySparkTypeError

[ https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42082: Summary: Add PySparkValueError and PySparkTypeError (was: Migrate ValueError into

[jira] [Resolved] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH

[ https://issues.apache.org/jira/browse/SPARK-41485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-41485. -- Fix Version/s: 3.4.0 Target Version/s: 3.4.0 Resolution: Fixed

[jira] [Updated] (SPARK-42029) Distribution build for Spark Connect does not work with Spark Shell

[ https://issues.apache.org/jira/browse/SPARK-42029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42029: - Parent: (was: SPARK-39375) Issue Type: Bug (was: Sub-task) > Distribution build

[jira] [Updated] (SPARK-42029) Distribution build for Spark Connect does not work with Spark Shell

[ https://issues.apache.org/jira/browse/SPARK-42029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42029: - Parent: SPARK-41286 Issue Type: Sub-task (was: Bug) > Distribution build for Spark

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41727: - Priority: Major (was: Critical) > ClassCastException when config spark.sql.hive.metastore*

[jira] [Reopened] (SPARK-41589) PyTorch Distributor

[ https://issues.apache.org/jira/browse/SPARK-41589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-41589: -- > PyTorch Distributor > --- > > Key: SPARK-41589 >

[jira] [Updated] (SPARK-41589) PyTorch Distributor

[ https://issues.apache.org/jira/browse/SPARK-41589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41589: - Fix Version/s: (was: 3.4.0) > PyTorch Distributor > --- > >

[jira] [Updated] (SPARK-41589) PyTorch Distributor

[ https://issues.apache.org/jira/browse/SPARK-41589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41589: - Priority: Critical (was: Major) > PyTorch Distributor > --- > >

[jira] [Resolved] (SPARK-42061) Mark Expressions that have state has stateful

[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42061. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39630

[jira] [Assigned] (SPARK-42061) Mark Expressions that have state has stateful

[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42061: --- Assignee: (was: Wenchen Fan) > Mark Expressions that have state has stateful >

[jira] [Assigned] (SPARK-42061) Mark Expressions that have state has stateful

[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42061: --- Assignee: Wenchen Fan > Mark Expressions that have state has stateful >

[jira] [Comment Edited] (SPARK-24941) Add RDDBarrier.coalesce() function

[ https://issues.apache.org/jira/browse/SPARK-24941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678044#comment-17678044 ] Erik Ordentlich edited comment on SPARK-24941 at 1/18/23 1:33 AM: --

[jira] [Commented] (SPARK-24941) Add RDDBarrier.coalesce() function

[ https://issues.apache.org/jira/browse/SPARK-24941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678044#comment-17678044 ] Erik Ordentlich commented on SPARK-24941: - Anyone still planning to work on this?   cc [~mengxr] 

[jira] [Resolved] (SPARK-41596) Document the new feature "Async Progress Tracking" to Structured Streaming guide doc

[ https://issues.apache.org/jira/browse/SPARK-41596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-41596. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39538

[jira] [Assigned] (SPARK-41596) Document the new feature "Async Progress Tracking" to Structured Streaming guide doc

[ https://issues.apache.org/jira/browse/SPARK-41596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-41596: Assignee: Boyang Jerry Peng > Document the new feature "Async Progress Tracking" to

[jira] [Commented] (SPARK-41822) Setup Scala/JVM Client Connection

[ https://issues.apache.org/jira/browse/SPARK-41822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678038#comment-17678038 ] Apache Spark commented on SPARK-41822: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Commented] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678032#comment-17678032 ] Apache Spark commented on SPARK-42090: -- User 'akpatnam25' has created a pull request for this

[jira] [Commented] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678030#comment-17678030 ] Apache Spark commented on SPARK-42090: -- User 'akpatnam25' has created a pull request for this

[jira] [Commented] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678028#comment-17678028 ] Apache Spark commented on SPARK-41415: -- User 'akpatnam25' has created a pull request for this

[jira] [Commented] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678029#comment-17678029 ] Apache Spark commented on SPARK-42090: -- User 'akpatnam25' has created a pull request for this

[jira] [Commented] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678027#comment-17678027 ] Apache Spark commented on SPARK-41415: -- User 'akpatnam25' has created a pull request for this

[jira] [Commented] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678026#comment-17678026 ] Apache Spark commented on SPARK-41415: -- User 'akpatnam25' has created a pull request for this

[jira] [Assigned] (SPARK-42038) SPJ: Support partially clustered distribution

[ https://issues.apache.org/jira/browse/SPARK-42038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42038: Assignee: (was: Apache Spark) > SPJ: Support partially clustered distribution >

[jira] [Assigned] (SPARK-42038) SPJ: Support partially clustered distribution

[ https://issues.apache.org/jira/browse/SPARK-42038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42038: Assignee: Apache Spark > SPJ: Support partially clustered distribution >

[jira] [Commented] (SPARK-42038) SPJ: Support partially clustered distribution

[ https://issues.apache.org/jira/browse/SPARK-42038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678025#comment-17678025 ] Apache Spark commented on SPARK-42038: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42103) Add Instrumentation

[ https://issues.apache.org/jira/browse/SPARK-42103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42103: Assignee: (was: Apache Spark) > Add Instrumentation > --- > >

[jira] [Assigned] (SPARK-42103) Add Instrumentation

[ https://issues.apache.org/jira/browse/SPARK-42103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42103: Assignee: Apache Spark > Add Instrumentation > --- > >

[jira] [Commented] (SPARK-42103) Add Instrumentation

[ https://issues.apache.org/jira/browse/SPARK-42103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677995#comment-17677995 ] Apache Spark commented on SPARK-42103: -- User 'rithwik-db' has created a pull request for this

[jira] [Commented] (SPARK-42061) Mark Expressions that have state has stateful

[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677994#comment-17677994 ] Apache Spark commented on SPARK-42061: -- User 'lzlfred' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42061) Mark Expressions that have state has stateful

[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42061: Assignee: (was: Apache Spark) > Mark Expressions that have state has stateful >

[jira] [Assigned] (SPARK-42061) Mark Expressions that have state has stateful

[ https://issues.apache.org/jira/browse/SPARK-42061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42061: Assignee: Apache Spark > Mark Expressions that have state has stateful >

[jira] [Updated] (SPARK-41776) Implement support for PyTorch Lightning

[ https://issues.apache.org/jira/browse/SPARK-41776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani updated SPARK-41776: - Description: This requires us to just call train() on each spark task

[jira] [Updated] (SPARK-41776) Implement support for PyTorch Lightning

[ https://issues.apache.org/jira/browse/SPARK-41776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani updated SPARK-41776: - Description: This requires us to just call train() on each spark task

[jira] [Resolved] (SPARK-41915) Change API so that the user doesn't have to explicitly set pytorch-lightning

[ https://issues.apache.org/jira/browse/SPARK-41915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani resolved SPARK-41915. -- Resolution: Fixed This is already resolved within

[jira] [Comment Edited] (SPARK-40687) Support data masking built-in Function 'mask'

[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677988#comment-17677988 ] Vinod KC edited comment on SPARK-40687 at 1/17/23 9:29 PM: --- Note: In the udf

[jira] [Commented] (SPARK-40687) Support data masking built-in Function 'mask'

[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677988#comment-17677988 ] Vinod KC commented on SPARK-40687: -- Note: Please refer

[jira] [Updated] (SPARK-42070) Change the default value of argument of Mask udf from -1 to NULL

[ https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-42070: - Description: In the udf 'mask', using -1 as ignore parameter in String type argument is not a standard

[jira] [Resolved] (SPARK-42039) SPJ: Remove Option in KeyGroupedPartitioning#partitionValues

[ https://issues.apache.org/jira/browse/SPARK-42039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42039. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39540

[jira] [Assigned] (SPARK-42039) SPJ: Remove Option in KeyGroupedPartitioning#partitionValues

[ https://issues.apache.org/jira/browse/SPARK-42039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42039: - Assignee: Chao Sun > SPJ: Remove Option in KeyGroupedPartitioning#partitionValues >

[jira] [Created] (SPARK-42104) Throw ExecutorDeadException in fetchBlocks when executor dead

Zhongwei Zhu created SPARK-42104: Summary: Throw ExecutorDeadException in fetchBlocks when executor dead Key: SPARK-42104 URL: https://issues.apache.org/jira/browse/SPARK-42104 Project: Spark

[jira] [Commented] (SPARK-40264) Add helper function for DL model inference in pyspark.ml.functions

[ https://issues.apache.org/jira/browse/SPARK-40264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677905#comment-17677905 ] Apache Spark commented on SPARK-40264: -- User 'leewyang' has created a pull request for this issue:

[jira] [Created] (SPARK-42103) Add Instrumentation

Rithwik Ediga Lakhamsani created SPARK-42103: Summary: Add Instrumentation Key: SPARK-42103 URL: https://issues.apache.org/jira/browse/SPARK-42103 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42092) Upgrade RoaringBitmap to 0.9.38

[ https://issues.apache.org/jira/browse/SPARK-42092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42092: Assignee: Yang Jie > Upgrade RoaringBitmap to 0.9.38 > --- >

[jira] [Resolved] (SPARK-42092) Upgrade RoaringBitmap to 0.9.38

[ https://issues.apache.org/jira/browse/SPARK-42092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42092. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39613

[jira] [Commented] (SPARK-42098) ResolveInlineTables should handle RuntimeReplaceable

[ https://issues.apache.org/jira/browse/SPARK-42098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677856#comment-17677856 ] Daniel commented on SPARK-42098: [~cloud_fan]  [~srielau]  I can help with this if you guys need help >

[jira] [Commented] (SPARK-41993) Move RowEncoder to AgnosticEncoders

[ https://issues.apache.org/jira/browse/SPARK-41993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677823#comment-17677823 ] Apache Spark commented on SPARK-41993: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-42102) Using checkpoints in Spark Structured Streaming with the foreachBatch sink

Kai-Michael Roesner created SPARK-42102: --- Summary: Using checkpoints in Spark Structured Streaming with the foreachBatch sink Key: SPARK-42102 URL: https://issues.apache.org/jira/browse/SPARK-42102

[jira] [Resolved] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40599. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38034

[jira] [Assigned] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40599: --- Assignee: Peter Toth > Add multiTransform methods to TreeNode to generate alternatives >

[jira] [Assigned] (SPARK-42066) The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses

[ https://issues.apache.org/jira/browse/SPARK-42066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42066: Assignee: Apache Spark > The DATATYPE_MISMATCH error class contains inappropriate and

[jira] [Commented] (SPARK-42066) The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses

[ https://issues.apache.org/jira/browse/SPARK-42066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677717#comment-17677717 ] Apache Spark commented on SPARK-42066: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42066) The DATATYPE_MISMATCH error class contains inappropriate and duplicating subclasses

[ https://issues.apache.org/jira/browse/SPARK-42066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42066: Assignee: (was: Apache Spark) > The DATATYPE_MISMATCH error class contains

[jira] [Assigned] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42101: Assignee: Apache Spark > Wrap InMemoryTableScanExec with QueryStage >

[jira] [Assigned] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42101: Assignee: (was: Apache Spark) > Wrap InMemoryTableScanExec with QueryStage >

[jira] [Commented] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677716#comment-17677716 ] Apache Spark commented on SPARK-42101: -- User 'ulysses-you' has created a pull request for this

[jira] [Updated] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42101: -- Summary: Wrap InMemoryTableScanExec with QueryStage (was: Wrap InMemoryTableScanExec + AQE with

[jira] [Updated] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42101: -- Description: The first access to the cached plan which is enable AQE is tricky. Currently, we can

[jira] [Created] (SPARK-42101) Wrap InMemoryTableScanExec + AQE with QueryStage

XiDuo You created SPARK-42101: - Summary: Wrap InMemoryTableScanExec + AQE with QueryStage Key: SPARK-42101 URL: https://issues.apache.org/jira/browse/SPARK-42101 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677683#comment-17677683 ] Gabor Roczei commented on SPARK-38230: -- Hi [~ximz], > [~roczei] Can you please review the PR and

[jira] [Assigned] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

[ https://issues.apache.org/jira/browse/SPARK-42100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42100: Assignee: (was: Apache Spark) > Protect null `SQLExecutionUIData#description` in >

[jira] [Commented] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

[ https://issues.apache.org/jira/browse/SPARK-42100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677657#comment-17677657 ] Apache Spark commented on SPARK-42100: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

[ https://issues.apache.org/jira/browse/SPARK-42100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42100: Assignee: Apache Spark > Protect null `SQLExecutionUIData#description` in >