[jira] [Resolved] (SPARK-42908) Raise RuntimeError if SparkContext is not initialized when parsing DDL-formatted type strings

[ https://issues.apache.org/jira/browse/SPARK-42908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42908. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40534

[jira] [Assigned] (SPARK-42908) Raise RuntimeError if SparkContext is not initialized when parsing DDL-formatted type strings

[ https://issues.apache.org/jira/browse/SPARK-42908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42908: Assignee: Xinrong Meng > Raise RuntimeError if SparkContext is not initialized when

[jira] [Assigned] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37677: Assignee: jingxiong zhong > spark on k8s, when the user want to push python3.6.6.zip to

[jira] [Resolved] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37677. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40572

[jira] [Created] (SPARK-42944) Support foreachBatch() in streaming spark connect

Raghu Angadi created SPARK-42944: Summary: Support foreachBatch() in streaming spark connect Key: SPARK-42944 URL: https://issues.apache.org/jira/browse/SPARK-42944 Project: Spark Issue

[jira] [Commented] (SPARK-42943) Use LONGTEXT instead of TEXT for StringType

[ https://issues.apache.org/jira/browse/SPARK-42943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705791#comment-17705791 ] Snoot.io commented on SPARK-42943: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-42937) Join with subquery in condition can fail with wholestage codegen and adaptive execution disabled

[ https://issues.apache.org/jira/browse/SPARK-42937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705790#comment-17705790 ] Snoot.io commented on SPARK-42937: -- User 'bersprockets' has created a pull request for this issue:

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705789#comment-17705789 ] Snoot.io commented on SPARK-41233: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42922) Use SecureRandom, instead of Random in security sensitive contexts

[ https://issues.apache.org/jira/browse/SPARK-42922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42922. -- Fix Version/s: 3.3.3 3.4.1 3.5.0 Assignee:

[jira] [Updated] (SPARK-42922) Use SecureRandom, instead of Random in security sensitive contexts

[ https://issues.apache.org/jira/browse/SPARK-42922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42922: - Priority: Minor (was: Major) > Use SecureRandom, instead of Random in security sensitive

[jira] [Assigned] (SPARK-41876) Implement DataFrame `toLocalIterator`

[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41876: Assignee: Takuya Ueshin > Implement DataFrame `toLocalIterator` >

[jira] [Resolved] (SPARK-41876) Implement DataFrame `toLocalIterator`

[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41876. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40570

[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session

[ https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705782#comment-17705782 ] Snoot.io commented on SPARK-42895: -- User 'allisonwang-db' has created a pull request for this issue:

[jira] [Created] (SPARK-42943) Use LONGTEXT instead of TEXT for StringType

Kent Yao created SPARK-42943: Summary: Use LONGTEXT instead of TEXT for StringType Key: SPARK-42943 URL: https://issues.apache.org/jira/browse/SPARK-42943 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute

[ https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705781#comment-17705781 ] Snoot.io commented on SPARK-37677: -- User 'smallzhongfeng' has created a pull request for this issue:

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: upsert sql for different databases， Most databases support merge sql： sqlserver merge into sql

[jira] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

[ https://issues.apache.org/jira/browse/SPARK-38200 ] melin deleted comment on SPARK-38200: --- was (Author: melin): upsert sql for different databases， Most databases support merge sql： sqlserver merge into sql :

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Summary: [SQL] Spark JDBC Savemode Supports Upsert (was: [SQL] Spark JDBC Savemode Supports replace) >

[jira] [Resolved] (SPARK-41630) Support lateral column alias in Project code path

[ https://issues.apache.org/jira/browse/SPARK-41630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41630. - Fix Version/s: 3.4.0 Assignee: Xinyi Yu Resolution: Fixed > Support lateral

[jira] [Comment Edited] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705765#comment-17705765 ] melin edited comment on SPARK-38200 at 3/28/23 3:00 AM: upsert sql for different

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705765#comment-17705765 ] melin commented on SPARK-38200: --- upsert sql for different databases， Most databases support merge sql：

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42935: Fix Version/s: (was: 3.5.0) > Optimze shuffle for union spark plan >

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Labels: pull-request-available (was: ) > Optimze shuffle for union spark plan >

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Description: Union plan does not take full advantage of children plan output partitionings when output

[jira] [Created] (SPARK-42942) Support coalesce table cache stage partitions

XiDuo You created SPARK-42942: - Summary: Support coalesce table cache stage partitions Key: SPARK-42942 URL: https://issues.apache.org/jira/browse/SPARK-42942 Project: Spark Issue Type:

[jira] [Created] (SPARK-42941) Add support for streaming listener.

Raghu Angadi created SPARK-42941: Summary: Add support for streaming listener. Key: SPARK-42941 URL: https://issues.apache.org/jira/browse/SPARK-42941 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-42940) Session management support streaming connect

Raghu Angadi created SPARK-42940: Summary: Session management support streaming connect Key: SPARK-42940 URL: https://issues.apache.org/jira/browse/SPARK-42940 Project: Spark Issue Type:

[jira] [Created] (SPARK-42939) Streaming connect core API

Raghu Angadi created SPARK-42939: Summary: Streaming connect core API Key: SPARK-42939 URL: https://issues.apache.org/jira/browse/SPARK-42939 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-42937) Join with subquery in condition can fail with wholestage codegen and adaptive execution disabled

[ https://issues.apache.org/jira/browse/SPARK-42937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705702#comment-17705702 ] Bruce Robbins commented on SPARK-42937: --- PR at https://github.com/apache/spark/pull/40569 > Join

[jira] [Resolved] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.5

[ https://issues.apache.org/jira/browse/SPARK-42382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42382. --- Resolution: Won't Fix We will revisit this when we are able to find a valid combination of

[jira] [Resolved] (SPARK-42380) Upgrade maven to 3.9.0

[ https://issues.apache.org/jira/browse/SPARK-42380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42380. --- Resolution: Won't Fix We will revisit this when we are able to find a valid combination of

[jira] [Created] (SPARK-42938) Structured Streaming with Spark Connect

Raghu Angadi created SPARK-42938: Summary: Structured Streaming with Spark Connect Key: SPARK-42938 URL: https://issues.apache.org/jira/browse/SPARK-42938 Project: Spark Issue Type: Epic

[jira] [Updated] (SPARK-42906) Replace a starting digit with `x` in resource name prefix

[ https://issues.apache.org/jira/browse/SPARK-42906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42906: -- Summary: Replace a starting digit with `x` in resource name prefix (was: Replace a starting

[jira] [Updated] (SPARK-42906) Replace a starting digit with x in resource name prefix

[ https://issues.apache.org/jira/browse/SPARK-42906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42906: -- Summary: Replace a starting digit with x in resource name prefix (was: Resource name prefix

[jira] [Assigned] (SPARK-42906) Resource name prefix should start with an alphabetic character

[ https://issues.apache.org/jira/browse/SPARK-42906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42906: - Assignee: Cheng Pan > Resource name prefix should start with an alphabetic character >

[jira] [Resolved] (SPARK-42906) Resource name prefix should start with an alphabetic character

[ https://issues.apache.org/jira/browse/SPARK-42906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42906. --- Fix Version/s: 3.3.3 3.2.4 3.4.1 Resolution:

[jira] [Updated] (SPARK-42906) Resource name prefix should start with an alphabetic character

[ https://issues.apache.org/jira/browse/SPARK-42906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42906: -- Affects Version/s: 3.3.2 3.4.0 > Resource name prefix should start

[jira] [Updated] (SPARK-42937) Join with subquery in condition can fail with wholestage codegen and adaptive execution disabled

[ https://issues.apache.org/jira/browse/SPARK-42937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-42937: -- Affects Version/s: 3.4.0 > Join with subquery in condition can fail with wholestage codegen

[jira] [Updated] (SPARK-42937) Join with subquery in condition can fail with wholestage codegen and adaptive execution disabled

[ https://issues.apache.org/jira/browse/SPARK-42937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-42937: -- Affects Version/s: 3.3.2 > Join with subquery in condition can fail with wholestage codegen

[jira] [Created] (SPARK-42937) Join with subquery in condition can fail with wholestage codegen and adaptive execution disabled

Bruce Robbins created SPARK-42937: - Summary: Join with subquery in condition can fail with wholestage codegen and adaptive execution disabled Key: SPARK-42937 URL:

[jira] [Resolved] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

[ https://issues.apache.org/jira/browse/SPARK-36999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36999. -- Resolution: Duplicate > Document the command ALTER TABLE RECOVER PARTITIONS >

[jira] [Commented] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

[ https://issues.apache.org/jira/browse/SPARK-42936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705481#comment-17705481 ] Xinyi Yu commented on SPARK-42936: -- Created PR fixing the issue:

[jira] [Created] (SPARK-42936) Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate

Xinyi Yu created SPARK-42936: Summary: Unresolved having at the end of analysis when using with LCA with the having clause that can be resolved directly by its child Aggregate Key: SPARK-42936 URL:

[jira] [Resolved] (SPARK-42934) Testing OrcEncryptionSuite using maven is always skipped

[ https://issues.apache.org/jira/browse/SPARK-42934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42934. --- Fix Version/s: 3.3.3 3.2.4 3.4.1 Resolution:

[jira] [Updated] (SPARK-42934) Testing OrcEncryptionSuite using maven is always skipped

[ https://issues.apache.org/jira/browse/SPARK-42934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42934: -- Affects Version/s: 3.3.2 3.2.3 3.4.0

[jira] [Assigned] (SPARK-42934) Testing OrcEncryptionSuite using maven is always skipped

[ https://issues.apache.org/jira/browse/SPARK-42934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42934: - Assignee: Yang Jie > Testing OrcEncryptionSuite using maven is always skipped >

[jira] [Updated] (SPARK-42934) Testing OrcEncryptionSuite using maven is always skipped

[ https://issues.apache.org/jira/browse/SPARK-42934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42934: -- Priority: Minor (was: Major) > Testing OrcEncryptionSuite using maven is always skipped >

[jira] [Assigned] (SPARK-42930) Change the access scope of `ProtobufSerDe` related implementations to `private[spark]`

[ https://issues.apache.org/jira/browse/SPARK-42930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42930: - Assignee: Yang Jie > Change the access scope of `ProtobufSerDe` related

[jira] [Resolved] (SPARK-42930) Change the access scope of `ProtobufSerDe` related implementations to `private[spark]`

[ https://issues.apache.org/jira/browse/SPARK-42930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42930. --- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40560

[jira] [Resolved] (SPARK-42913) Upgrade Hadoop to 3.3.5

[ https://issues.apache.org/jira/browse/SPARK-42913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42913. --- Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed This is resolved

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Description: Union plan does not take full advantage of children plan output partitionings when output

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Description: Union plan does not take full advantage of children plan output partitionings when output

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Description: Union plan does not take full advantage of children plan output partitionings when output

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Description: Union plan does not take full advantage of children plan output partitionings when output

[jira] [Commented] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

[ https://issues.apache.org/jira/browse/SPARK-36999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705379#comment-17705379 ] Juanvi Soler commented on SPARK-36999: -- https://github.com/apache/spark/pull/35239 > Document the

[jira] [Commented] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

[ https://issues.apache.org/jira/browse/SPARK-36999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705376#comment-17705376 ] Juanvi Soler commented on SPARK-36999: -- [~maxgekk] can this be closed? > Document the command

[jira] [Updated] (SPARK-42935) Optimze shuffle for union spark plan

[ https://issues.apache.org/jira/browse/SPARK-42935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Min updated SPARK-42935: - Description: Union plan does not take full advantage of children plan output partitionings when output

[jira] [Created] (SPARK-42935) Optimze shuffle for union spark plan

Jeff Min created SPARK-42935: Summary: Optimze shuffle for union spark plan Key: SPARK-42935 URL: https://issues.apache.org/jira/browse/SPARK-42935 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36999) Document the command ALTER TABLE RECOVER PARTITIONS

[ https://issues.apache.org/jira/browse/SPARK-36999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705355#comment-17705355 ] Juanvi Soler commented on SPARK-36999: -- This looks already solved

[jira] [Created] (SPARK-42934) Testing OrcEncryptionSuite using maven is always skipped

Yang Jie created SPARK-42934: Summary: Testing OrcEncryptionSuite using maven is always skipped Key: SPARK-42934 URL: https://issues.apache.org/jira/browse/SPARK-42934 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42929) make mapInPandas / mapInArrow support "is_barrier"

[ https://issues.apache.org/jira/browse/SPARK-42929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-42929. Fix Version/s: 3.5.0 Target Version/s: 3.5.0 Resolution: Fixed > make

[jira] [Comment Edited] (SPARK-14516) Clustering evaluator

[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069815#comment-16069815 ] Marco Gaido edited comment on SPARK-14516 at 3/27/23 9:42 AM: -- Hello

[jira] [Commented] (SPARK-14516) Clustering evaluator

[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705265#comment-17705265 ] Marco Gaido commented on SPARK-14516: - As there are some issues with the Google Doc sharing, I

[jira] [Commented] (SPARK-39722) Make Dataset.showString() public

[ https://issues.apache.org/jira/browse/SPARK-39722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705257#comment-17705257 ] ASF GitHub Bot commented on SPARK-39722: User 'VindhyaG' has created a pull request for this

[jira] [Commented] (SPARK-42931) dropDuplicates within watermark

[ https://issues.apache.org/jira/browse/SPARK-42931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705252#comment-17705252 ] ASF GitHub Bot commented on SPARK-42931: User 'HeartSaVioR' has created a pull request for this

[jira] [Created] (SPARK-42933) PySpark: dropDuplicates within watermark

Jungtaek Lim created SPARK-42933: Summary: PySpark: dropDuplicates within watermark Key: SPARK-42933 URL: https://issues.apache.org/jira/browse/SPARK-42933 Project: Spark Issue Type: New

[jira] [Created] (SPARK-42932) Spark 3.3.2, with hadoop3, Error with java.io.IOException: Mkdirs failed to create file

shamim created SPARK-42932: -- Summary: Spark 3.3.2, with hadoop3, Error with java.io.IOException: Mkdirs failed to create file Key: SPARK-42932 URL: https://issues.apache.org/jira/browse/SPARK-42932

[jira] [Updated] (SPARK-42931) dropDuplicates within watermark

[ https://issues.apache.org/jira/browse/SPARK-42931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-42931: - Attachment: [External] Mini design doc_ dropDuplicates within watermark.pdf > dropDuplicates

[jira] [Created] (SPARK-42930) Change the access scope of `ProtobufSerDe` related implementations to `private[spark]`

Yang Jie created SPARK-42930: Summary: Change the access scope of `ProtobufSerDe` related implementations to `private[spark]` Key: SPARK-42930 URL: https://issues.apache.org/jira/browse/SPARK-42930

[jira] [Created] (SPARK-42931) dropDuplicates within watermark

Jungtaek Lim created SPARK-42931: Summary: dropDuplicates within watermark Key: SPARK-42931 URL: https://issues.apache.org/jira/browse/SPARK-42931 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-42929) make mapInPandas / mapInArrow support "is_barrier"

[ https://issues.apache.org/jira/browse/SPARK-42929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-42929: -- Assignee: Weichen Xu > make mapInPandas / mapInArrow support "is_barrier" >

[jira] [Created] (SPARK-42929) make mapInPandas / mapInArrow support "is_barrier"

Weichen Xu created SPARK-42929: -- Summary: make mapInPandas / mapInArrow support "is_barrier" Key: SPARK-42929 URL: https://issues.apache.org/jira/browse/SPARK-42929 Project: Spark Issue Type: