[jira] [Updated] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

[ https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40885: Fix Version/s: (was: 3.4.0) > Spark will filter out data field sorting when dynamic

[jira] [Updated] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

[ https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-40885: --- Description: When using dynamic partitions to write data and sort partitions and data fields,

[jira] [Updated] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

[ https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-40885: --- Description: When using dynamic partitions to write data and sort partitions and data fields,

[jira] [Updated] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

[ https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-40885: --- Attachment: 1666494504884.jpg > Spark will filter out data field sorting when dynamic partitions

[jira] [Updated] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

[ https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-40885: --- External issue URL: https://issues.apache.org/jira/browse/SPARK-40588 Description: When

[jira] [Created] (SPARK-40885) Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time

ming95 created SPARK-40885: -- Summary: Spark will filter out data field sorting when dynamic partitions and data fields are sorted at the same time Key: SPARK-40885 URL:

[jira] [Commented] (SPARK-40748) Migrate type check failures of conditions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622730#comment-17622730 ] BingKun Pan commented on SPARK-40748: - I work on it. > Migrate type check failures of conditions

[jira] [Commented] (SPARK-40588) Sorting issue with AQE turned on

[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622728#comment-17622728 ] ming95 commented on SPARK-40588: Yes, I found the same problem. This should be a bug in Spark.

[jira] [Commented] (SPARK-40882) Upgrade actions/setup-java to v3 with distribution specified

[ https://issues.apache.org/jira/browse/SPARK-40882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622720#comment-17622720 ] Apache Spark commented on SPARK-40882: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40882) Upgrade actions/setup-java to v3 with distribution specified

[ https://issues.apache.org/jira/browse/SPARK-40882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40882: Assignee: (was: Apache Spark) > Upgrade actions/setup-java to v3 with distribution

[jira] [Commented] (SPARK-40882) Upgrade actions/setup-java to v3 with distribution specified

[ https://issues.apache.org/jira/browse/SPARK-40882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622719#comment-17622719 ] Apache Spark commented on SPARK-40882: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40882) Upgrade actions/setup-java to v3 with distribution specified

[ https://issues.apache.org/jira/browse/SPARK-40882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40882: Assignee: Apache Spark > Upgrade actions/setup-java to v3 with distribution specified >

[jira] [Commented] (SPARK-40881) Upgrade actions/cache to v3 and actions/upload-artifact to v3

[ https://issues.apache.org/jira/browse/SPARK-40881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622718#comment-17622718 ] Apache Spark commented on SPARK-40881: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-40881) Upgrade actions/cache to v3 and actions/upload-artifact to v3

[ https://issues.apache.org/jira/browse/SPARK-40881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622717#comment-17622717 ] Apache Spark commented on SPARK-40881: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40881) Upgrade actions/cache to v3 and actions/upload-artifact to v3

[ https://issues.apache.org/jira/browse/SPARK-40881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40881: Assignee: Apache Spark > Upgrade actions/cache to v3 and actions/upload-artifact to v3 >

[jira] [Assigned] (SPARK-40881) Upgrade actions/cache to v3 and actions/upload-artifact to v3

[ https://issues.apache.org/jira/browse/SPARK-40881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40881: Assignee: (was: Apache Spark) > Upgrade actions/cache to v3 and

[jira] (SPARK-40867) Flaky test ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-40867 ] Sandish Kumar HN deleted comment on SPARK-40867: -- was (Author: sanysand...@gmail.com): this issue got resolved through https://github.com/apache/spark/pull/38286 > Flaky test

[jira] [Commented] (SPARK-40867) Flaky test ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-40867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622693#comment-17622693 ] Sandish Kumar HN commented on SPARK-40867: -- [~LuciferYang] this issue got resolved through

[jira] [Resolved] (SPARK-40867) Flaky test ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-40867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandish Kumar HN resolved SPARK-40867. -- Fix Version/s: 3.4.0 Resolution: Fixed this issue got resolved through

[jira] [Comment Edited] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622683#comment-17622683 ] Raj Sharma edited comment on SPARK-34827 at 10/22/22 7:24 PM: -- I like your

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622683#comment-17622683 ] Raj Sharma commented on SPARK-34827: I like your content.  If anyone wants to learn a new course

[jira] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807 ] Chao Sun deleted comment on SPARK-33807: -- was (Author: JIRAUSER295111): Very informative and effective post.  [Vlocity Platform Developer

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622681#comment-17622681 ] Pankaj Nagla edited comment on SPARK-33807 at 10/22/22 6:36 PM: Very

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622681#comment-17622681 ] Pankaj Nagla edited comment on SPARK-33807 at 10/22/22 6:35 PM: Very

[jira] [Commented] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622681#comment-17622681 ] Pankaj Nagla commented on SPARK-33807: -- Very informative and effective post.  [Vlocity Platform

[jira] [Commented] (SPARK-40801) Upgrade Apache Commons Text to 1.10

[ https://issues.apache.org/jira/browse/SPARK-40801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622680#comment-17622680 ] Apache Spark commented on SPARK-40801: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622679#comment-17622679 ] Vivek Garg commented on SPARK-34827: I appreciate you sharing this useful information. Very useful

[jira] [Assigned] (SPARK-40391) Test the error class UNSUPPORTED_FEATURE.JDBC_TRANSACTION

[ https://issues.apache.org/jira/browse/SPARK-40391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40391: Assignee: Apache Spark > Test the error class UNSUPPORTED_FEATURE.JDBC_TRANSACTION >

[jira] [Commented] (SPARK-40391) Test the error class UNSUPPORTED_FEATURE.JDBC_TRANSACTION

[ https://issues.apache.org/jira/browse/SPARK-40391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622655#comment-17622655 ] Apache Spark commented on SPARK-40391: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40391) Test the error class UNSUPPORTED_FEATURE.JDBC_TRANSACTION

[ https://issues.apache.org/jira/browse/SPARK-40391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40391: Assignee: (was: Apache Spark) > Test the error class

[jira] [Resolved] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

[ https://issues.apache.org/jira/browse/SPARK-40856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40856. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38319

[jira] [Assigned] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

[ https://issues.apache.org/jira/browse/SPARK-40856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40856: Assignee: BingKun Pan > Update the error template of WRONG_NUM_PARAMS >

[jira] [Commented] (SPARK-40588) Sorting issue with AQE turned on

[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622620#comment-17622620 ] Enrico Minack commented on SPARK-40588: --- Even with AQE enabled (pre Spark 3.4.0), the written

[jira] [Comment Edited] (SPARK-40588) Sorting issue with AQE turned on

[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621032#comment-17621032 ] Enrico Minack edited comment on SPARK-40588 at 10/22/22 1:02 PM: - Here

[jira] [Assigned] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40752: Assignee: (was: Apache Spark) > Migrate type check failures of misc expressions onto

[jira] [Assigned] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40752: Assignee: Apache Spark > Migrate type check failures of misc expressions onto error

[jira] [Commented] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622611#comment-17622611 ] Apache Spark commented on SPARK-40752: -- User 'panbingkun' has created a pull request for this

[jira] [Updated] (SPARK-39404) Unable to query _metadata in streaming if getBatch returns multiple logical nodes in the DataFrame

[ https://issues.apache.org/jira/browse/SPARK-39404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-39404: - Fix Version/s: 3.3.2 > Unable to query _metadata in streaming if getBatch returns multiple

[jira] [Comment Edited] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622594#comment-17622594 ] ming95 edited comment on SPARK-40808 at 10/22/22 9:39 AM: -- [~ohadm] 

[jira] [Commented] (SPARK-40808) Infer schema for CSV files - wrong behavior using header + merge schema

[ https://issues.apache.org/jira/browse/SPARK-40808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622594#comment-17622594 ] ming95 commented on SPARK-40808: [~ohadm]  In spark , infer csv schema will skip first line

[jira] [Commented] (SPARK-40884) Upgrade fabric8io - kubernetes-client to 6.2.0

[ https://issues.apache.org/jira/browse/SPARK-40884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622582#comment-17622582 ] Apache Spark commented on SPARK-40884: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-40884) Upgrade fabric8io - kubernetes-client to 6.2.0

[ https://issues.apache.org/jira/browse/SPARK-40884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40884: Assignee: Apache Spark > Upgrade fabric8io - kubernetes-client to 6.2.0 >

[jira] [Assigned] (SPARK-40884) Upgrade fabric8io - kubernetes-client to 6.2.0

[ https://issues.apache.org/jira/browse/SPARK-40884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40884: Assignee: (was: Apache Spark) > Upgrade fabric8io - kubernetes-client to 6.2.0 >

[jira] [Commented] (SPARK-40884) Upgrade fabric8io - kubernetes-client to 6.2.0

[ https://issues.apache.org/jira/browse/SPARK-40884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622581#comment-17622581 ] Apache Spark commented on SPARK-40884: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Created] (SPARK-40884) Upgrade fabric8io - kubernetes-client to 6.2.0

Bjørn Jørgensen created SPARK-40884: --- Summary: Upgrade fabric8io - kubernetes-client to 6.2.0 Key: SPARK-40884 URL: https://issues.apache.org/jira/browse/SPARK-40884 Project: Spark Issue

[jira] [Commented] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622576#comment-17622576 ] Apache Spark commented on SPARK-40883: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622575#comment-17622575 ] Apache Spark commented on SPARK-40883: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40883: Assignee: Apache Spark > Support Range in Connect proto > --

[jira] [Assigned] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40883: Assignee: (was: Apache Spark) > Support Range in Connect proto >

[jira] [Created] (SPARK-40883) Support Range in Connect proto

Rui Wang created SPARK-40883: Summary: Support Range in Connect proto Key: SPARK-40883 URL: https://issues.apache.org/jira/browse/SPARK-40883 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40881) Upgrade actions/cache to v3 and actions/upload-artifact to v3

[ https://issues.apache.org/jira/browse/SPARK-40881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40881: Summary: Upgrade actions/cache to v3 and actions/upload-artifact to v3 (was: Upgrade

[jira] [Created] (SPARK-40882) Upgrade actions/setup-java to v3 with distribution specified

Yikun Jiang created SPARK-40882: --- Summary: Upgrade actions/setup-java to v3 with distribution specified Key: SPARK-40882 URL: https://issues.apache.org/jira/browse/SPARK-40882 Project: Spark

[jira] [Created] (SPARK-40881) Upgrade actions/cache and actions/upload-artifact

Yikun Jiang created SPARK-40881: --- Summary: Upgrade actions/cache and actions/upload-artifact Key: SPARK-40881 URL: https://issues.apache.org/jira/browse/SPARK-40881 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40871) Upgrade actions/script to v6 and fix notify workflow

[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40871: Summary: Upgrade actions/script to v6 and fix notify workflow (was: Upgrade actions/script to

[jira] [Assigned] (SPARK-40870) Upgrade docker actions to cleanup warning

[ https://issues.apache.org/jira/browse/SPARK-40870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40870: --- Assignee: Yikun Jiang > Upgrade docker actions to cleanup warning >

[jira] [Resolved] (SPARK-40870) Upgrade docker actions to cleanup warning

[ https://issues.apache.org/jira/browse/SPARK-40870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40870. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38342

[jira] [Assigned] (SPARK-40880) Reimplement `summary` with dataframe operations

[ https://issues.apache.org/jira/browse/SPARK-40880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40880: Assignee: (was: Apache Spark) > Reimplement `summary` with dataframe operations >

[jira] [Assigned] (SPARK-40880) Reimplement `summary` with dataframe operations

[ https://issues.apache.org/jira/browse/SPARK-40880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40880: Assignee: Apache Spark > Reimplement `summary` with dataframe operations >

[jira] [Commented] (SPARK-40880) Reimplement `summary` with dataframe operations

[ https://issues.apache.org/jira/browse/SPARK-40880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622562#comment-17622562 ] Apache Spark commented on SPARK-40880: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-40880) Reimplement `summary` with dataframe operations

Ruifeng Zheng created SPARK-40880: - Summary: Reimplement `summary` with dataframe operations Key: SPARK-40880 URL: https://issues.apache.org/jira/browse/SPARK-40880 Project: Spark Issue