[jira] [Commented] (SPARK-40982) When the value of quote or escape exists in the content of csv file, the character in the csv file will be misidentified

[ https://issues.apache.org/jira/browse/SPARK-40982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626963#comment-17626963 ] Apache Spark commented on SPARK-40982: -- User 'clairezhuang' has created a pull request for this

[jira] [Assigned] (SPARK-40982) When the value of quote or escape exists in the content of csv file, the character in the csv file will be misidentified

[ https://issues.apache.org/jira/browse/SPARK-40982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40982: Assignee: Apache Spark > When the value of quote or escape exists in the content of csv

[jira] [Assigned] (SPARK-40982) When the value of quote or escape exists in the content of csv file, the character in the csv file will be misidentified

[ https://issues.apache.org/jira/browse/SPARK-40982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40982: Assignee: (was: Apache Spark) > When the value of quote or escape exists in the

[jira] [Resolved] (SPARK-40949) Implement `DataFrame.sortWithinPartitions`

[ https://issues.apache.org/jira/browse/SPARK-40949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40949. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38423

[jira] [Assigned] (SPARK-40949) Implement `DataFrame.sortWithinPartitions`

[ https://issues.apache.org/jira/browse/SPARK-40949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40949: - Assignee: Ruifeng Zheng > Implement `DataFrame.sortWithinPartitions` >

[jira] [Resolved] (SPARK-40938) Support Alias for every Relation

[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40938. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38415

[jira] [Assigned] (SPARK-40938) Support Alias for every Relation

[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40938: --- Assignee: Rui Wang > Support Alias for every Relation > >

[jira] [Assigned] (SPARK-40981) Support session.range in Python client

[ https://issues.apache.org/jira/browse/SPARK-40981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40981: Assignee: (was: Apache Spark) > Support session.range in Python client >

[jira] [Assigned] (SPARK-40981) Support session.range in Python client

[ https://issues.apache.org/jira/browse/SPARK-40981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40981: Assignee: Apache Spark > Support session.range in Python client >

[jira] [Commented] (SPARK-40981) Support session.range in Python client

[ https://issues.apache.org/jira/browse/SPARK-40981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626957#comment-17626957 ] Apache Spark commented on SPARK-40981: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40980) Support session.sql in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40980: Assignee: Apache Spark > Support session.sql in Connect DSL >

[jira] [Assigned] (SPARK-40980) Support session.sql in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40980: Assignee: (was: Apache Spark) > Support session.sql in Connect DSL >

[jira] [Commented] (SPARK-40980) Support session.sql in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626956#comment-17626956 ] Apache Spark commented on SPARK-40980: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40983) Remove Hadoop requirements for zstd mention in Parquet compression codec

[ https://issues.apache.org/jira/browse/SPARK-40983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626955#comment-17626955 ] Apache Spark commented on SPARK-40983: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40983) Remove Hadoop requirements for zstd mention in Parquet compression codec

[ https://issues.apache.org/jira/browse/SPARK-40983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40983: Assignee: (was: Apache Spark) > Remove Hadoop requirements for zstd mention in

[jira] [Assigned] (SPARK-40983) Remove Hadoop requirements for zstd mention in Parquet compression codec

[ https://issues.apache.org/jira/browse/SPARK-40983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40983: Assignee: Apache Spark > Remove Hadoop requirements for zstd mention in Parquet

[jira] [Created] (SPARK-40983) Remove Hadoop requirements for zstd mention in Parquet compression codec

Cheng Pan created SPARK-40983: - Summary: Remove Hadoop requirements for zstd mention in Parquet compression codec Key: SPARK-40983 URL: https://issues.apache.org/jira/browse/SPARK-40983 Project: Spark

[jira] [Created] (SPARK-40982) When the value of quote or escape exists in the content of csv file, the character in the csv file will be misidentified

clairezhuang created SPARK-40982: Summary: When the value of quote or escape exists in the content of csv file, the character in the csv file will be misidentified Key: SPARK-40982 URL:

[jira] [Commented] (SPARK-2258) Worker UI displays zombie executors

[ https://issues.apache.org/jira/browse/SPARK-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626942#comment-17626942 ] Pankaj Nagla commented on SPARK-2258: - The website is so easy to use – I am impressed with it. Thank

[jira] [Comment Edited] (SPARK-2258) Worker UI displays zombie executors

[ https://issues.apache.org/jira/browse/SPARK-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626942#comment-17626942 ] Pankaj Nagla edited comment on SPARK-2258 at 11/1/22 3:39 AM: -- The website

[jira] [Created] (SPARK-40981) Support session.range in Python client

Rui Wang created SPARK-40981: Summary: Support session.range in Python client Key: SPARK-40981 URL: https://issues.apache.org/jira/browse/SPARK-40981 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40980) Support session.sql in Connect DSL

[ https://issues.apache.org/jira/browse/SPARK-40980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-40980: - Summary: Support session.sql in Connect DSL (was: Improve test coverage for session.sql) > Support

[jira] [Created] (SPARK-40980) Improve test coverage for session.sql

Rui Wang created SPARK-40980: Summary: Improve test coverage for session.sql Key: SPARK-40980 URL: https://issues.apache.org/jira/browse/SPARK-40980 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-40969) Unable to download spark 3.3.0 tarball after 3.3.1 release in spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40969. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 22

[jira] [Commented] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626932#comment-17626932 ] Apache Spark commented on SPARK-40371: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40371: Assignee: Apache Spark > Migrate type check failures of NthValue and NTile onto error

[jira] [Assigned] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40371: Assignee: (was: Apache Spark) > Migrate type check failures of NthValue and NTile

[jira] [Resolved] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29683. -- Fix Version/s: 3.1.1 Resolution: Fixed > Job failed due to executor failures all

[jira] [Commented] (SPARK-39405) NumPy input support in PySpark SQL

[ https://issues.apache.org/jira/browse/SPARK-39405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626930#comment-17626930 ] Douglas Moore commented on SPARK-39405: --- Works for One Dimensional array, not Two dimensional

[jira] [Commented] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes

[ https://issues.apache.org/jira/browse/SPARK-37697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626928#comment-17626928 ] Douglas Moore commented on SPARK-37697: --- [~XinrongM] can confirm the one dimensional case works on

[jira] [Updated] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes

[ https://issues.apache.org/jira/browse/SPARK-37697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Douglas Moore updated SPARK-37697: -- Attachment: image-2022-10-31-22-49-37-356.png > Make it easier to convert numpy arrays to

[jira] [Resolved] (SPARK-40915) Improve `on` in Join in Python client

[ https://issues.apache.org/jira/browse/SPARK-40915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40915. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38393

[jira] [Assigned] (SPARK-40915) Improve `on` in Join in Python client

[ https://issues.apache.org/jira/browse/SPARK-40915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40915: Assignee: Rui Wang > Improve `on` in Join in Python client >

[jira] [Resolved] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40883. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38347

[jira] [Assigned] (SPARK-40883) Support Range in Connect proto

[ https://issues.apache.org/jira/browse/SPARK-40883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40883: --- Assignee: Rui Wang > Support Range in Connect proto > -- > >

[jira] [Assigned] (SPARK-40827) Re-enable the DataFrame.corrwith test after fixing in future pandas.

[ https://issues.apache.org/jira/browse/SPARK-40827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40827: Assignee: (was: Apache Spark) > Re-enable the DataFrame.corrwith test after fixing

[jira] [Assigned] (SPARK-40827) Re-enable the DataFrame.corrwith test after fixing in future pandas.

[ https://issues.apache.org/jira/browse/SPARK-40827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40827: Assignee: Apache Spark > Re-enable the DataFrame.corrwith test after fixing in future

[jira] [Commented] (SPARK-40827) Re-enable the DataFrame.corrwith test after fixing in future pandas.

[ https://issues.apache.org/jira/browse/SPARK-40827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626913#comment-17626913 ] Apache Spark commented on SPARK-40827: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-40933) Reimplement df.stat.{cov, corr} with built-in sql functions

[ https://issues.apache.org/jira/browse/SPARK-40933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40933: -- Summary: Reimplement df.stat.{cov, corr} with built-in sql functions (was: Make

[jira] [Commented] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626884#comment-17626884 ] Attila Zsolt Piros commented on SPARK-29683: [~srowen] I think we can close this as this

[jira] [Resolved] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40944. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38418

[jira] [Assigned] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40944: -- Assignee: Daniel > Relax ordering constraint for CREATE TABLE column options >

[jira] [Commented] (SPARK-40951) pyspark-connect tests should be skipped if pandas doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-40951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626878#comment-17626878 ] Rui Wang commented on SPARK-40951: -- [~dongjoon] Is this JIRA fully resolved already? Can we close this

[jira] [Resolved] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40815. --- Fix Version/s: 3.4.0 Assignee: Ivan Sadikov Resolution: Fixed This is

[jira] [Commented] (SPARK-37946) Use error classes in the execution errors related to partitions

[ https://issues.apache.org/jira/browse/SPARK-37946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626866#comment-17626866 ] Khalid Mammadov commented on SPARK-37946: - Hi [~maxgekk], I see this one is not done yet here:

[jira] [Commented] (SPARK-40978) Migrate failAnalysis() w/o context onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626854#comment-17626854 ] Apache Spark commented on SPARK-40978: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40978) Migrate failAnalysis() w/o context onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40978: Assignee: Apache Spark (was: Max Gekk) > Migrate failAnalysis() w/o context onto error

[jira] [Commented] (SPARK-40978) Migrate failAnalysis() w/o context onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626853#comment-17626853 ] Apache Spark commented on SPARK-40978: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40978) Migrate failAnalysis() w/o context onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40978: Assignee: Max Gekk (was: Apache Spark) > Migrate failAnalysis() w/o context onto error

[jira] [Updated] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-40979: - Description: Removed executor due to decommission should be kept in a separate set. To avoid

[jira] [Commented] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes

[ https://issues.apache.org/jira/browse/SPARK-37697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626850#comment-17626850 ] Xinrong Meng commented on SPARK-37697: -- Hi, we have NumPy input support 

[jira] [Commented] (SPARK-6857) Python SQL schema inference should support numpy types

[ https://issues.apache.org/jira/browse/SPARK-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626847#comment-17626847 ] Xinrong Meng commented on SPARK-6857: - Hi, we have NumPy input support

[jira] [Assigned] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40979: Assignee: Apache Spark > Keep removed executor info in decommission state >

[jira] [Commented] (SPARK-31776) Literal lit() supports lists and numpy arrays

[ https://issues.apache.org/jira/browse/SPARK-31776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626844#comment-17626844 ] Xinrong Meng commented on SPARK-31776: -- `lit` supports Python list and NumPy arrays in

[jira] [Assigned] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40979: Assignee: (was: Apache Spark) > Keep removed executor info in decommission state >

[jira] [Commented] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626845#comment-17626845 ] Apache Spark commented on SPARK-40979: -- User 'warrenzhu25' has created a pull request for this

[jira] [Updated] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40979: -- Reporter: Zhongwei Zhu (was: Dongjoon Hyun) > Keep removed executor info in decommission

[jira] [Created] (SPARK-40979) Keep removed executor info in decommission state

Dongjoon Hyun created SPARK-40979: - Summary: Keep removed executor info in decommission state Key: SPARK-40979 URL: https://issues.apache.org/jira/browse/SPARK-40979 Project: Spark Issue

[jira] [Updated] (SPARK-40978) Migrate failAnalysis() w/o context onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40978: - Description: Call `failAnalysis()` w/o context but with an error class instead of `failAnalysis()` w/ a

[jira] [Created] (SPARK-40978) Migrate failAnalysis() w/o context onto error classes

Max Gekk created SPARK-40978: Summary: Migrate failAnalysis() w/o context onto error classes Key: SPARK-40978 URL: https://issues.apache.org/jira/browse/SPARK-40978 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40976) Upgrade sbt to 1.7.3

[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40976: - Assignee: Yang Jie > Upgrade sbt to 1.7.3 > > >

[jira] [Resolved] (SPARK-40976) Upgrade sbt to 1.7.3

[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40976. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38451

[jira] [Resolved] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40966. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38420

[jira] [Resolved] (SPARK-40947) Upgrade pandas to 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40947. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38420

[jira] [Assigned] (SPARK-40966) FIX `read_parquet` with `pandas_metadata`

[ https://issues.apache.org/jira/browse/SPARK-40966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40966: - Assignee: Haejoon Lee > FIX `read_parquet` with `pandas_metadata` >

[jira] [Assigned] (SPARK-40947) Upgrade pandas to 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40947: - Assignee: Haejoon Lee > Upgrade pandas to 1.5.1 > --- > >

[jira] [Assigned] (SPARK-40977) Complete Support for Union in Python client

[ https://issues.apache.org/jira/browse/SPARK-40977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40977: Assignee: Apache Spark > Complete Support for Union in Python client >

[jira] [Assigned] (SPARK-40977) Complete Support for Union in Python client

[ https://issues.apache.org/jira/browse/SPARK-40977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40977: Assignee: (was: Apache Spark) > Complete Support for Union in Python client >

[jira] [Commented] (SPARK-40977) Complete Support for Union in Python client

[ https://issues.apache.org/jira/browse/SPARK-40977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626800#comment-17626800 ] Apache Spark commented on SPARK-40977: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40977) Complete Support for Union in Python client

[ https://issues.apache.org/jira/browse/SPARK-40977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626799#comment-17626799 ] Apache Spark commented on SPARK-40977: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-40977) Complete Support for Union in Python client

Rui Wang created SPARK-40977: Summary: Complete Support for Union in Python client Key: SPARK-40977 URL: https://issues.apache.org/jira/browse/SPARK-40977 Project: Spark Issue Type: Sub-task

[jira] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807 ] Chao Sun deleted comment on SPARK-33807: -- was (Author: JIRAUSER295436): Thank you for sharing such good information. Very informative and effective post. 

[jira] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807 ] Chao Sun deleted comment on SPARK-33807: -- was (Author: JIRAUSER294516): Great job. [Salesforce Marketing Cloud

[jira] [Commented] (SPARK-23521) SPIP: Standardize SQL logical plans with DataSourceV2

[ https://issues.apache.org/jira/browse/SPARK-23521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626762#comment-17626762 ] Vivek Garg commented on SPARK-23521: IgmGuru [Mulesoft Online

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626759#comment-17626759 ] Vivek Garg edited comment on SPARK-33807 at 10/31/22 6:43 PM: -- Great job.

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626759#comment-17626759 ] Vivek Garg edited comment on SPARK-33807 at 10/31/22 6:42 PM: -- Thank

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626758#comment-17626758 ] Vivek Garg commented on SPARK-22588: Thank

[jira] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588 ] Vivek Garg deleted comment on SPARK-22588: was (Author: JIRAUSER294516): Thank [you|https://www.igmguru.com/salesforce/salesforce-marketing-cloud-training/]. > SPARK: Load Data from

[jira] [Commented] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626759#comment-17626759 ] Vivek Garg commented on SPARK-33807: Thank

[jira] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40569 ] Vivek Garg deleted comment on SPARK-40569: was (Author: JIRAUSER294516): The Salesforce Marketing Cloud training offered by IgmGuru is created by instructors who are experts in the field

[jira] [Comment Edited] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626753#comment-17626753 ] Vivek Garg edited comment on SPARK-40569 at 10/31/22 6:39 PM: -- The

[jira] [Comment Edited] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626753#comment-17626753 ] Vivek Garg edited comment on SPARK-40569 at 10/31/22 6:38 PM: --

[jira] [Comment Edited] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626753#comment-17626753 ] Vivek Garg edited comment on SPARK-40569 at 10/31/22 6:38 PM: -- The

[jira] [Commented] (SPARK-40569) Add smoke test in standalone cluster for spark-docker

[ https://issues.apache.org/jira/browse/SPARK-40569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626753#comment-17626753 ] Vivek Garg commented on SPARK-40569: The Salesforce Marketing Cloud training offered by IgmGuru is

[jira] [Assigned] (SPARK-40802) Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema instead of PreparedStatement.executeQuery()

[ https://issues.apache.org/jira/browse/SPARK-40802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40802: Assignee: Apache Spark > Enhance JDBC Connector to use PreparedStatement.getMetaData()

[jira] [Assigned] (SPARK-40802) Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema instead of PreparedStatement.executeQuery()

[ https://issues.apache.org/jira/browse/SPARK-40802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40802: Assignee: (was: Apache Spark) > Enhance JDBC Connector to use

[jira] [Commented] (SPARK-40802) Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema instead of PreparedStatement.executeQuery()

[ https://issues.apache.org/jira/browse/SPARK-40802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626742#comment-17626742 ] Apache Spark commented on SPARK-40802: -- User 'Mingli-Rui' has created a pull request for this

[jira] [Commented] (SPARK-40802) Enhance JDBC Connector to use PreparedStatement.getMetaData() to resolve schema instead of PreparedStatement.executeQuery()

[ https://issues.apache.org/jira/browse/SPARK-40802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626743#comment-17626743 ] Apache Spark commented on SPARK-40802: -- User 'Mingli-Rui' has created a pull request for this

[jira] [Updated] (SPARK-40916) udf could not filter null value cause npe

[ https://issues.apache.org/jira/browse/SPARK-40916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-40916: Description: {code:sql} select t22.uid, from ( SELECT code,

[jira] [Commented] (SPARK-40974) EXPODE function selects outer column

[ https://issues.apache.org/jira/browse/SPARK-40974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626644#comment-17626644 ] Apache Spark commented on SPARK-40974: -- User 'clairezhuang' has created a pull request for this

[jira] [Commented] (SPARK-40974) EXPODE function selects outer column

[ https://issues.apache.org/jira/browse/SPARK-40974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626642#comment-17626642 ] Apache Spark commented on SPARK-40974: -- User 'clairezhuang' has created a pull request for this

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626635#comment-17626635 ] Nikhil Sharma edited comment on SPARK-33807 at 10/31/22 3:10 PM: - Thank

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626635#comment-17626635 ] Nikhil Sharma edited comment on SPARK-33807 at 10/31/22 3:10 PM: - Thank

[jira] [Commented] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626635#comment-17626635 ] Nikhil Sharma commented on SPARK-33807: --- Thank you for sharing such good information. Very

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626635#comment-17626635 ] Nikhil Sharma edited comment on SPARK-33807 at 10/31/22 3:09 PM: - Thank

[jira] [Commented] (SPARK-40976) Upgrade sbt to 1.7.3

[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626631#comment-17626631 ] Apache Spark commented on SPARK-40976: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40976) Upgrade sbt to 1.7.3

[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40976: Assignee: Apache Spark > Upgrade sbt to 1.7.3 > > >

[jira] [Commented] (SPARK-40976) Upgrade sbt to 1.7.3

[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626630#comment-17626630 ] Apache Spark commented on SPARK-40976: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40976) Upgrade sbt to 1.7.3

[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40976: Assignee: (was: Apache Spark) > Upgrade sbt to 1.7.3 > > >

[jira] [Created] (SPARK-40976) Upgrade sbt to 1.7.3

Yang Jie created SPARK-40976: Summary: Upgrade sbt to 1.7.3 Key: SPARK-40976 URL: https://issues.apache.org/jira/browse/SPARK-40976 Project: Spark Issue Type: Improvement Components:

  1   2   >