[jira] [Assigned] (SPARK-33011) Promote the stability annotation to Evolving for MLEvent traits/classes

[ https://issues.apache.org/jira/browse/SPARK-33011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33011: Assignee: Jungtaek Lim > Promote the stability annotation to Evolving for MLEvent

[jira] [Resolved] (SPARK-33011) Promote the stability annotation to Evolving for MLEvent traits/classes

[ https://issues.apache.org/jira/browse/SPARK-33011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33011. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29887

[jira] [Assigned] (SPARK-33011) Promote the stability annotation to Evolving for MLEvent traits/classes

[ https://issues.apache.org/jira/browse/SPARK-33011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33011: Assignee: (was: Apache Spark) > Promote the stability annotation to Evolving for

[jira] [Commented] (SPARK-33011) Promote the stability annotation to Evolving for MLEvent traits/classes

[ https://issues.apache.org/jira/browse/SPARK-33011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203004#comment-17203004 ] Apache Spark commented on SPARK-33011: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-33011) Promote the stability annotation to Evolving for MLEvent traits/classes

[ https://issues.apache.org/jira/browse/SPARK-33011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33011: Assignee: Apache Spark > Promote the stability annotation to Evolving for MLEvent

[jira] [Updated] (SPARK-32998) Add ability to override default remote repos with internal repos only

[ https://issues.apache.org/jira/browse/SPARK-32998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32998: Target Version/s: (was: 3.0.1, 3.0.2) > Add ability to override default remote repos with

[jira] [Updated] (SPARK-32998) Add ability to override default remote repos with internal repos only

[ https://issues.apache.org/jira/browse/SPARK-32998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32998: Fix Version/s: (was: 3.02) > Add ability to override default remote repos with internal repos

[jira] [Created] (SPARK-33011) Promote the stability annotation to Evolving for MLEvent traits/classes

Jungtaek Lim created SPARK-33011: Summary: Promote the stability annotation to Evolving for MLEvent traits/classes Key: SPARK-33011 URL: https://issues.apache.org/jira/browse/SPARK-33011 Project:

[jira] [Resolved] (SPARK-32187) User Guide - Shipping Python Package

[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32187. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-32927) Bitwise OR, AND and XOR should have similar canonicalization rules to boolean OR and AND

[ https://issues.apache.org/jira/browse/SPARK-32927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32927: - Fix Version/s: 3.1.0 > Bitwise OR, AND and XOR should have similar canonicalization rules to

[jira] [Resolved] (SPARK-32927) Bitwise OR, AND and XOR should have similar canonicalization rules to boolean OR and AND

[ https://issues.apache.org/jira/browse/SPARK-32927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32927. -- Assignee: Tanel Kiis Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-27951) ANSI SQL: NTH_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202974#comment-17202974 ] Apache Spark commented on SPARK-27951: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33010) Make DataFrameWriter.jdbc work for DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-33010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33010: Assignee: (was: Apache Spark) > Make DataFrameWriter.jdbc work for DataSource V2 >

[jira] [Assigned] (SPARK-33010) Make DataFrameWriter.jdbc work for DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-33010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33010: Assignee: Apache Spark > Make DataFrameWriter.jdbc work for DataSource V2 >

[jira] [Commented] (SPARK-33010) Make DataFrameWriter.jdbc work for DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-33010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202947#comment-17202947 ] Apache Spark commented on SPARK-33010: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202946#comment-17202946 ] roamer_wu commented on SPARK-22876: --- spark2.4 with hadoop3.0.0  on CDH6.2.0  have the same issue >

[jira] [Created] (SPARK-33010) Make DataFrameWriter.jdbc work for DataSource V2

Huaxin Gao created SPARK-33010: -- Summary: Make DataFrameWriter.jdbc work for DataSource V2 Key: SPARK-33010 URL: https://issues.apache.org/jira/browse/SPARK-33010 Project: Spark Issue Type:

[jira] [Created] (SPARK-33009) Verify list of binary incompatibilities after MiMa upgrade

Denis Pyshev created SPARK-33009: Summary: Verify list of binary incompatibilities after MiMa upgrade Key: SPARK-33009 URL: https://issues.apache.org/jira/browse/SPARK-33009 Project: Spark

[jira] [Commented] (SPARK-32992) In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202858#comment-17202858 ] Apache Spark commented on SPARK-32992: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32992) In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32992: Assignee: Apache Spark > In OracleDialect, "RowID" SQL type should be converted into

[jira] [Assigned] (SPARK-32992) In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32992: Assignee: (was: Apache Spark) > In OracleDialect, "RowID" SQL type should be

[jira] [Assigned] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32972: Assignee: Yang Jie > Pass all `mllib` module UTs in Scala 2.13 >

[jira] [Resolved] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32972. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29857

[jira] [Assigned] (SPARK-32973) FeatureHasher does not check categoricalCols in inputCols

[ https://issues.apache.org/jira/browse/SPARK-32973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32973: Assignee: zhengruifeng > FeatureHasher does not check categoricalCols in inputCols >

[jira] [Resolved] (SPARK-32973) FeatureHasher does not check categoricalCols in inputCols

[ https://issues.apache.org/jira/browse/SPARK-32973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32973. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29868

[jira] [Commented] (SPARK-31753) Add missing keywords in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202840#comment-17202840 ] Apache Spark commented on SPARK-31753: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Commented] (SPARK-31753) Add missing keywords in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202838#comment-17202838 ] Apache Spark commented on SPARK-31753: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Commented] (SPARK-33001) Why am I receiving this warning?

[ https://issues.apache.org/jira/browse/SPARK-33001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202837#comment-17202837 ] George Fotopoulos commented on SPARK-33001: --- Sure it is a question. I specified the type of

[jira] [Updated] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ondrej Kokes updated SPARK-32989: - Description: When I create a map using str_to_map and select more than a single value, I

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202812#comment-17202812 ] Ondrej Kokes commented on SPARK-32989: -- [~hyukjin.kwon] I've added a file generator in the python

[jira] [Updated] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ondrej Kokes updated SPARK-32989: - Description: When I create a map using str_to_map and select more than a single value, I

[jira] [Updated] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ondrej Kokes updated SPARK-32989: - Description: When I create a map using str_to_map and select more than a single value, I

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202810#comment-17202810 ] Hyukjin Kwon commented on SPARK-32989: -- Can you upload the full CSV file? > Performance regression

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202801#comment-17202801 ] Ondrej Kokes commented on SPARK-32989: -- [~hyukjin.kwon] I wanted to do so originally, but removing

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202800#comment-17202800 ] zhengruifeng commented on SPARK-32691: -- [~huangtianhua]  [~dongjoon] I just see that the last two

[jira] [Updated] (SPARK-32969) Spark Submit process not exiting after session.stop()

[ https://issues.apache.org/jira/browse/SPARK-32969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32969: - Priority: Major (was: Critical) > Spark Submit process not exiting after session.stop() >

[jira] [Resolved] (SPARK-32988) ExternalCatalog vs ExternalCatalogWithListener: backward compatibility problem

[ https://issues.apache.org/jira/browse/SPARK-32988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32988. -- Resolution: Not A Problem > ExternalCatalog vs ExternalCatalogWithListener: backward

[jira] [Commented] (SPARK-32988) ExternalCatalog vs ExternalCatalogWithListener: backward compatibility problem

[ https://issues.apache.org/jira/browse/SPARK-32988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202793#comment-17202793 ] Hyukjin Kwon commented on SPARK-32988: -- `sharedState` is an unstable API that can be change between

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202791#comment-17202791 ] Hyukjin Kwon commented on SPARK-32989: -- >From a cursory look, there are two JIRAs that might need

[jira] [Resolved] (SPARK-27640) Avoid duplicate lookups for datasource through provider

[ https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-27640. Resolution: Won't Fix > Avoid duplicate lookups for datasource through provider >

[jira] [Commented] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202790#comment-17202790 ] Hyukjin Kwon commented on SPARK-32989: -- [~ondrej] would you mind showing a self-contained

[jira] [Resolved] (SPARK-33001) Why am I receiving this warning?

[ https://issues.apache.org/jira/browse/SPARK-33001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33001. -- Fix Version/s: (was: 3.0.1) Resolution: Invalid Sounds more like a question.

[jira] [Updated] (SPARK-33001) Why am I receiving this warning?

[ https://issues.apache.org/jira/browse/SPARK-33001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33001: - Target Version/s: (was: 3.0.1) > Why am I receiving this warning? >

[jira] [Updated] (SPARK-30796) Add parameter position for REGEXP_REPLACE

[ https://issues.apache.org/jira/browse/SPARK-30796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30796: --- Description:   vertica REGEXP_REPLACE( _string_, _target_ [, _replacement_ [, _position_ [, 

[jira] [Commented] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202744#comment-17202744 ] Apache Spark commented on SPARK-33008: -- User 'luluorta' has created a pull request for this issue:

[jira] [Commented] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202743#comment-17202743 ] Apache Spark commented on SPARK-33008: -- User 'luluorta' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33008: Assignee: (was: Apache Spark) > Division by zero on divide-like operations returns

[jira] [Assigned] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33008: Assignee: Apache Spark > Division by zero on divide-like operations returns incorrect