[jira] [Comment Edited] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-11 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319031#comment-17319031 ] KarlManong edited comment on SPARK-35000 at 4/12/21, 5:36 AM: -- Got

[jira] [Commented] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-11 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319031#comment-17319031 ] KarlManong commented on SPARK-35000:

[jira] [Updated] (SPARK-35025) Move Parquet data source options from Python and Scala into a single page.

2021-04-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-35025: Summary: Move Parquet data source options from Python and Scala into a single page. (was: move

[jira] [Updated] (SPARK-34494) Move other data source options than Parquet from Python and Scala into a single page.

2021-04-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34494: Summary: Move other data source options than Parquet from Python and Scala into a single page.

[jira] [Updated] (SPARK-34494) Move other data source options from Python and Scala into a single page.

2021-04-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34494: Summary: Move other data source options from Python and Scala into a single page. (was: Move

[jira] [Created] (SPARK-35025) move Parquet data source options from Python and Scala into a single page.

2021-04-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-35025: --- Summary: move Parquet data source options from Python and Scala into a single page. Key: SPARK-35025 URL: https://issues.apache.org/jira/browse/SPARK-35025 Project:

[jira] [Updated] (SPARK-34491) Move data source options docs for Python and Scala into a single page

2021-04-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34491: Description: Currently we documents options of various data sources for Python and Scala in a

[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319018#comment-17319018 ] Apache Spark commented on SPARK-35002: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-35002) Fix the java.net.BindException when testing with Github Action

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319017#comment-17319017 ] Apache Spark commented on SPARK-35002: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-34916) Reduce tree traversals in transform/resolve function families

2021-04-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34916. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32060

[jira] [Assigned] (SPARK-34916) Reduce tree traversals in transform/resolve function families

2021-04-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-34916: -- Assignee: Yingyi Bu > Reduce tree traversals in transform/resolve function families

[jira] [Resolved] (SPARK-35017) Transfer ANSI intervals via Hive Thrift server

2021-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35017. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32121

[jira] [Assigned] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35023: Assignee: Denis Pyshev > Remove deprecated syntex in SBT build file >

[jira] [Resolved] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35023. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32115

[jira] [Resolved] (SPARK-34986) Aggregate ordinal should judge is it contains agg function

2021-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34986. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32089

[jira] [Assigned] (SPARK-34986) Aggregate ordinal should judge is it contains agg function

2021-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34986: Assignee: angerszhu > Aggregate ordinal should judge is it contains agg function >

[jira] [Resolved] (SPARK-34983) Renaming the package alias from pp to ps

2021-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34983. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32108

[jira] [Commented] (SPARK-34630) Add type hints of pyspark.__version__ and pyspark.sql.Column.contains

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318975#comment-17318975 ] Apache Spark commented on SPARK-34630: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35024) Refactor LinearSVC - support virtual centering

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318961#comment-17318961 ] Apache Spark commented on SPARK-35024: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-35024) Refactor LinearSVC - support virtual centering

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318960#comment-17318960 ] Apache Spark commented on SPARK-35024: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-35024) Refactor LinearSVC - support virtual centering

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35024: Assignee: (was: Apache Spark) > Refactor LinearSVC - support virtual centering >

[jira] [Assigned] (SPARK-35024) Refactor LinearSVC - support virtual centering

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35024: Assignee: Apache Spark > Refactor LinearSVC - support virtual centering >

[jira] [Commented] (SPARK-34494) Move data source options from Python and Scala into a single page.

2021-04-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318959#comment-17318959 ] Haejoon Lee commented on SPARK-34494: - I'm working on this > Move data source options from Python

[jira] [Created] (SPARK-35024) Refactor LinearSVC - support virtual centering

2021-04-11 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-35024: Summary: Refactor LinearSVC - support virtual centering Key: SPARK-35024 URL: https://issues.apache.org/jira/browse/SPARK-35024 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-04-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34087: Attachment: screenshot-1.png > a memory leak occurs when we clone the spark session >

[jira] [Updated] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-04-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34087: Attachment: (was: screenshot-1.png) > a memory leak occurs when we clone the spark session >

[jira] [Commented] (SPARK-34883) Setting CSV reader option "multiLine" to "true" causes URISyntaxException when colon is in file path

2021-04-11 Thread Vikas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318949#comment-17318949 ] Vikas commented on SPARK-34883: --- I was able to use multiLine option without any issue . it seems 

[jira] [Commented] (SPARK-34562) Leverage parquet bloom filters

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318822#comment-17318822 ] Apache Spark commented on SPARK-34562: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34562) Leverage parquet bloom filters

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34562: Assignee: (was: Apache Spark) > Leverage parquet bloom filters >

[jira] [Assigned] (SPARK-34562) Leverage parquet bloom filters

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34562: Assignee: Apache Spark > Leverage parquet bloom filters > --

[jira] [Commented] (SPARK-34562) Leverage parquet bloom filters

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318821#comment-17318821 ] Apache Spark commented on SPARK-34562: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35023: Assignee: Apache Spark > Remove deprecated syntex in SBT build file >

[jira] [Assigned] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35023: Assignee: (was: Apache Spark) > Remove deprecated syntex in SBT build file >

[jira] [Commented] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318730#comment-17318730 ] Apache Spark commented on SPARK-35023: -- User 'gemelen' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-35023: - Comment: was deleted (was: https://github.com/apache/spark/pull/32115) > Remove deprecated

[jira] [Commented] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318728#comment-17318728 ] Apache Spark commented on SPARK-35023: -- User 'gemelen' has created a pull request for this issue:

[jira] [Updated] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-35023: - Description: Related to SPARK-34959 SBT 1.5.0 deprecates {{in}} syntax from 0.13.x, so build

[jira] [Updated] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-35023: - Environment: (was:

[jira] [Updated] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Pyshev updated SPARK-35023: - Environment:

[jira] [Commented] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318727#comment-17318727 ] Denis Pyshev commented on SPARK-35023: -- https://github.com/apache/spark/pull/32115 > Remove

[jira] [Created] (SPARK-35023) Remove deprecated syntex in SBT build file

2021-04-11 Thread Denis Pyshev (Jira)
Denis Pyshev created SPARK-35023: Summary: Remove deprecated syntex in SBT build file Key: SPARK-35023 URL: https://issues.apache.org/jira/browse/SPARK-35023 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

2021-04-11 Thread Sumeet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318679#comment-17318679 ] Sumeet commented on SPARK-35011: [~holden], [~dongjoon], [~attilapiros] could you please take a look at

[jira] [Resolved] (SPARK-35016) Format ANSI intervals in Hive style

2021-04-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35016. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32120

[jira] [Assigned] (SPARK-35022) Task Scheduling Plugin in Spark

2021-04-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35022: --- Assignee: L. C. Hsieh > Task Scheduling Plugin in Spark > ---

[jira] [Commented] (SPARK-35022) Task Scheduling Plugin in Spark

2021-04-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318666#comment-17318666 ] L. C. Hsieh commented on SPARK-35022: - Design doc: 

[jira] [Created] (SPARK-35022) Task Scheduling Plugin in Spark

2021-04-11 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-35022: --- Summary: Task Scheduling Plugin in Spark Key: SPARK-35022 URL: https://issues.apache.org/jira/browse/SPARK-35022 Project: Spark Issue Type: New Feature