[jira] [Assigned] (SPARK-38118) MEAN(Boolean) in the HAVING claus should throw data mismatch error

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38118: Assignee: Apache Spark > MEAN(Boolean) in the HAVING claus should throw data mismatch

[jira] [Assigned] (SPARK-38118) MEAN(Boolean) in the HAVING claus should throw data mismatch error

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38118: Assignee: (was: Apache Spark) > MEAN(Boolean) in the HAVING claus should throw data

[jira] [Commented] (SPARK-38118) MEAN(Boolean) in the HAVING claus should throw data mismatch error

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487636#comment-17487636 ] Apache Spark commented on SPARK-38118: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-38118) MEAN(Boolean) in the HAVING claus should throw data mismatch error

2022-02-05 Thread Rui Wang (Jira)
Rui Wang created SPARK-38118: Summary: MEAN(Boolean) in the HAVING claus should throw data mismatch error Key: SPARK-38118 URL: https://issues.apache.org/jira/browse/SPARK-38118 Project: Spark

[jira] [Commented] (SPARK-38105) Use error classes in the parsing errors of joins

2022-02-05 Thread huangtengfei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487619#comment-17487619 ] huangtengfei commented on SPARK-38105: -- I will work on this. Thanks [~maxgekk] > Use error classes

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

2022-02-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487591#comment-17487591 ] Dongjoon Hyun commented on SPARK-37814: --- I don't think so, [~sldr] . Apache Spark community has

[jira] [Resolved] (SPARK-37925) Update document to mention the workaround for YARN-11053

2022-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37925. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35223

[jira] [Updated] (SPARK-37925) Update document to mention the workaround for YARN-11053

2022-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37925: - Priority: Trivial (was: Major) > Update document to mention the workaround for YARN-11053 >

[jira] [Assigned] (SPARK-37925) Update document to mention the workaround for YARN-11053

2022-02-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37925: Assignee: Cheng Pan > Update document to mention the workaround for YARN-11053 >

[jira] [Updated] (SPARK-38117) Executor metrics are missing on prometheus sink

2022-02-05 Thread zoli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zoli updated SPARK-38117: - Description: Setting up prometheus sink in this way: {code:java} -c spark.ui.prometheus.enabled=true -c

[jira] [Created] (SPARK-38117) Executor metrics are missing on prometheus sink

2022-02-05 Thread zoli (Jira)
zoli created SPARK-38117: Summary: Executor metrics are missing on prometheus sink Key: SPARK-38117 URL: https://issues.apache.org/jira/browse/SPARK-38117 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37404) Inline type hints for python/pyspark/ml/evaluation.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487488#comment-17487488 ] Apache Spark commented on SPARK-37404: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37404) Inline type hints for python/pyspark/ml/evaluation.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37404: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Commented] (SPARK-37404) Inline type hints for python/pyspark/ml/evaluation.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487487#comment-17487487 ] Apache Spark commented on SPARK-37404: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37404) Inline type hints for python/pyspark/ml/evaluation.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37404: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/evaluation.py >

[jira] [Created] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-05 Thread Artem Kupchinskiy (Jira)
Artem Kupchinskiy created SPARK-38116: - Summary: Ability to turn off auto commit in JDBC source for read only operations Key: SPARK-38116 URL: https://issues.apache.org/jira/browse/SPARK-38116

[jira] [Updated] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Rodrigo Boavida (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Boavida updated SPARK-37536: Description: We have been using Spark on local mode, as a small embedded, in-memory SQL

[jira] [Updated] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Rodrigo Boavida (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Boavida updated SPARK-37536: Description: We have been using Spark on local mode, as a small embedded, in-memory SQL

[jira] [Assigned] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37536: Assignee: Apache Spark > Allow for API user to disable Shuffle Operations while running

[jira] [Commented] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487447#comment-17487447 ] Apache Spark commented on SPARK-37536: -- User 'risinga' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37536: Assignee: (was: Apache Spark) > Allow for API user to disable Shuffle Operations

[jira] [Commented] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487448#comment-17487448 ] Apache Spark commented on SPARK-37536: -- User 'risinga' has created a pull request for this issue:

[jira] [Commented] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487446#comment-17487446 ] Apache Spark commented on SPARK-37412: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37412: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/stat.py >

[jira] [Assigned] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

2022-02-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37412: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/stat.py >

[jira] [Assigned] (SPARK-36885) Inline type hints for python/pyspark/sql/dataframe.py

2022-02-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-36885: -- Assignee: Apache Spark > Inline type hints for

[jira] [Updated] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally

2022-02-05 Thread Rodrigo Boavida (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Boavida updated SPARK-37536: Description: We have been using Spark on local mode, as a small embedded, in-memory SQL

[jira] [Updated] (SPARK-36986) Improving schema filtering flexibility

2022-02-05 Thread Rodrigo Boavida (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Boavida updated SPARK-36986: Description: Our spark usage, requires us to build an external schema and pass it on

[jira] [Assigned] (SPARK-36885) Inline type hints for python/pyspark/sql/dataframe.py

2022-02-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-36885: -- Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Updated] (SPARK-36986) Improving schema filtering flexibility

2022-02-05 Thread Rodrigo Boavida (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Boavida updated SPARK-36986: Summary: Improving schema filtering flexibility (was: Improving external schema

[jira] [Resolved] (SPARK-38099) Query using an aggregation on a literal value with an empty underlying dataframe returns null

2022-02-05 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-38099. - Resolution: Invalid > Query using an aggregation on a literal value with an empty underlying >

[jira] [Commented] (SPARK-38099) Query using an aggregation on a literal value with an empty underlying dataframe returns null

2022-02-05 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487435#comment-17487435 ] L. C. Hsieh commented on SPARK-38099: - As this is not a bug, I will close this ticket then. > Query

[jira] [Commented] (SPARK-38099) Query using an aggregation on a literal value with an empty underlying dataframe returns null

2022-02-05 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487434#comment-17487434 ] L. C. Hsieh commented on SPARK-38099: - Quoted an explanation from postgresql