[jira] [Updated] (SPARK-39893) Remote Aggregate if it is group only and all grouping and aggregate expressions are foldable

2022-07-27 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-39893: Description: If all groupingExpressions and aggregateExpressions in a aggregate are foldable, we can

[jira] [Created] (SPARK-39893) Remote Aggregate if it is group only and all grouping and aggregate expressions are foldable

2022-07-27 Thread Wan Kun (Jira)
Wan Kun created SPARK-39893: --- Summary: Remote Aggregate if it is group only and all grouping and aggregate expressions are foldable Key: SPARK-39893 URL: https://issues.apache.org/jira/browse/SPARK-39893

[jira] [Resolved] (SPARK-39834) Include the origin stats and constraints for LogicalRDD if it comes from DataFrame

2022-07-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39834. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37248

[jira] [Assigned] (SPARK-39834) Include the origin stats and constraints for LogicalRDD if it comes from DataFrame

2022-07-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39834: Assignee: Jungtaek Lim > Include the origin stats and constraints for LogicalRDD if it

[jira] [Assigned] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39892: Assignee: Apache Spark > Use ArrowType.Decimal(precision, scale, bitWidth) instead of >

[jira] [Assigned] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39892: Assignee: (was: Apache Spark) > Use ArrowType.Decimal(precision, scale, bitWidth)

[jira] [Commented] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571780#comment-17571780 ] Apache Spark commented on SPARK-39892: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571779#comment-17571779 ] Apache Spark commented on SPARK-39892: -- User 'panbingkun' has created a pull request for this

[jira] [Updated] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

2022-07-27 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-39892: Summary: Use ArrowType.Decimal(precision, scale, bitWidth) instead of

[jira] [Created] (SPARK-39892) Use ArrowType.Decimal(int precision, int scale, int bitWidth) instead of ArrowType.Decimal(int precision, int scale)

2022-07-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-39892: --- Summary: Use ArrowType.Decimal(int precision, int scale, int bitWidth) instead of ArrowType.Decimal(int precision, int scale) Key: SPARK-39892 URL:

[jira] [Commented] (SPARK-39833) Filtered parquet data frame count() and show() produce inconsistent results when spark.sql.parquet.filterPushdown is true

2022-07-27 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571768#comment-17571768 ] Ivan Sadikov commented on SPARK-39833: -- Interesting, I will take a look. > Filtered parquet data

[jira] [Resolved] (SPARK-39888) Fix scala code style in SecurityManagerSuite

2022-07-27 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang resolved SPARK-39888. Resolution: Won't Do > Fix scala code style in SecurityManagerSuite >

[jira] [Commented] (SPARK-39891) Bump h2 to 2.1.214

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571765#comment-17571765 ] Apache Spark commented on SPARK-39891: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-39891) Bump h2 to 2.1.214

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39891: Assignee: Apache Spark > Bump h2 to 2.1.214 > -- > >

[jira] [Assigned] (SPARK-39891) Bump h2 to 2.1.214

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39891: Assignee: (was: Apache Spark) > Bump h2 to 2.1.214 > -- > >

[jira] [Commented] (SPARK-39833) Filtered parquet data frame count() and show() produce inconsistent results when spark.sql.parquet.filterPushdown is true

2022-07-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571763#comment-17571763 ] Hyukjin Kwon commented on SPARK-39833: -- Seems like a bug from Parquet side in rowgroup filtering.

[jira] [Commented] (SPARK-39891) Bump h2 to 2.1.214

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571764#comment-17571764 ] Apache Spark commented on SPARK-39891: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-39891) Bump h2 to 2.1.214

2022-07-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-39891: --- Summary: Bump h2 to 2.1.214 Key: SPARK-39891 URL: https://issues.apache.org/jira/browse/SPARK-39891 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571751#comment-17571751 ] Apache Spark commented on SPARK-39889: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39889: Assignee: Apache Spark (was: Gengliang Wang) > Use different error classes for

[jira] [Assigned] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39889: Assignee: Gengliang Wang (was: Apache Spark) > Use different error classes for

[jira] [Commented] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-07-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571750#comment-17571750 ] Apache Spark commented on SPARK-39889: -- User 'gengliangwang' has created a pull request for this

<    1   2