[jira] [Commented] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

2020-01-18 Thread Rahul Kumar Challapalli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018828#comment-17018828 ] Rahul Kumar Challapalli commented on SPARK-30332: - If you cannot narrow

[jira] [Resolved] (SPARK-30551) Disable comparison for interval type

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30551. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27262 [https://gith

[jira] [Assigned] (SPARK-30551) Disable comparison for interval type

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30551: --- Assignee: Kent Yao > Disable comparison for interval type > ---

[jira] [Created] (SPARK-30568) Invalidate interval type as a field table schema

2020-01-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-30568: Summary: Invalidate interval type as a field table schema Key: SPARK-30568 URL: https://issues.apache.org/jira/browse/SPARK-30568 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-18455) General support for correlated subquery processing

2020-01-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-18455: --- Assignee: Dilip Biswal > General support for correlated subquery processing > -

[jira] [Resolved] (SPARK-29679) Make interval type camparable and orderable

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29679. - Resolution: Won't Do > Make interval type camparable and orderable > ---

[jira] [Reopened] (SPARK-29679) Make interval type camparable and orderable

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-29679: - > Make interval type camparable and orderable > --- > >

[jira] [Commented] (SPARK-29679) Make interval type camparable and orderable

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018822#comment-17018822 ] Wenchen Fan commented on SPARK-29679: - This has been reverted in https://github.com/

[jira] [Commented] (SPARK-30048) Enable aggregates with interval type values for RelationalGroupedDataset

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018820#comment-17018820 ] Wenchen Fan commented on SPARK-30048: - This has been reverted in https://github.com/

[jira] [Resolved] (SPARK-30048) Enable aggregates with interval type values for RelationalGroupedDataset

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30048. - Resolution: Won't Do > Enable aggregates with interval type values for RelationalGroupedDataset

[jira] [Reopened] (SPARK-30048) Enable aggregates with interval type values for RelationalGroupedDataset

2020-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-30048: - > Enable aggregates with interval type values for RelationalGroupedDataset > --

[jira] [Commented] (SPARK-28531) Improve Extract Python UDFs optimizer rule to enforce idempotence

2020-01-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018818#comment-17018818 ] Xiao Li commented on SPARK-28531: - [~mauzhang] Feel free to submit a PR > Improve Extra

[jira] [Created] (SPARK-30567) setDelegateCatalog should be called if catalog has implemented CatalogExtension

2020-01-18 Thread yu jiantao (Jira)
yu jiantao created SPARK-30567: -- Summary: setDelegateCatalog should be called if catalog has implemented CatalogExtension Key: SPARK-30567 URL: https://issues.apache.org/jira/browse/SPARK-30567 Project:

[jira] [Updated] (SPARK-30566) Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13

2020-01-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-30566: --- Parent: SPARK-25075 Issue Type: Sub-task (was: Bug) > Iterator doesn't refer outer

[jira] [Created] (SPARK-30566) Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13

2020-01-18 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-30566: -- Summary: Iterator doesn't refer outer identifier named "iterator" properly in Scala 2.13 Key: SPARK-30566 URL: https://issues.apache.org/jira/browse/SPARK-30566 P

[jira] [Created] (SPARK-30565) Regression in the ORC benchmark

2020-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30565: -- Summary: Regression in the ORC benchmark Key: SPARK-30565 URL: https://issues.apache.org/jira/browse/SPARK-30565 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-30564) Regression in the wide schema benchmark

2020-01-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018653#comment-17018653 ] Maxim Gekk commented on SPARK-30564: [~viirya] Please, take a look at this. Maybe it

[jira] [Commented] (SPARK-30564) Regression in the wide schema benchmark

2020-01-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018652#comment-17018652 ] Maxim Gekk commented on SPARK-30564: Here, regression is ~8 times  [https://github.c

[jira] [Created] (SPARK-30564) Regression in the wide schema benchmark

2020-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30564: -- Summary: Regression in the wide schema benchmark Key: SPARK-30564 URL: https://issues.apache.org/jira/browse/SPARK-30564 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30563) Regressions in Join benchmarks

2020-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30563: -- Summary: Regressions in Join benchmarks Key: SPARK-30563 URL: https://issues.apache.org/jira/browse/SPARK-30563 Project: Spark Issue Type: Bug Componen

[jira] [Created] (SPARK-30562) Regression in interval string parsing

2020-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30562: -- Summary: Regression in interval string parsing Key: SPARK-30562 URL: https://issues.apache.org/jira/browse/SPARK-30562 Project: Spark Issue Type: Bug C

[jira] [Created] (SPARK-30561) start spark applications without a 30second startup penalty

2020-01-18 Thread t oo (Jira)
t oo created SPARK-30561: Summary: start spark applications without a 30second startup penalty Key: SPARK-30561 URL: https://issues.apache.org/jira/browse/SPARK-30561 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-30560) allow driver to consume a fractional core

2020-01-18 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-30560: - Description: see https://stackoverflow.com/questions/56781927/apache-spark-standalone-scheduler-why-does-driver

[jira] [Created] (SPARK-30560) allow driver to consume a fractional core

2020-01-18 Thread t oo (Jira)
t oo created SPARK-30560: Summary: allow driver to consume a fractional core Key: SPARK-30560 URL: https://issues.apache.org/jira/browse/SPARK-30560 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-30559) Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

2020-01-18 Thread Ori Popowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ori Popowski updated SPARK-30559: - Description: In Spark SQL, spark.sql.hive.caseSensitiveInferenceMode INFER_ONLY and INFER_AND_S

[jira] [Updated] (SPARK-30559) Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

2020-01-18 Thread Ori Popowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ori Popowski updated SPARK-30559: - Description: In Spark SQL, spark.sql.hive.caseSensitiveInferenceMode INFER_ONLY and INFER_AND_S

[jira] [Updated] (SPARK-30559) Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

2020-01-18 Thread Ori Popowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ori Popowski updated SPARK-30559: - Description: In Spark SQL, spark.sql.hive.caseSensitiveInferenceMode INFER_ONLY and INFER_AND_S

[jira] [Created] (SPARK-30559) Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

2020-01-18 Thread Ori Popowski (Jira)
Ori Popowski created SPARK-30559: Summary: Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive Key: SPARK-30559 URL: https://issues.apache.org/jira/browse/SPARK-30559 Proje

[jira] [Created] (SPARK-30558) Avoid rebuilding `AvroOptions` per each partition

2020-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30558: -- Summary: Avoid rebuilding `AvroOptions` per each partition Key: SPARK-30558 URL: https://issues.apache.org/jira/browse/SPARK-30558 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-27750) Standalone scheduler - ability to prioritize applications over drivers, many drivers act like Denial of Service

2020-01-18 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018544#comment-17018544 ] t oo commented on SPARK-27750: -- did some digging, let me know if I'm on right track. https

[jira] [Assigned] (SPARK-30539) DataFrame.tail in PySpark API

2020-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30539: - Assignee: Hyukjin Kwon > DataFrame.tail in PySpark API > -

[jira] [Resolved] (SPARK-30539) DataFrame.tail in PySpark API

2020-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30539. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27251 [https://

[jira] [Resolved] (SPARK-30544) Upgrade Genjavadoc to 0.15

2020-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30544. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27255 [https://