[jira] [Updated] (SPARK-30531) Duplicate query plan on Spark UI SQL page

[ https://issues.apache.org/jira/browse/SPARK-30531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-30531: -- Affects Version/s: 2.4.4 > Duplicate query plan on Spark UI SQL page >

[jira] [Created] (SPARK-30593) Revert interval ISO/ANSI SQL Standard output since we decide not to follow ANSI and no round trip.

Kent Yao created SPARK-30593: Summary: Revert interval ISO/ANSI SQL Standard output since we decide not to follow ANSI and no round trip. Key: SPARK-30593 URL: https://issues.apache.org/jira/browse/SPARK-30593

[jira] [Resolved] (SPARK-30021) set ownerName and owner type as reserved properties to support v2 catalog

[ https://issues.apache.org/jira/browse/SPARK-30021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-30021. -- Resolution: Won't Fix > set ownerName and owner type as reserved properties to support v2 catalog >

[jira] [Created] (SPARK-30592) to_csv should not support output intervals as same as using CSV file format

Kent Yao created SPARK-30592: Summary: to_csv should not support output intervals as same as using CSV file format Key: SPARK-30592 URL: https://issues.apache.org/jira/browse/SPARK-30592 Project: Spark

[jira] [Assigned] (SPARK-30587) Run test suites for CSV v1 and JSON v1

[ https://issues.apache.org/jira/browse/SPARK-30587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30587: --- Assignee: Maxim Gekk > Run test suites for CSV v1 and JSON v1 >

[jira] [Resolved] (SPARK-30587) Run test suites for CSV v1 and JSON v1

[ https://issues.apache.org/jira/browse/SPARK-30587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30587. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27294

[jira] [Resolved] (SPARK-30475) File source V2: Push data filters for file listing

[ https://issues.apache.org/jira/browse/SPARK-30475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-30475. Assignee: Guy Khazma Resolution: Fixed This issue is resolved by

[jira] [Resolved] (SPARK-30568) Invalidate interval type as a field table schema

[ https://issues.apache.org/jira/browse/SPARK-30568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30568. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27277

[jira] [Assigned] (SPARK-30568) Invalidate interval type as a field table schema

[ https://issues.apache.org/jira/browse/SPARK-30568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30568: --- Assignee: Kent Yao > Invalidate interval type as a field table schema >

[jira] [Created] (SPARK-30591) Remove the nonstandard SET OWNER syntax for namespaces

Kent Yao created SPARK-30591: Summary: Remove the nonstandard SET OWNER syntax for namespaces Key: SPARK-30591 URL: https://issues.apache.org/jira/browse/SPARK-30591 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-30019) Support ALTER TABLE SET OWNER syntax

[ https://issues.apache.org/jira/browse/SPARK-30019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30019: --- Assignee: Kent Yao > Support ALTER TABLE SET OWNER syntax >

[jira] [Resolved] (SPARK-30019) Support ALTER TABLE SET OWNER syntax

[ https://issues.apache.org/jira/browse/SPARK-30019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30019. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27249

[jira] [Updated] (SPARK-30590) can't use more than five type-safe user-defined aggregation in select statement

[ https://issues.apache.org/jira/browse/SPARK-30590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Mantovani updated SPARK-30590: - Description:  How to reproduce: {code:scala} val df =

[jira] [Created] (SPARK-30590) can't use more than five type-safe user-defined aggregation in select statement

Daniel Mantovani created SPARK-30590: Summary: can't use more than five type-safe user-defined aggregation in select statement Key: SPARK-30590 URL: https://issues.apache.org/jira/browse/SPARK-30590

[jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019770#comment-17019770 ] Bryan Cutler commented on SPARK-24915: -- [~jhereth] since there is already a lot of discussion on

[jira] [Created] (SPARK-30589) Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference.

Dilip Biswal created SPARK-30589: Summary: Document DISTRIBUTE BY Clause of SELECT statement in SQL Reference. Key: SPARK-30589 URL: https://issues.apache.org/jira/browse/SPARK-30589 Project: Spark

[jira] [Created] (SPARK-30588) Document CLUSTER BY Clause of SELECT statement in SQL Reference.

Dilip Biswal created SPARK-30588: Summary: Document CLUSTER BY Clause of SELECT statement in SQL Reference. Key: SPARK-30588 URL: https://issues.apache.org/jira/browse/SPARK-30588 Project: Spark

[jira] [Resolved] (SPARK-30584) Non-synchronized methods override Synchronized methods

[ https://issues.apache.org/jira/browse/SPARK-30584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30584. -- Resolution: Not A Problem > Non-synchronized methods override Synchronized methods >

[jira] [Created] (SPARK-30587) Run test suites for CSV v1 and JSON v1

Maxim Gekk created SPARK-30587: -- Summary: Run test suites for CSV v1 and JSON v1 Key: SPARK-30587 URL: https://issues.apache.org/jira/browse/SPARK-30587 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-30578) Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite

[ https://issues.apache.org/jira/browse/SPARK-30578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30578: --- Assignee: wuyi > Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite >

[jira] [Resolved] (SPARK-30578) Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite

[ https://issues.apache.org/jira/browse/SPARK-30578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30578. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27285

[jira] [Resolved] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30535. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27243

[jira] [Assigned] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30535: --- Assignee: Terry Kim > Migrate ALTER TABLE commands to the new resolution framework >

[jira] [Updated] (SPARK-30586) NPE in LiveRDDDistribution (AppStatusListener)

[ https://issues.apache.org/jira/browse/SPARK-30586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Van den bosch updated SPARK-30586: -- Description: We've been noticing a great amount of NullPointerExceptions in our

[jira] [Created] (SPARK-30586) NPE in LiveRDDDistribution (AppStatusListener)

Jan Van den bosch created SPARK-30586: - Summary: NPE in LiveRDDDistribution (AppStatusListener) Key: SPARK-30586 URL: https://issues.apache.org/jira/browse/SPARK-30586 Project: Spark

[jira] [Comment Edited] (SPARK-30542) Two Spark structured streaming jobs cannot write to same base path

[ https://issues.apache.org/jira/browse/SPARK-30542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017820#comment-17017820 ] Sivakumar edited comment on SPARK-30542 at 1/20/20 12:36 PM: - Hi Jungtaek,

[jira] [Commented] (SPARK-30585) scalatest fails for Apache Spark SQL project

[ https://issues.apache.org/jira/browse/SPARK-30585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019425#comment-17019425 ] Rashmi commented on SPARK-30585: - cte.sql - datetime.sql - describe-table-column.sql 03:48:33.567 WARN

[jira] [Resolved] (SPARK-30470) Uncache table in tempViews if needed on session closed

[ https://issues.apache.org/jira/browse/SPARK-30470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30470. -- Resolution: Duplicate > Uncache table in tempViews if needed on session closed >

[jira] [Created] (SPARK-30585) scalatest fails for Apache Spark SQL project

Rashmi created SPARK-30585: -- Summary: scalatest fails for Apache Spark SQL project Key: SPARK-30585 URL: https://issues.apache.org/jira/browse/SPARK-30585 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30585) scalatest fails for Apache Spark SQL project

[ https://issues.apache.org/jira/browse/SPARK-30585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019335#comment-17019335 ] Rashmi commented on SPARK-30585: Trying to build Apache Spark on Power. > scalatest fails for Apache

[jira] [Created] (SPARK-30584) Non-synchronized methods override Synchronized methods

Aman Omer created SPARK-30584: - Summary: Non-synchronized methods override Synchronized methods Key: SPARK-30584 URL: https://issues.apache.org/jira/browse/SPARK-30584 Project: Spark Issue Type:

[jira] [Created] (SPARK-30583) Document LIMIT Clause of SELECT statement in SQL Reference.

Dilip Biswal created SPARK-30583: Summary: Document LIMIT Clause of SELECT statement in SQL Reference. Key: SPARK-30583 URL: https://issues.apache.org/jira/browse/SPARK-30583 Project: Spark

[jira] [Updated] (SPARK-30582) Spark UI is not showing Aggregated Metrics by Executor in stage page

[ https://issues.apache.org/jira/browse/SPARK-30582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-30582: --- Attachment: SparkUIStagePage.mov > Spark UI is not showing Aggregated Metrics by Executor

[jira] [Created] (SPARK-30582) Spark UI is not showing Aggregated Metrics by Executor in stage page

Saurabh Chawla created SPARK-30582: -- Summary: Spark UI is not showing Aggregated Metrics by Executor in stage page Key: SPARK-30582 URL: https://issues.apache.org/jira/browse/SPARK-30582 Project:

[jira] [Created] (SPARK-30581) Document SORT BY Clause of SELECT statement in SQL Reference.

Dilip Biswal created SPARK-30581: Summary: Document SORT BY Clause of SELECT statement in SQL Reference. Key: SPARK-30581 URL: https://issues.apache.org/jira/browse/SPARK-30581 Project: Spark

[jira] [Created] (SPARK-30580) Why can PySpark persist data only in serialised format?

Francesco Cavrini created SPARK-30580: - Summary: Why can PySpark persist data only in serialised format? Key: SPARK-30580 URL: https://issues.apache.org/jira/browse/SPARK-30580 Project: Spark