[jira] [Resolved] (SPARK-27883) Add aggregates.sql - Part2

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27883. - Resolution: Fixed Fix Version/s: 3.0.0 > Add aggregates.sql - Part2 > --

[jira] [Resolved] (SPARK-27857) DataSourceV2: Support ALTER TABLE statements

2019-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27857. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 3.0.0 > DataSourceV2: Support ALTER

[jira] [Resolved] (SPARK-27521) move data source v2 API to catalyst module

2019-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27521. - Resolution: Fixed Fix Version/s: 3.0.0 > move data source v2 API to catalyst module > ---

[jira] [Resolved] (SPARK-27749) hadoop-3.2 support hive-thriftserver

2019-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27749. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > hadoop-3.2 support hive-t

[jira] [Updated] (SPARK-27521) move data source v2 API to catalyst module

2019-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27521: Labels: release-notes (was: ) > move data source v2 API to catalyst module >

[jira] [Resolved] (SPARK-27909) Fix CTE substitution dependence on ResolveRelations throwing AnalysisException

2019-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27909. - Resolution: Fixed Assignee: Ryan Blue > Fix CTE substitution dependence on ResolveRelations throwi

[jira] [Updated] (SPARK-27909) Fix CTE substitution dependence on ResolveRelations throwing AnalysisException

2019-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27909: Issue Type: Improvement (was: Bug) > Fix CTE substitution dependence on ResolveRelations throwing Analysi

[jira] [Commented] (SPARK-27909) Fix CTE substitution dependence on ResolveRelations throwing AnalysisException

2019-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856138#comment-16856138 ] Xiao Li commented on SPARK-27909: - We do not support recursive CTE. I change it to an im

[jira] [Created] (SPARK-27946) Hive DDL to Spark DDL conversion feature for "show create table"

2019-06-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27946: --- Summary: Hive DDL to Spark DDL conversion feature for "show create table" Key: SPARK-27946 URL: https://issues.apache.org/jira/browse/SPARK-27946 Project: Spark Issue

[jira] [Updated] (SPARK-27946) Hive DDL to Spark DDL conversion feature for "show create table"

2019-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27946: Issue Type: Improvement (was: Bug) > Hive DDL to Spark DDL conversion feature for "show create table" > -

[jira] [Updated] (SPARK-27946) Hive DDL to Spark DDL conversion USING "show create table"

2019-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27946: Summary: Hive DDL to Spark DDL conversion USING "show create table" (was: Hive DDL to Spark DDL conversio

[jira] [Assigned] (SPARK-27926) Allow altering table add columns with CSVFileFormat/JsonFileFormat provider

2019-06-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27926: --- Assignee: Gengliang Wang > Allow altering table add columns with CSVFileFormat/JsonFileFormat provi

[jira] [Resolved] (SPARK-27926) Allow altering table add columns with CSVFileFormat/JsonFileFormat provider

2019-06-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27926. - Resolution: Fixed Fix Version/s: 3.0.0 > Allow altering table add columns with CSVFileFormat/Json

[jira] [Updated] (SPARK-27873) Csv reader, adding a corrupt record column causes error if enforceSchema=false

2019-06-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27873: Component/s: (was: Spark Core) SQL > Csv reader, adding a corrupt record column cause

[jira] [Commented] (SPARK-17164) Query with colon in the table name fails to parse in 2.0

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853412#comment-16853412 ] Xiao Li commented on SPARK-17164: - I think we can issue a better error message here. lik

[jira] [Updated] (SPARK-17164) Query with colon in the table name fails to parse in 2.0

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17164: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Query with colon in the table name fails to

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21529: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Improve the error message for unsupported U

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21529: Labels: hive starter uniontype (was: bulk-closed hive uniontype) > Improve the error message for unsuppor

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21529: Summary: Improve the error message for unsupported Uniontype (was: Uniontype not supported when reading f

[jira] [Reopened] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21529: - > Improve the error message for unsupported Uniontype > ---

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21136: Priority: Critical (was: Minor) > Misleading error message for typo in SQL >

[jira] [Assigned] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21136: --- Assignee: Yesheng Ma > Misleading error message for typo in SQL > -

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24077: Labels: starter (was: ) > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`? > -

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21136: Labels: (was: bulk-closed) > Misleading error message for typo in SQL >

[jira] [Reopened] (SPARK-24077) Why spark SQL not support `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-24077: - > Why spark SQL not support `CREATE TEMPORARY FUNCTION IF NOT EXISTS`? > ---

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24077: Issue Type: Sub-task (was: Question) Parent: SPARK-27901 > Issue a better error message for `CREA

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24077: Summary: Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`? (was: Why spark SQL

[jira] [Reopened] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21136: - > Misleading error message for typo in SQL > > > Ke

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21136: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Misleading error message for typo in SQL >

[jira] [Commented] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853234#comment-16853234 ] Xiao Li commented on SPARK-21154: - This issue should have been resolved in the new versi

[jira] [Updated] (SPARK-27809) Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL statement

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27809: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Make optional clauses order insensitive for

[jira] [Updated] (SPARK-27890) Improve SQL parser error message when missing backquotes for identifiers with hyphens

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27890: Issue Type: Sub-task (was: Improvement) Parent: SPARK-27901 > Improve SQL parser error message wh

[jira] [Updated] (SPARK-27901) Improve the error messages of SQL parser

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27901: Issue Type: Umbrella (was: Bug) > Improve the error messages of SQL parser >

[jira] [Created] (SPARK-27901) Improve the error messages of SQL parser

2019-05-31 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27901: --- Summary: Improve the error messages of SQL parser Key: SPARK-27901 URL: https://issues.apache.org/jira/browse/SPARK-27901 Project: Spark Issue Type: Bug Comp

[jira] [Assigned] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27899: --- Assignee: Lantao Jin > Make HiveMetastoreClient.getTableObjectsByName available in > ExternalCatal

[jira] [Commented] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853209#comment-16853209 ] Xiao Li commented on SPARK-27899: - Also cc [~cltlfcjin]   > Make HiveMetastoreClient.g

[jira] [Updated] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27899: Target Version/s: 3.0.0 > Make HiveMetastoreClient.getTableObjectsByName available in > ExternalCatalog/S

[jira] [Assigned] (SPARK-27809) Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL statement

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27809: --- Assignee: Yesheng Ma > Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL stateme

[jira] [Resolved] (SPARK-27809) Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL statement

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27809. - Resolution: Fixed Fix Version/s: (was: 2.4.3) 3.0.0 Target Ver

[jira] [Resolved] (SPARK-27824) Make rule EliminateResolvedHint idempotent

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27824. - Resolution: Fixed Fix Version/s: 3.0.0 > Make rule EliminateResolvedHint idempotent > ---

[jira] [Assigned] (SPARK-27824) Make rule EliminateResolvedHint idempotent

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27824: --- Assignee: Maryann Xue > Make rule EliminateResolvedHint idempotent > --

[jira] [Resolved] (SPARK-26356) Remove SaveMode from data source v2 API

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26356. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 3.0.0 > Remove SaveMode from data

[jira] [Resolved] (SPARK-27816) make TreeNode tag type safe

2019-05-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27816. - Resolution: Fixed Fix Version/s: 3.0.0 > make TreeNode tag type safe > --

[jira] [Updated] (SPARK-27439) Explainging Dataset should show correct resolved plans

2019-05-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27439: Issue Type: Bug (was: Improvement) > Explainging Dataset should show correct resolved plans > ---

[jira] [Resolved] (SPARK-27439) Explainging Dataset should show correct resolved plans

2019-05-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27439. - Resolution: Fixed Fix Version/s: 3.0.0 > Explainging Dataset should show correct resolved plans >

[jira] [Commented] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

2019-05-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844374#comment-16844374 ] Xiao Li commented on SPARK-27768: - Both DB2 and PostgreSQL treat 'infinity' like special

[jira] [Commented] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

2019-05-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844375#comment-16844375 ] Xiao Li commented on SPARK-27768: - We need to document the difference in the migration g

[jira] [Updated] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

2019-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27768: Summary: Infinity, -Infinity, NaN should be recognized in a case insensitive manner (was: Incorrect stati

[jira] [Updated] (SPARK-27768) Incorrect statistical aggregate results when the inputs have constants infinity

2019-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27768: Description: When the inputs contain the constant 'infinity', Spark SQL does not generate the expected re

[jira] [Created] (SPARK-27770) Add aggregates.sql - Part1

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27770: --- Summary: Add aggregates.sql - Part1 Key: SPARK-27770 URL: https://issues.apache.org/jira/browse/SPARK-27770 Project: Spark Issue Type: Sub-task Components: S

[jira] [Created] (SPARK-27769) Handling of sublinks within outer-level aggregates.

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27769: --- Summary: Handling of sublinks within outer-level aggregates. Key: SPARK-27769 URL: https://issues.apache.org/jira/browse/SPARK-27769 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-27768) Incorrect statistical aggregate results when the inputs have constants infinity

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27768: Labels: correctness (was: ) > Incorrect statistical aggregate results when the inputs have constants > i

[jira] [Created] (SPARK-27768) Incorrect statistical aggregate results when the inputs have constants infinity

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27768: --- Summary: Incorrect statistical aggregate results when the inputs have constants infinity Key: SPARK-27768 URL: https://issues.apache.org/jira/browse/SPARK-27768 Project: Spark

[jira] [Resolved] (SPARK-27767) Built-in function: generate_series

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27767. - Resolution: Won't Do > Built-in function: generate_series > -- > >

[jira] [Closed] (SPARK-27767) Built-in function: generate_series

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-27767. --- > Built-in function: generate_series > -- > > Key: SPARK-27767 >

[jira] [Commented] (SPARK-27767) Built-in function: generate_series

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843295#comment-16843295 ] Xiao Li commented on SPARK-27767: - This is similar to what Spark provides: range. {co

[jira] [Created] (SPARK-27767) Built-in function: generate_series

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27767: --- Summary: Built-in function: generate_series Key: SPARK-27767 URL: https://issues.apache.org/jira/browse/SPARK-27767 Project: Spark Issue Type: Sub-task Compo

[jira] [Resolved] (SPARK-27766) Data type: POINT(x, y)

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27766. - Resolution: Won't Do > Data type: POINT(x, y) > -- > > Key: SPARK-27

[jira] [Closed] (SPARK-27766) Data type: POINT(x, y)

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-27766. --- > Data type: POINT(x, y) > -- > > Key: SPARK-27766 > URL: ht

[jira] [Commented] (SPARK-27766) Data type: POINT(x, y)

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843294#comment-16843294 ] Xiao Li commented on SPARK-27766: - There does not exist such a data type in SQL Complian

[jira] [Created] (SPARK-27766) Data type: POINT(x, y)

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27766: --- Summary: Data type: POINT(x, y) Key: SPARK-27766 URL: https://issues.apache.org/jira/browse/SPARK-27766 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Closed] (SPARK-27765) Type Casts: expression::type

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-27765. --- > Type Casts: expression::type > - > > Key: SPARK-27765 >

[jira] [Commented] (SPARK-27765) Type Casts: expression::type

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843286#comment-16843286 ] Xiao Li commented on SPARK-27765: -  {{::}} is historical PostgreSQL usage. Thus, we do n

[jira] [Resolved] (SPARK-27765) Type Casts: expression::type

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27765. - Resolution: Won't Do > Type Casts: expression::type > - > >

[jira] [Created] (SPARK-27765) Type Casts: expression::type

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27765: --- Summary: Type Casts: expression::type Key: SPARK-27765 URL: https://issues.apache.org/jira/browse/SPARK-27765 Project: Spark Issue Type: Sub-task Components

[jira] [Updated] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27763: Description: To improve the test coverage, we can port the regression tests from the other popular open s

[jira] [Updated] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

2019-05-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27763: Description: To improve the test coverage, we can port the regression tests from the other popular open s

[jira] [Created] (SPARK-27764) Feature Parity between PostgreSQL and Spark

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27764: --- Summary: Feature Parity between PostgreSQL and Spark Key: SPARK-27764 URL: https://issues.apache.org/jira/browse/SPARK-27764 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

2019-05-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27763: --- Summary: Port test cases from PostgreSQL to Spark SQL Key: SPARK-27763 URL: https://issues.apache.org/jira/browse/SPARK-27763 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-27674) the hint should not be dropped after cache lookup

2019-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27674. - Resolution: Fixed Fix Version/s: 3.0.0 > the hint should not be dropped after cache lookup >

[jira] [Commented] (SPARK-27723) Unable to pull the oracle table data using patitionColumn date/timeStamp

2019-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840842#comment-16840842 ] Xiao Li commented on SPARK-27723: - [~Shyama] Could you submit a PR to improve our docume

[jira] [Resolved] (SPARK-27354) Move incompatible code from the hive-thriftserver module to sql/hive-thriftserver/v1.2.1

2019-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27354. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Move incompatible code fr

[jira] [Resolved] (SPARK-27036) Even Broadcast thread is timed out, BroadCast Job is not aborted.

2019-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27036. - Resolution: Fixed Assignee: Xingbo Jiang Fix Version/s: 3.0.0 > Even Broadcast thread is

[jira] [Resolved] (SPARK-20774) BroadcastExchangeExec doesn't cancel the Spark job if broadcasting a relation timeouts.

2019-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20774. - Resolution: Fixed Assignee: Xingbo Jiang Fix Version/s: 3.0.0 > BroadcastExchangeExec do

[jira] [Resolved] (SPARK-27402) Fix hadoop-3.2 test issue(except the hive-thriftserver module)

2019-05-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27402. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Fix hadoop-3.2 test issue

[jira] [Commented] (SPARK-26437) Decimal data becomes bigint to query, unable to query

2019-05-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836878#comment-16836878 ] Xiao Li commented on SPARK-26437: - Even if we do not use our native ORC reader, Spark 3.

[jira] [Resolved] (SPARK-27642) make v1 offset extends v2 offset

2019-05-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27642. - Resolution: Fixed Fix Version/s: 3.0.0 > make v1 offset extends v2 offset > -

[jira] [Resolved] (SPARK-27596) The JDBC 'query' option doesn't work for Oracle database

2019-05-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27596. - Resolution: Fixed Fix Version/s: 2.4.4 3.0.0 > The JDBC 'query' option doesn't

[jira] [Resolved] (SPARK-20089) Add DESC FUNCTION and DESC EXTENDED FUNCTION to SQLQueryTestSuite

2019-05-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20089. - Resolution: Won't Fix > Add DESC FUNCTION and DESC EXTENDED FUNCTION to SQLQueryTestSuite >

[jira] [Resolved] (SPARK-21309) Remove SQLConf parameters from the analyzer

2019-05-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21309. - Resolution: Won't Fix > Remove SQLConf parameters from the analyzer > --

[jira] [Resolved] (SPARK-25604) Reduce the overall time costs in Jenkins tests

2019-05-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25604. - Resolution: Fixed > Reduce the overall time costs in Jenkins tests > --

[jira] [Commented] (SPARK-25604) Reduce the overall time costs in Jenkins tests

2019-05-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833413#comment-16833413 ] Xiao Li commented on SPARK-25604: - We recently enhanced the test framework by paralleliz

[jira] [Resolved] (SPARK-27618) Unnecessary access to externalCatalog

2019-05-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27618. - Resolution: Fixed > Unnecessary access to externalCatalog > - > >

[jira] [Created] (SPARK-27618) Unnecessary access to externalCatalog

2019-05-01 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27618: --- Summary: Unnecessary access to externalCatalog Key: SPARK-27618 URL: https://issues.apache.org/jira/browse/SPARK-27618 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-27596) The JDBC 'query' option doesn't work for Oracle database

2019-04-29 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27596: --- Summary: The JDBC 'query' option doesn't work for Oracle database Key: SPARK-27596 URL: https://issues.apache.org/jira/browse/SPARK-27596 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-27216) Upgrade RoaringBitmap to 0.7.45 to fix Kryo unsafe ser/dser issue

2019-04-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825788#comment-16825788 ] Xiao Li commented on SPARK-27216: - Thanks, Josh! We will add it to the release note. [~c

[jira] [Commented] (SPARK-15348) Hive ACID

2019-04-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821557#comment-16821557 ] Xiao Li commented on SPARK-15348: - Please follow the announcement of the upcoming Spark+

[jira] [Resolved] (SPARK-27479) Hide API docs for "org.apache.spark.util.kvstore"

2019-04-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27479. - Resolution: Fixed Fix Version/s: 2.4.2 > Hide API docs for "org.apache.spark.util.kvstore" >

[jira] [Created] (SPARK-27479) Hide API docs for "org.apache.spark.util.kvstore"

2019-04-16 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27479: --- Summary: Hide API docs for "org.apache.spark.util.kvstore" Key: SPARK-27479 URL: https://issues.apache.org/jira/browse/SPARK-27479 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

2019-04-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818197#comment-16818197 ] Xiao Li commented on SPARK-27468: - cc [~Gengliang.Wang] > "Storage Level" in "RDD Stora

[jira] [Updated] (SPARK-27460) Running slowest test suites in their own forked JVMs for higher parallelism

2019-04-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27460: Priority: Critical (was: Major) > Running slowest test suites in their own forked JVMs for higher paralle

[jira] [Commented] (SPARK-27460) Running slowest test suites in their own forked JVMs for higher parallelism

2019-04-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16817508#comment-16817508 ] Xiao Li commented on SPARK-27460: - also cc [~cloud_fan] [~sowen] > Running slowest tes

[jira] [Created] (SPARK-27460) Running slowest test suites in their own forked JVMs for higher parallelism

2019-04-14 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27460: --- Summary: Running slowest test suites in their own forked JVMs for higher parallelism Key: SPARK-27460 URL: https://issues.apache.org/jira/browse/SPARK-27460 Project: Spark

[jira] [Updated] (SPARK-27453) DataFrameWriter.partitionBy is Silently Dropped by DSV1

2019-04-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27453: Target Version/s: 2.4.2, 3.0.0 (was: 2.4.2, 2.5.0) > DataFrameWriter.partitionBy is Silently Dropped by D

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.4 for hadoop-3.2

2019-04-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23710: Target Version/s: 3.0.0 > Upgrade the built-in Hive to 2.3.4 for hadoop-3.2 >

[jira] [Resolved] (SPARK-27176) Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-04-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27176. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Upgrade hadoop-3's built-

[jira] [Resolved] (SPARK-27393) Show ReusedSubquery in the plan when the subquery is reused

2019-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27393. - Resolution: Fixed Fix Version/s: 3.0.0 > Show ReusedSubquery in the plan when the subquery is reu

[jira] [Resolved] (SPARK-27342) Optimize limit 0 queries

2019-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27342. - Resolution: Fixed Assignee: Aayushmaan Jain Fix Version/s: 3.0.0 > Optimize limit 0 quer

[jira] [Updated] (SPARK-27395) Improve EXPLAIN command

2019-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27395: Description: Currently, when the query is complex or the output schema is long, the outputs of our EXPAIN

[jira] [Created] (SPARK-27395) Improve EXPLAIN command

2019-04-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27395: --- Summary: Improve EXPLAIN command Key: SPARK-27395 URL: https://issues.apache.org/jira/browse/SPARK-27395 Project: Spark Issue Type: Umbrella Components: SQL

<    3   4   5   6   7   8   9   10   11   12   >