[jira] [Updated] (SPARK-32127) Check rules for MERGE INTO should use MergeAction.condition other than MergeAction.children

2020-06-29 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-32127: Summary: Check rules for MERGE INTO should use MergeAction.condition other than

[jira] [Updated] (SPARK-32127) Check rules for MERGE INTO should use MergeAction.condition other than MeregAction.children

2020-06-29 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-32127: Description: [SPARK-30924|https://issues.apache.org/jira/browse/SPARK-30924] adds some check

[jira] [Created] (SPARK-32127) Check rules for MERGE INTO should use MergeAction.condition other than MeregAction.children

2020-06-29 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-32127: --- Summary: Check rules for MERGE INTO should use MergeAction.condition other than MeregAction.children Key: SPARK-32127 URL: https://issues.apache.org/jira/browse/SPARK-32127

[jira] [Updated] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-32030: Description: Now the {{MERGE INTO}} syntax is, {code:sql} MERGE INTO [db_name.]target_table [AS

[jira] [Created] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

2020-06-19 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-32030: --- Summary: Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO Key: SPARK-32030 URL: https://issues.apache.org/jira/browse/SPARK-32030 Project: Spark

[jira] [Created] (SPARK-29907) Move DELETE/UPDATE/MERGE relative rules to dmlStatementNoWith to support cte.

2019-11-14 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-29907: --- Summary: Move DELETE/UPDATE/MERGE relative rules to dmlStatementNoWith to support cte. Key: SPARK-29907 URL: https://issues.apache.org/jira/browse/SPARK-29907 Project:

[jira] [Updated] (SPARK-29835) Remove the unnecessary conversion from Statement to LogicalPlan for DELETE/UPDATE

2019-11-10 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-29835: Summary: Remove the unnecessary conversion from Statement to LogicalPlan for DELETE/UPDATE (was:

[jira] [Created] (SPARK-29835) Remove the unneeded conversion from Statement to LogicalPlan for DELETE/UPDATE

2019-11-10 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-29835: --- Summary: Remove the unneeded conversion from Statement to LogicalPlan for DELETE/UPDATE Key: SPARK-29835 URL: https://issues.apache.org/jira/browse/SPARK-29835

[jira] [Commented] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-10-09 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948160#comment-16948160 ] Xianyin Xin commented on SPARK-28303: - [~echangzhang] Thank you for sharing your work with me. Seems

[jira] [Resolved] (SPARK-29420) support MERGE INTO in the parser and add the corresponding logical plan

2019-10-09 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin resolved SPARK-29420. - Resolution: Duplicate Resolve this as duplicate. Move to [#SPARK-28893]. > support MERGE INTO

[jira] [Updated] (SPARK-28893) support MERGE INTO in the parser and add the corresponding logical plan

2019-10-09 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28893: Summary: support MERGE INTO in the parser and add the corresponding logical plan (was: Support

[jira] [Created] (SPARK-29420) support MERGE INTO in the parser and add the corresponding logical plan

2019-10-09 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-29420: --- Summary: support MERGE INTO in the parser and add the corresponding logical plan Key: SPARK-29420 URL: https://issues.apache.org/jira/browse/SPARK-29420 Project: Spark

[jira] [Commented] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-16 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931017#comment-16931017 ] Xianyin Xin commented on SPARK-29049: - [~hyukjin.kwon], I updated the description. PR

[jira] [Updated] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-16 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-29049: Description: DataSourceStrategy#normalizeFilters can also be used to normalize attributes in

[jira] [Updated] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-16 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-29049: Description: DataSourceStrategy#normalizeFilters can also be used to normalize attributes in

[jira] [Updated] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-16 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-29049: Description: DataSourceStrategy#normalizeFilters can also be used to normalize attributes in

[jira] [Updated] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-16 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-29049: Description: DataSourceStrategy#normalizeFilters can also be used to normalize attributes in

[jira] [Updated] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-16 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-29049: Description: DataSourceStrategy#normalizeFilters can also be used to normalize attributes in

[jira] [Created] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

2019-09-11 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-29049: --- Summary: Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames Key: SPARK-29049 URL: https://issues.apache.org/jira/browse/SPARK-29049

[jira] [Created] (SPARK-28950) FollowingUp: Change whereClause to be optional in DELETE

2019-09-02 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-28950: --- Summary: FollowingUp: Change whereClause to be optional in DELETE Key: SPARK-28950 URL: https://issues.apache.org/jira/browse/SPARK-28950 Project: Spark Issue

[jira] [Updated] (SPARK-28950) [SPARK-28351] FollowingUp: Change whereClause to be optional in DELETE

2019-09-02 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28950: Summary: [SPARK-28351] FollowingUp: Change whereClause to be optional in DELETE (was:

[jira] [Resolved] (SPARK-28923) Deduplicate the codes 'multipartIdentifier' and 'identifierSeq'

2019-09-01 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin resolved SPARK-28923. - Resolution: Invalid > Deduplicate the codes 'multipartIdentifier' and 'identifierSeq' >

[jira] [Created] (SPARK-28923) Deduplicate the codes 'multipartIdentifier' and 'identifierSeq'

2019-08-29 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-28923: --- Summary: Deduplicate the codes 'multipartIdentifier' and 'identifierSeq' Key: SPARK-28923 URL: https://issues.apache.org/jira/browse/SPARK-28923 Project: Spark

[jira] [Created] (SPARK-28893) Support MERGE INTO in DataSource V2

2019-08-28 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-28893: --- Summary: Support MERGE INTO in DataSource V2 Key: SPARK-28893 URL: https://issues.apache.org/jira/browse/SPARK-28893 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-28892) Support UPDATE in DataSource V2

2019-08-28 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28892: Affects Version/s: (was: 2.4.3) 3.0.0 > Support UPDATE in DataSource

[jira] [Created] (SPARK-28892) Support UPDATE in DataSource V2

2019-08-28 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-28892: --- Summary: Support UPDATE in DataSource V2 Key: SPARK-28892 URL: https://issues.apache.org/jira/browse/SPARK-28892 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-07-15 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885019#comment-16885019 ] Xianyin Xin commented on SPARK-21067: - [~dricard],does the attached patch work in your case? >

[jira] [Updated] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28303: Description: Now many datasources (delta, jdbc, hive with transaction support, kudu, etc)

[jira] [Resolved] (SPARK-28350) Support DELETE in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin resolved SPARK-28350. - Resolution: Duplicate Resolve this, and create sub-task of

[jira] [Created] (SPARK-28351) Support DELETE in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28351: --- Summary: Support DELETE in DataSource V2 Key: SPARK-28351 URL: https://issues.apache.org/jira/browse/SPARK-28351 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28350) Support DELETE in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28350: --- Summary: Support DELETE in DataSource V2 Key: SPARK-28350 URL: https://issues.apache.org/jira/browse/SPARK-28350 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880258#comment-16880258 ] Xianyin Xin commented on SPARK-28303: - The SQL entrance is need also. > Support DELETE/UPDATE/MERGE

[jira] [Updated] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28303: Description: Now many datasources (delta, jdbc, hive with transaction support, kudu, etc)

[jira] [Created] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-08 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28303: --- Summary: Support DELETE/UPDATE/MERGE Operations in DataSource V2 Key: SPARK-28303 URL: https://issues.apache.org/jira/browse/SPARK-28303 Project: Spark Issue

[jira] [Commented] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-06-16 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865272#comment-16865272 ] Xianyin Xin commented on SPARK-27714: - [~nkollar], sorry for the late reply. Yes, It's similar with

[jira] [Commented] (SPARK-15348) Hive ACID

2019-05-27 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848881#comment-16848881 ] Xianyin Xin commented on SPARK-15348: - The starting point (or goal) of Delta Lake is not ACID, but

[jira] [Commented] (SPARK-27722) Remove UnsafeKeyValueSorter

2019-05-15 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840971#comment-16840971 ] Xianyin Xin commented on SPARK-27722: - When doing the moving, I didn't find any reference of this

[jira] [Commented] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-05-15 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840370#comment-16840370 ] Xianyin Xin commented on SPARK-27714: - [~hyukjin.kwon] Thanks for reminding. [~hyukjin.kwon]

[jira] [Updated] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-05-14 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-27714: Description: Now the join reorder logic is based on dynamic planning which can find the most

[jira] [Updated] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-05-14 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-27714: Summary: Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12 (was:

[jira] [Created] (SPARK-27714) Support Join Reorder based on Genetic algorithm when the # of joined tables > 12

2019-05-14 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-27714: --- Summary: Support Join Reorder based on Genetic algorithm when the # of joined tables > 12 Key: SPARK-27714 URL: https://issues.apache.org/jira/browse/SPARK-27714

[jira] [Created] (SPARK-27713) Move RecordBinaryComparator and unsafe sorters from catalyst project to core

2019-05-14 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-27713: --- Summary: Move RecordBinaryComparator and unsafe sorters from catalyst project to core Key: SPARK-27713 URL: https://issues.apache.org/jira/browse/SPARK-27713 Project:

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-03-11 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790119#comment-16790119 ] Xianyin Xin commented on SPARK-21067: - Yep, [~Moriarty279] , nice analysis. > Thrift Server - CTAS

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-02-21 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774675#comment-16774675 ] Xianyin Xin commented on SPARK-21067: - Upload a patch which is based on 2.3.2. > Thrift Server -

[jira] [Updated] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-02-21 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-21067: Attachment: SPARK-21067.patch > Thrift Server - CTAS fail with Unable to move source >