[jira] [Updated] (SPARK-15832) Embedded IN/EXISTS predicate subquery throws TreeNodeException

2016-06-08 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-15832: -- Component/s: SQL > Embedded IN/EXISTS predicate subquery throws TreeNodeException >

[jira] [Created] (SPARK-15832) Embedded IN/EXISTS predicate subquery throws TreeNodeException

2016-06-08 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-15832: - Summary: Embedded IN/EXISTS predicate subquery throws TreeNodeException Key: SPARK-15832 URL: https://issues.apache.org/jira/browse/SPARK-15832 Project: Spark

[jira] [Created] (SPARK-15677) Query with scalar sub-query in the SELECT list throws UnsupportedOperationException.

2016-05-31 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-15677: - Summary: Query with scalar sub-query in the SELECT list throws UnsupportedOperationException. Key: SPARK-15677 URL: https://issues.apache.org/jira/browse/SPARK-15677

[jira] [Created] (SPARK-16161) Ambiguous error message for unsupported correlated predicate subqueries

2016-06-22 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-16161: - Summary: Ambiguous error message for unsupported correlated predicate subqueries Key: SPARK-16161 URL: https://issues.apache.org/jira/browse/SPARK-16161 Project:

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

2017-02-13 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864708#comment-15864708 ] Ioana Delaney commented on SPARK-16026: --- [~Tagar], Our team is currently working on the support for

[jira] [Updated] (SPARK-17791) Join reordering using star schema detection

2016-10-05 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17791: -- Attachment: StarJoinReordering1005.doc > Join reordering using star schema detection >

[jira] [Created] (SPARK-17791) Join reordering using star schema detection

2016-10-05 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-17791: - Summary: Join reordering using star schema detection Key: SPARK-17791 URL: https://issues.apache.org/jira/browse/SPARK-17791 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-10-07 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556305#comment-15556305 ] Ioana Delaney commented on SPARK-17626: --- [~rxin] Hi Reynold, Thank you for your reply. My argument

[jira] [Commented] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-10-08 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15558762#comment-15558762 ] Ioana Delaney commented on SPARK-17626: --- [~mikewzh] Thank you. Yes, having informational RI

[jira] [Commented] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-10-06 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552570#comment-15552570 ] Ioana Delaney commented on SPARK-17626: --- Selectivity hint is a very useful feature, widely used in

[jira] [Commented] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-10-06 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552517#comment-15552517 ] Ioana Delaney commented on SPARK-17626: --- Star schema optimization and cost based model will

[jira] [Created] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-09-21 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-17626: - Summary: TPC-DS performance improvements using star-schema heuristics Key: SPARK-17626 URL: https://issues.apache.org/jira/browse/SPARK-17626 Project: Spark

[jira] [Updated] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-09-21 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17626: -- Description: *TPC-DS performance improvements using star-schema heuristics* \\ \\ TPC-DS

[jira] [Updated] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-09-21 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17626: -- Attachment: StarSchemaJoinReordering.pptx > TPC-DS performance improvements using star-schema

[jira] [Commented] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

2016-10-10 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564169#comment-15564169 ] Ioana Delaney commented on SPARK-17626: --- [~ron8hu] Thank you for your comments. Our current star

[jira] [Comment Edited] (SPARK-17791) Join reordering using star schema detection

2016-10-30 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620517#comment-15620517 ] Ioana Delaney edited comment on SPARK-17791 at 10/30/16 8:22 PM: -

[jira] [Commented] (SPARK-17791) Join reordering using star schema detection

2016-10-30 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620517#comment-15620517 ] Ioana Delaney commented on SPARK-17791: --- [~ron8hu] I appreciate your comment. Thank you. I agree

[jira] [Commented] (SPARK-18863) Output non-aggregate expressions without GROUP BY in a subquery does not yield an error

2016-12-14 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749780#comment-15749780 ] Ioana Delaney commented on SPARK-18863: --- This looks like another instance of SPARK-16161. > Output

[jira] [Commented] (SPARK-17791) Join reordering using star schema detection

2016-12-14 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749888#comment-15749888 ] Ioana Delaney commented on SPARK-17791: --- I’ve incorporated the table and column statistics into the

[jira] [Updated] (SPARK-17791) Join reordering using star schema detection

2016-12-14 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17791: -- Attachment: StarJoinReordering1214.doc > Join reordering using star schema detection >

[jira] [Updated] (SPARK-17791) Join reordering using star schema detection

2016-12-14 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17791: -- Attachment: (was: StarJoinReordering1005.doc) > Join reordering using star schema

[jira] [Commented] (SPARK-17073) generate basic stats for column

2016-12-16 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755367#comment-15755367 ] Ioana Delaney commented on SPARK-17073: --- [~mikewzh] FYI, I ran the ANALYZE COMPUTE STATISTICS FOR

[jira] [Created] (SPARK-20231) Refactor star schema code for the subsequent star join detection in CBO

2017-04-05 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-20231: - Summary: Refactor star schema code for the subsequent star join detection in CBO Key: SPARK-20231 URL: https://issues.apache.org/jira/browse/SPARK-20231 Project:

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2017-03-06 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Target Version/s: (was: 2.2.0) > Informational Referential Integrity Constraints Support in

[jira] [Created] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2017-03-06 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-19842: - Summary: Informational Referential Integrity Constraints Support in Spark Key: SPARK-19842 URL: https://issues.apache.org/jira/browse/SPARK-19842 Project: Spark

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2017-03-06 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Description: *Informational Referential Integrity Constraints Support in Spark* This work

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2017-03-06 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Attachment: InformationalRIConstraints.doc > Informational Referential Integrity Constraints

[jira] [Updated] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2017-03-06 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-19842: -- Description: *Informational Referential Integrity Constraints Support in Spark* This work

[jira] [Created] (SPARK-20233) Apply star-join filter heuristics to dynamic programming join enumeration

2017-04-05 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-20233: - Summary: Apply star-join filter heuristics to dynamic programming join enumeration Key: SPARK-20233 URL: https://issues.apache.org/jira/browse/SPARK-20233 Project:

[jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2017-07-20 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094547#comment-16094547 ] Ioana Delaney commented on SPARK-19842: --- Yes, we've been working to productize our code. Our

[jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2018-01-21 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333703#comment-16333703 ] Ioana Delaney commented on SPARK-19842: --- The benefits of this work is that it opens up an area of

[jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2018-03-14 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398819#comment-16398819 ] Ioana Delaney commented on SPARK-19842: --- [~cloud_fan] The document is already uploaded to google

[jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2018-04-04 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425845#comment-16425845 ] Ioana Delaney commented on SPARK-19842: --- [~maropu] Thank you for reviewing the document. From your

[jira] [Created] (SPARK-23753) [Performance] Group By Push Down through Join

2018-03-20 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-23753: - Summary: [Performance] Group By Push Down through Join Key: SPARK-23753 URL: https://issues.apache.org/jira/browse/SPARK-23753 Project: Spark Issue Type:

[jira] [Created] (SPARK-23755) [Performance] Distinct elimination

2018-03-20 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-23755: - Summary: [Performance] Distinct elimination Key: SPARK-23755 URL: https://issues.apache.org/jira/browse/SPARK-23755 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-23752) [Performance] Existential Subquery to Inner Join

2018-03-20 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-23752: - Summary: [Performance] Existential Subquery to Inner Join Key: SPARK-23752 URL: https://issues.apache.org/jira/browse/SPARK-23752 Project: Spark Issue

[jira] [Created] (SPARK-23750) [Performance] Inner Join Elimination based on Informational RI constraints

2018-03-20 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-23750: - Summary: [Performance] Inner Join Elimination based on Informational RI constraints Key: SPARK-23750 URL: https://issues.apache.org/jira/browse/SPARK-23750

[jira] [Created] (SPARK-23756) [Performance] Redundant join elimination

2018-03-20 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-23756: - Summary: [Performance] Redundant join elimination Key: SPARK-23756 URL: https://issues.apache.org/jira/browse/SPARK-23756 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark

2018-03-20 Thread Ioana Delaney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406909#comment-16406909 ] Ioana Delaney commented on SPARK-19842: --- I opened several performance JIRAs to show the benefits of

[jira] [Created] (SPARK-23757) [Performance] Star schema detection improvements

2018-03-20 Thread Ioana Delaney (JIRA)
Ioana Delaney created SPARK-23757: - Summary: [Performance] Star schema detection improvements Key: SPARK-23757 URL: https://issues.apache.org/jira/browse/SPARK-23757 Project: Spark Issue