[
https://issues.apache.org/jira/browse/SPARK-18591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165148#comment-16165148
]
Maryann Xue commented on SPARK-18591:
-
Hey, I came up with this idea of doing sort-aggregate on
Maryann Xue created SPARK-21998:
---
Summary: SortMergeJoinExec should calculate its outputOrdering
independent of its children's outputOrdering
Key: SPARK-21998
URL: https://issues.apache.org/jira/browse/SPARK-21998
[
https://issues.apache.org/jira/browse/SPARK-21998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165765#comment-16165765
]
Maryann Xue commented on SPARK-21998:
-
Thank you for pointing this out, [~maropu]! Yes, you are
[
https://issues.apache.org/jira/browse/SPARK-21998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-21998:
Summary: SortMergeJoinExec did not calculate its outputOrdering correctly
during physical planning
[
https://issues.apache.org/jira/browse/SPARK-21998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-21998:
Description:
Right now the calculation of SortMergeJoinExec's outputOrdering relies on the
fact
[
https://issues.apache.org/jira/browse/SPARK-21998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172169#comment-16172169
]
Maryann Xue commented on SPARK-21998:
-
Thanks again for your comment, [~maropu]! I changed the title
[
https://issues.apache.org/jira/browse/SPARK-22266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203105#comment-16203105
]
Maryann Xue commented on SPARK-22266:
-
Thank you for the comment, [~maropu]! I think it is a problem
Maryann Xue created SPARK-22266:
---
Summary: The same aggregate function was evaluated multiple times
Key: SPARK-22266
URL: https://issues.apache.org/jira/browse/SPARK-22266
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480237#comment-16480237
]
Maryann Xue commented on SPARK-24288:
-
Thank you for pointing this out, [~cloud_fan]! I made
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476985#comment-16476985
]
Maryann Xue commented on SPARK-24288:
-
The special operator would just look like
{{sql("SELECT * FROM
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477747#comment-16477747
]
Maryann Xue commented on SPARK-24288:
-
Thank you, [~cloud_fan] and [~TomaszGaweda] for the input!
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24288:
Attachment: SPARK-24288.simple.patch
> Enable preventing predicate pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476368#comment-16476368
]
Maryann Xue commented on SPARK-24288:
-
Feel free to assign this to me then, [~smilegator].
> Enable
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476372#comment-16476372
]
Maryann Xue commented on SPARK-24288:
-
I agree with you, [~TomaszGaweda], that making this a special
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476900#comment-16476900
]
Maryann Xue commented on SPARK-24288:
-
After taking a closer look at the problem, I realized that we
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476985#comment-16476985
]
Maryann Xue edited comment on SPARK-24288 at 5/16/18 7:46 AM:
--
The special
[
https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16478534#comment-16478534
]
Maryann Xue commented on SPARK-24288:
-
Yes, sure. This is more of a demonstration than a patch. So
Maryann Xue created SPARK-24583:
---
Summary: Wrong schema type in InsertIntoDataSourceCommand
Key: SPARK-24583
URL: https://issues.apache.org/jira/browse/SPARK-24583
Project: Spark
Issue Type:
Maryann Xue created SPARK-24568:
---
Summary: Code refactoring for DataType equalsXXX methods
Key: SPARK-24568
URL: https://issues.apache.org/jira/browse/SPARK-24568
Project: Spark
Issue Type:
Maryann Xue created SPARK-24596:
---
Summary: Non-cascading Cache Invalidation
Key: SPARK-24596
URL: https://issues.apache.org/jira/browse/SPARK-24596
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24696:
Description:
The following test case would cause a "max iterations reached" error, i.e., an
[
https://issues.apache.org/jira/browse/SPARK-24613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24613:
Issue Type: Bug (was: Improvement)
> Cache with UDF could not be matched with subsequent
Maryann Xue created SPARK-24613:
---
Summary: Cache with UDF could not be matched with subsequent
dependent caches
Key: SPARK-24613
URL: https://issues.apache.org/jira/browse/SPARK-24613
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24613:
Priority: Minor (was: Major)
> Cache with UDF could not be matched with subsequent dependent
[
https://issues.apache.org/jira/browse/SPARK-24613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24613:
Description:
When caching a query, we generate its execution plan from the query's logical
plan.
Maryann Xue created SPARK-24164:
---
Summary: Support column list as the pivot column in Pivot
Key: SPARK-24164
URL: https://issues.apache.org/jira/browse/SPARK-24164
Project: Spark
Issue Type:
Maryann Xue created SPARK-24162:
---
Summary: Support aliased literal values for Pivot "IN" clause
Key: SPARK-24162
URL: https://issues.apache.org/jira/browse/SPARK-24162
Project: Spark
Issue
Maryann Xue created SPARK-24163:
---
Summary: Support "ANY" or sub-query for Pivot "IN" clause
Key: SPARK-24163
URL: https://issues.apache.org/jira/browse/SPARK-24163
Project: Spark
Issue Type:
Maryann Xue created SPARK-23368:
---
Summary: OutputOrdering and OutputPartitioning in ProjectExec
should reflect the projected columns
Key: SPARK-23368
URL: https://issues.apache.org/jira/browse/SPARK-23368
[
https://issues.apache.org/jira/browse/SPARK-23368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-23368:
Summary: Avoid unnecessary Exchange or Sort after projection (was:
OutputOrdering and
[
https://issues.apache.org/jira/browse/SPARK-23368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366374#comment-16366374
]
Maryann Xue commented on SPARK-23368:
-
[~cloud_fan], [~smilegator], Could you please help review this
[
https://issues.apache.org/jira/browse/SPARK-24596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24596:
Description:
When invalidating a cache, we invalid other caches dependent on this cache to
Maryann Xue created SPARK-24972:
---
Summary: PivotFirst could not handle pivot columns of complex types
Key: SPARK-24972
URL: https://issues.apache.org/jira/browse/SPARK-24972
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25063:
Description: It's a class name typo checked in through SPARK-24891 (was:
It's a class name typo
Maryann Xue created SPARK-25063:
---
Summary: Rename class KnowNotNull to KnownNotNull
Key: SPARK-25063
URL: https://issues.apache.org/jira/browse/SPARK-25063
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-24891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24891:
Summary: Fix HandleNullInputsForUDF rule (was: Fix HandleNullInputsForUDF
rule.)
> Fix
Maryann Xue created SPARK-24891:
---
Summary: Fix HandleNullInputsForUDF rule.
Key: SPARK-24891
URL: https://issues.apache.org/jira/browse/SPARK-24891
Project: Spark
Issue Type: Bug
Maryann Xue created SPARK-24790:
---
Summary: Allow complex aggregate expressions in Pivot
Key: SPARK-24790
URL: https://issues.apache.org/jira/browse/SPARK-24790
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-24790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24790:
Description: In SPARK-24035, to conform with Oracle PIVOT syntax, a strict
check of PIVOT's
[
https://issues.apache.org/jira/browse/SPARK-24802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-24802:
Description:
Since Spark has provided fairly clear interfaces for adding user-defined
Maryann Xue created SPARK-24802:
---
Summary: Optimization Rule Exclusion
Key: SPARK-24802
URL: https://issues.apache.org/jira/browse/SPARK-24802
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-20169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418282#comment-16418282
]
Maryann Xue commented on SPARK-20169:
-
This was related to the use of "withColumnRenamed", which will
[
https://issues.apache.org/jira/browse/SPARK-20169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419808#comment-16419808
]
Maryann Xue commented on SPARK-20169:
-
[~smilegator], I think this is also caused by SPARK-23368, so
[
https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25650:
Description:
Rules like {{HandleNullInputsForUDF}}
Maryann Xue created SPARK-25650:
---
Summary: Make analyzer rules used in once-policy idempotent
Key: SPARK-25650
URL: https://issues.apache.org/jira/browse/SPARK-25650
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25650:
Issue Type: Task (was: Bug)
> Make analyzer rules used in once-policy idempotent
>
[
https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25690:
Description:
This was fixed in SPARK-24891 and was then broken by SPARK-25044.
The unit test in
[
https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25914:
Description:
Currently the Spark SQL logical Aggregate has two expression fields:
[
https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25914:
Description:
Currently the Spark SQL logical Aggregate has two expression fields:
Maryann Xue created SPARK-25916:
---
Summary: Add `resultExpressions` in logical `Aggregate`
Key: SPARK-25916
URL: https://issues.apache.org/jira/browse/SPARK-25916
Project: Spark
Issue Type:
Maryann Xue created SPARK-25914:
---
Summary: Separate projection from grouping and aggregate in
logical Aggregate
Key: SPARK-25914
URL: https://issues.apache.org/jira/browse/SPARK-25914
Project: Spark
Maryann Xue created SPARK-25915:
---
Summary: Replace grouping expressions with references in
`aggregateExpressions` of logical `Aggregate`
Key: SPARK-25915
URL: https://issues.apache.org/jira/browse/SPARK-25915
Maryann Xue created SPARK-26065:
---
Summary: Change query hint from a `LogicalPlan` to a field
Key: SPARK-26065
URL: https://issues.apache.org/jira/browse/SPARK-26065
Project: Spark
Issue Type:
Maryann Xue created SPARK-25690:
---
Summary: Analyzer rule "HandleNullInputsForUDF" does not stabilize
and can be applied infinitely
Key: SPARK-25690
URL: https://issues.apache.org/jira/browse/SPARK-25690
[
https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25690:
Description:
This was fixed in SPARK-24891 and was then broken by SPARK-25044.
The tests added
Maryann Xue created SPARK-25691:
---
Summary: Analyzer rule "AliasViewChild" does not stabilize
Key: SPARK-25691
URL: https://issues.apache.org/jira/browse/SPARK-25691
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25650:
Description:
Rules like {{HandleNullInputsForUDF}}
[
https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25690:
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-14220)
> Analyzer rule
[
https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25690:
Issue Type: Sub-task (was: Bug)
Parent: SPARK-25650
> Analyzer rule
Maryann Xue created SPARK-25505:
---
Summary: The output order of grouping columns in Pivot is
different from the input order
Key: SPARK-25505
URL: https://issues.apache.org/jira/browse/SPARK-25505
Maryann Xue created SPARK-25415:
---
Summary: Make plan change log in RuleExecutor configurable by
SQLConf
Key: SPARK-25415
URL: https://issues.apache.org/jira/browse/SPARK-25415
Project: Spark
Maryann Xue created SPARK-25450:
---
Summary: PushProjectThroughUnion rule uses the same exprId for
project expressions in each Union child, causing mistakes in constant
propagation
Key: SPARK-25450
URL:
[
https://issues.apache.org/jira/browse/SPARK-25450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25450:
Issue Type: Bug (was: Improvement)
> PushProjectThroughUnion rule uses the same exprId for
[
https://issues.apache.org/jira/browse/SPARK-25423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25423:
Summary: Output "dataFilters" in DataSourceScanExec.metadata (was: Output
"dataFilters" in
Maryann Xue created SPARK-25423:
---
Summary: Output "dataFilters" in DataSourceScanExec.toString
Key: SPARK-25423
URL: https://issues.apache.org/jira/browse/SPARK-25423
Project: Spark
Issue
Maryann Xue created SPARK-27225:
---
Summary: Implement join strategy hints
Key: SPARK-27225
URL: https://issues.apache.org/jira/browse/SPARK-27225
Project: Spark
Issue Type: New Feature
Maryann Xue created SPARK-27088:
---
Summary: Apply conf "spark.sql.optimizer.planChangeLog.level" to
batch plan change in RuleExecutor
Key: SPARK-27088
URL: https://issues.apache.org/jira/browse/SPARK-27088
Maryann Xue created SPARK-27236:
---
Summary: Refactor log-appender pattern in tests
Key: SPARK-27236
URL: https://issues.apache.org/jira/browse/SPARK-27236
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-27223:
Summary: Remove private methods that skip conversion when passing user
schemas for constructing a
Maryann Xue created SPARK-27223:
---
Summary: Remove private methods that allow no conversion when
passing user schemas for constructing a DataFrame
Key: SPARK-27223
URL:
[
https://issues.apache.org/jira/browse/SPARK-26840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-26840:
Description: This is a fix for
Maryann Xue created SPARK-26840:
---
Summary: Avoid cost-based join reorder in presence of join hints
Key: SPARK-26840
URL: https://issues.apache.org/jira/browse/SPARK-26840
Project: Spark
Issue
Maryann Xue created SPARK-28057:
---
Summary: Add method `clone` in catalyst TreeNode
Key: SPARK-28057
URL: https://issues.apache.org/jira/browse/SPARK-28057
Project: Spark
Issue Type:
Maryann Xue created SPARK-27824:
---
Summary: Make rule EliminateResolvedHint idempotent
Key: SPARK-27824
URL: https://issues.apache.org/jira/browse/SPARK-27824
Project: Spark
Issue Type: Bug
Maryann Xue created SPARK-27783:
---
Summary: Add customizable hint error handler
Key: SPARK-27783
URL: https://issues.apache.org/jira/browse/SPARK-27783
Project: Spark
Issue Type: Improvement
Maryann Xue created SPARK-28583:
---
Summary: Subqueries should not call `onUpdatePlan` in Adaptive
Query Execution
Key: SPARK-28583
URL: https://issues.apache.org/jira/browse/SPARK-28583
Project: Spark
Maryann Xue created SPARK-28753:
---
Summary: Dynamically reuse subqueries in AQE
Key: SPARK-28753
URL: https://issues.apache.org/jira/browse/SPARK-28753
Project: Spark
Issue Type: Improvement
Maryann Xue created SPARK-2:
---
Summary: Implement Dynamic Partition Pruning
Key: SPARK-2
URL: https://issues.apache.org/jira/browse/SPARK-2
Project: Spark
Issue Type: New Feature
Maryann Xue created SPARK-28959:
---
Summary: Support `EqualNullSafe` as join condition in Dynamic
Partition Pruning
Key: SPARK-28959
URL: https://issues.apache.org/jira/browse/SPARK-28959
Project: Spark
Maryann Xue created SPARK-29002:
---
Summary: Avoid changing SMJ to BHJ if the build side has a high
ratio of empty partitions
Key: SPARK-29002
URL: https://issues.apache.org/jira/browse/SPARK-29002
Maryann Xue created SPARK-29060:
---
Summary: Add tree traversal helper for adaptive spark plans
Key: SPARK-29060
URL: https://issues.apache.org/jira/browse/SPARK-29060
Project: Spark
Issue Type:
81 matches
Mail list logo
