[
https://issues.apache.org/jira/browse/SPARK-19690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136171#comment-16136171
]
Jose Torres commented on SPARK-19690:
-------------------------------------
This will be fixed by SPARK-21765; we can restrict the streaming aggregation
strategy to only the subtrees of the logical plan which are actually streaming.
> Join a streaming DataFrame with a batch DataFrame may not work
> --------------------------------------------------------------
>
> Key: SPARK-19690
> URL: https://issues.apache.org/jira/browse/SPARK-19690
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 2.0.3, 2.1.0, 2.1.1
> Reporter: Shixiong Zhu
> Priority: Critical
>
> When joining a streaming DataFrame with a batch DataFrame, if the batch
> DataFrame has an aggregation, it will be converted to a streaming physical
> aggregation. Then the query will crash.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
