Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19271#discussion_r140042806
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
---
@@ -222,16 +222,17 @@ object UnsupportedOperationChecker {
joinType match {
case _: InnerLike =>
- if (left.isStreaming && right.isStreaming) {
- throwError("Inner join between two streaming
DataFrames/Datasets is not supported")
+ if (left.isStreaming && right.isStreaming &&
--- End diff --
What if the join is not equality join? UnsupportedOperationChecker should
disallow this case?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
