Github user tdas commented on a diff in the pull request:
    --- Diff: 
    @@ -62,7 +64,7 @@ case class StreamingRelation(dataSource: DataSource, 
sourceName: String, output:
     case class StreamingExecutionRelation(
    --- End diff --
    They need to extend MultiInstance relation, because Dataset.join() forces 
an analysis to disambiguate left and right in self-joins 
 and when there is a self-join between two streaming Datasets (i.e. they 
contain StreamingRelation/StreamingRelationV2), without the 
MultiInstanceRelation, it throws the error (see PR description).
    Regarding StreamingExecutionRelation, while the other sources convert 
StreamingRelation to StreamingExecutionRelation, the MemoryStream directly 
injects StreamingExceutionRelation at that time of Dataset operations. Hence 
its good that StreamingExecutionRelation also extends MultiInstanceRelation.


To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to