Re: [SS] full outer stream-stream join

2020-11-22 Thread Jungtaek Lim
Adding rationalization here, my request for raising the thead to dev mailing list is, to figure out possible reasons not having full outer join at the moment when adding left/right outer join. This is rather historical knowledge, so I have no idea about this. Most likely a limited number of folks

[SS] full outer stream-stream join

2020-11-20 Thread real-cheng-su
Hi, Stream-stream join in spark structured streaming right now supports INNER, LEFT OUTER, RIGHT OUTER and LEFT SEMI join type. But it does not support FULL OUTER join and we are working on to add it in https://github.com/apache/spark/pull/30395 . Given LEFT OUTER and RIGHT OUTER stream-stream