Hi again, On Tue, Aug 26, 2014 at 10:13 AM, Tobias Pfeiffer <t...@preferred.jp> wrote: > > On Mon, Aug 25, 2014 at 7:11 PM, praveshjain1991 < > praveshjain1...@gmail.com> wrote: >> >> "If you want to issue an SQL statement on streaming data, you must have >> both >> the registerAsTable() and the sql() call *within* the foreachRDD(...) >> block, >> or -- as you experienced -- the table name will be unknown" >> >> Since this is the case then is there any way to run join over data >> received >> from two different streams? >> > > Couldn't you do dstream1.join(dstream2).foreachRDD(...)? >
Ah, I guess you meant something like "SELECT * FROM dstream1 JOIN dstream2 WHERE ..."? I don't know if that is possible. Doesn't seem easy to me; I don't think that's doable with the current codebase... Tobias
