cool ,but did you find a way or anyhelp or clue ? On Fri, Sep 6, 2019 at 11:40 PM David Zhou <zhou10...@gmail.com> wrote:
> I have the same question with yours > > On Thu, Sep 5, 2019 at 9:18 PM Shyam P <shyamabigd...@gmail.com> wrote: > >> Hi, >> >> I am using spark-sql-2.4.1v to streaming in my PoC. >> >> how to refresh the loaded dataframe from hdfs/cassandra table every time >> new batch of stream processed ? What is the practice followed in general to >> handle this kind of scenario? >> >> Below is the SOF link for more details . >> >> >> https://stackoverflow.com/questions/57815645/how-to-refresh-the-contents-of-non-streaming-dataframe >> >> Thank you, >> Shyam >> >> >