Hi, I am using spark-sql-2.4.1v to streaming in my PoC.
how to refresh the loaded dataframe from hdfs/cassandra table every time new batch of stream processed ? What is the practice followed in general to handle this kind of scenario? Below is the SOF link for more details . https://stackoverflow.com/questions/57815645/how-to-refresh-the-contents-of-non-streaming-dataframe Thank you, Shyam