Hi, We are running spark streaming app on a single machine and we have configured spark executor memory to 30G. We noticed that after running the app for 12 hours, spark streaming started spilling ALL the data to disk even though we have configured sufficient memory for spark to use for storage.
-Mayur -- Learn more about our inaugural *FirstScreen Conference <http://www.firstscreenconf.com/>*! *Where the worlds of mobile advertising and technology meet!* June 15, 2016 @ Urania Berlin
