I'm running a single worker EMR cluster for a Structured Streaming job. How do I deal with my application log filling up HDFS?
/var/log/spark/apps/application_1487823545416_0021_1.inprogress is currently 21.8 GB *Sent with Shift <https://tryshift.com/?utm_source=SentWithShift&utm_campaign=Sent%20with%20Shift%20Signature&utm_medium=Email%20Signature&utm_content=General%20Email%20Group/>*
