Any help?
Need urgent help. Someone please clarify the doubt?
-- Forwarded message --
From: Aakash Basu
Date: Thu, Apr 5, 2018 at 2:28 PM
Subject: [Structured Streaming] How to save entire column aggregation to a
file
To: user
Hi,
I want to save an aggregate to a file
Hi,
I want to save an aggregate to a file without using any window, watermark
or groupBy. So, my aggregation is at entire column level.
df = spark.sql("select avg(col1) as aver from ds")
Now, the challenge is as follows -
1) If I use outputMode = Append, but "*Append output mode not supported