Here a JIRA: https://issues.apache.org/jira/browse/SPARK-19497
We should add this soon. On Tue, Feb 7, 2017 at 8:35 AM, Sam Elamin <hussam.ela...@gmail.com> wrote: > Hi All > > When trying to read a stream off S3 and I try and drop duplicates I get > the following error: > > Exception in thread "main" org.apache.spark.sql.AnalysisException: Append > output mode not supported when there are streaming aggregations on > streaming DataFrames/DataSets;; > > > Whats strange if I use the batch "spark.read.json", it works > > Can I assume you cant drop duplicates in structured streaming > > Regards > Sam >
