Re: spark-3.0.0-preview release notes link is broken

2019-11-28 Thread Xingbo Jiang
Hi Sandeep, Thanks for reporting! spark-3.0.0-preview is not a stable release, so we should not include this version in the `Release Notes for Stable Releases` section. I've submitted a PR ( https://github.com/apache/spark-website/pull/235) to fix the issue. Cheers, Xingbo On Thu, Nov 28, 2019

Re: Query regarding stateless aggregations

2019-11-28 Thread Jungtaek Lim
I'm not sure the meaning of stateless aggregation for structured streaming. The ground rule is that both batch query and streaming query should provide same output if there's no late rows and no indeterministic functions/operations - the query should not produce different outputs depending on how

spark-3.0.0-preview release notes link is broken

2019-11-28 Thread Sandeep Katta
Hi, I see for preview release, release notes link is broken. https://spark.apache.org/releases/spark-release-3-0-0-preview.html

Query regarding stateless aggregations

2019-11-28 Thread Chitral Verma
Hi Devs, I have a query regarding stateless aggregations. I understand that its possible to do stateless aggregation using mapGroups and flatMapGroups API in Spark 2.x+. I want to use aggregate queries on a streaming registered temporary view. Is there any way to do the same using spark.sql("