Re: spark-3.0.0-preview release notes link is broken

[Xingbo Jiang]

Hi Sandeep,

Thanks for reporting! spark-3.0.0-preview is not a stable release, so we
should not include this version in the `Release Notes for Stable Releases`
section. I've submitted a PR (
https://github.com/apache/spark-website/pull/235) to fix the issue.

Cheers,

Xingbo

On Thu, Nov 28, 2019 at 8:53 PM Sandeep Katta <
sandeep0102.opensou...@gmail.com> wrote:

> Hi,
>
> I see for preview release, release notes link is broken.
>
> https://spark.apache.org/releases/spark-release-3-0-0-preview.html
>

Re: Query regarding stateless aggregations

[Jungtaek Lim]

I'm not sure the meaning of stateless aggregation for structured streaming.

The ground rule is that both batch query and streaming query should provide
same output if there's no late rows and no indeterministic
functions/operations - the query should not produce different outputs
depending on how the input is broken down to multiple batches. By the
definition of ground rule, streaming aggregation is required to be stateful.

Thanks,
Jungtaek Lim (HeartSaVioR)

On Thu, Nov 28, 2019 at 9:17 PM Chitral Verma 
wrote:

> Hi Devs,
> I have a query regarding stateless aggregations.
>
> I understand that its possible to do stateless aggregation using mapGroups
>  and flatMapGroups API in Spark 2.x+. I want to use aggregate queries on
> a streaming registered temporary view. Is there any way to do the same
> using spark.sql(" ... ") ?
>
> Also posted here,
>
> https://stackoverflow.com/questions/59050663/is-it-possible-to-do-stateless-aggregations-using-spark-sql
>
> Any helps will be appreciated.
>
> Regards,
> Chitral Verma
>

spark-3.0.0-preview release notes link is broken

[Sandeep Katta]

Hi,

I see for preview release, release notes link is broken.

https://spark.apache.org/releases/spark-release-3-0-0-preview.html

Query regarding stateless aggregations

[Chitral Verma]

Hi Devs,
I have a query regarding stateless aggregations.

I understand that its possible to do stateless aggregation using mapGroups
 and flatMapGroups API in Spark 2.x+. I want to use aggregate queries on a
streaming registered temporary view. Is there any way to do the same
using spark.sql("
... ") ?

Also posted here,
https://stackoverflow.com/questions/59050663/is-it-possible-to-do-stateless-aggregations-using-spark-sql

Any helps will be appreciated.

Regards,
Chitral Verma