Thanks for bringing this issue to the mailing list.
As an addition, I would also ask the same questions about DStreams and
Structured Streaming APIs.
Structured Streaming is high level and it makes difficult to express all
business logic in it, although Databricks are pushing it and recommending
Hi,
Is spark 2.0.0 supports partitioned windows in streaming?
Cheers
Adrienne
Hi all,
I am using Spark Streaming for my use case.
I want to
- partition or group the stream by key
- window the tuples in partitions
and - find max/min element in windows (in every partition)
My code is like:
val keyedStream = socketDataSource.map(s =>
