GitHub user SimonUzL opened a pull request:
https://github.com/apache/spark/pull/19526
[SPARK-22014][SQL] removed TypeCheckFailure: slide duration <=
windowDuration
It is possible to create sampling windows in Spark Streaming, where the
duration of the window is smaller than the slide, but it throws a
TypeCheckFailure in Spark SQL.
I think there should be no difference (duration and slide) in a "Spark
Streaming window" and a "Spark SQL window" function.
@brkyvz
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/SimonUzL/spark sampling_window
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19526.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19526
----
commit 295872b23af94f514263ec7512a572c88eb172db
Author: Simon Schiff <[email protected]>
Date: 2017-10-17T08:52:42Z
removed TypeCheckFailure: slide duration must be less than or equal to the
windowDuration
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
