GitHub user jose-torres opened a pull request:
https://github.com/apache/spark/pull/20828
[SPARK-23687][SS] Add a memory source for continuous processing.
## What changes were proposed in this pull request?
Add a memory source for continuous processing.
Note that only one of the ContinuousSuite tests is migrated to minimize the
diff here. I'll submit a second PR for SPARK-23688 to change the rest and get
rid of waitForRateSourceTriggers.
## How was this patch tested?
unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jose-torres/spark continuousMemory
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20828.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20828
----
commit 4b45318d5dec76fd0b8f0b69f0a48e9387367442
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-14T16:04:14Z
partial
commit 4f80ba7cfc42e042671850f2913712e189a051ab
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-15T00:18:31Z
continuous memory
commit 5ffa8e223187a1943c7b22abe379ccc3cf390513
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-15T01:40:25Z
use for single test
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
