GitHub user joseph-torres opened a pull request:
https://github.com/apache/spark/pull/18925
[SPARK-21713][SC] Replace streaming bit with OutputMode
## What changes were proposed in this pull request?
* Replace LogicalPlan.isStreaming with output mode.
* Replace Deduplicate.streaming with output mode.
Note that this is an implementation-only change, so it deliberately does
not change isStreaming in the Dataset API.
## How was this patch tested?
refactoring only - ran existing unit tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/joseph-torres/spark SC-8027
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18925.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18925
----
commit 4d8fe6e3e0300b847cbf11a8c29b9cda696bb238
Author: Jose Torres <[email protected]>
Date: 2017-08-10T16:59:40Z
Rename FlatMapGroupsWithState.outputMode to funcOutputMode.
commit aacf0592e7720e4784377714673cc4d2151be66d
Author: Jose Torres <[email protected]>
Date: 2017-08-10T16:24:56Z
partial
commit e23b1d0c7563eeecccc61697b7a3a4a1a3f6fe1d
Author: Jose Torres <[email protected]>
Date: 2017-08-10T17:54:54Z
Replace LogicalPlan.isStreaming with outputMode Append() and Complete().
commit d2f7e604f58071f7f14c68f9760e1b5d0b705487
Author: Jose Torres <[email protected]>
Date: 2017-08-11T17:25:52Z
Replace Deduplicate.streaming with output mode.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
