GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/13162
[SPARK-15375][SQL][Streaming] Add ConsoleSink to structure streaming
## What changes were proposed in this pull request?
Add ConsoleSink to structure streaming, user could use it to display
dataframes on the console (useful for debugging and demostrating), similar to
the functionality of `DStream#print`, to use it:
```
val query = result.write
.format("console")
.trigger(ProcessingTime("2 seconds"))
.startStream()
```
## How was this patch tested?
local verified.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/apache-spark SPARK-15375
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13162.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13162
----
commit 235f5d28c0d53697c12b647df94fa9c7670d8faa
Author: jerryshao <[email protected]>
Date: 2016-05-18T02:51:39Z
Add ConsoleSink to structure streaming
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
