GitHub user oza opened a pull request:
https://github.com/apache/spark/pull/15806
[SPARK-18345][STRUCTURED STREAMING] Structured Streaming quick examples
fails with default configuration
## What changes were proposed in this pull request?
This PR fixes failure of a quick example of structured streaming with
default configuration, because of failure of HDFS connection.
* Fix to use local filesystem as checkpointLocation.
* Fix a wrong branch condition of recoverFromCheckpointLocation in
StreamingQueryManager.
## How was this patch tested?
I test this with manual test: running a quick example of structured
streaming with default configuration. With this fix, it works well without
configuring HDFS.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/oza/spark SPARK-18345
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15806.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15806
----
commit 30e5364d902dd48cc154de4d8b23183477a3b5c4
Author: Tsuyoshi Ozawa <[email protected]>
Date: 2016-11-08T05:34:31Z
Fix to launch streaming quick example with default configuration
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
