GitHub user assafmendelson opened a pull request:
https://github.com/apache/spark/pull/18342
[Spark 21123][Docs][Structured Streaming] Options for file stream source
are in a wrong table
## What changes were proposed in this pull request?
The description for several options of File Source for structured streaming
appeared in the File Sink description instead.
This pull request has two commits: The first includes changes to the
version as it appeared in spark 2.1 and the second handled an additional option
added for spark 2.2
## How was this patch tested?
Built the documentation by SKIP_API=1 jekyll build and visually inspected
the structured streaming programming guide.
The original documentation was written by @tdas and @lw-lin
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/assafmendelson/spark spark-21123
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18342.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18342
----
commit f8044581b35eaa33aa78c29c602fedf1d89c06b8
Author: assafmendelson <[email protected]>
Date: 2017-06-18T06:20:50Z
File source options for spark 2.1 appeared under File sink
commit 13ff475f42f22f4bdee4b982c217feb0c8825d57
Author: assafmendelson <[email protected]>
Date: 2017-06-18T06:23:31Z
Additional File source options for spark 2.2 appeared under File sink
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
