lisancao opened a new pull request, #708:
URL: https://github.com/apache/spark-website/pull/708
The Structured Streaming product page at spark.apache.org/streaming/ predates
Real-time Mode and only described micro-batch streaming. This updates the
page to
cover both execution modes.
Changes:
- Describe Real-time Mode and micro-batch mode, and note that both use the
same
APIs and codebase and differ only by the trigger.
- Fix the code examples to use the real trigger APIs:
`Trigger.ProcessingTime("1 minute")`
for micro-batch and `Trigger.RealTime("5 minutes")` for Real-time Mode,
with the
`update` output mode that Real-time Mode requires.
- Describe latency the way the Real-time Mode documentation does: a
micro-batch floor
around 100 ms, dropping to millisecond-scale under Real-time Mode.
This is the product page only. The programming guide under docs/ is built and
published with each release, so it is out of scope here.
site/streaming/index.html was regenerated with `bundle exec jekyll build`
(Jekyll 4.4.1) and is included.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
