[
https://issues.apache.org/jira/browse/SPARK-53736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18035242#comment-18035242
]
Dongjoon Hyun commented on SPARK-53736:
---------------------------------------
Yes, I asked that because `Add additional E2E tests` doesn't look like a
blocker. `Allow list for operators` is a little tricky but also looks like an
improvement instead of a blocker. BTW, it was a question to understand your
thought about the maturity of the feature, `Real-Time Mode`.
It's a question as the release manager of Apache Spark 4.1.0.
> Real-time Mode in Structured Streaming
> --------------------------------------
>
> Key: SPARK-53736
> URL: https://issues.apache.org/jira/browse/SPARK-53736
> Project: Spark
> Issue Type: Epic
> Components: Structured Streaming
> Affects Versions: 4.1.0
> Reporter: Boyang Jerry Peng
> Priority: Major
> Labels: releasenotes
>
> Real-time mode for Apache Spark Structured Streaming is a new execution model
> designed to significantly lower end-to-end data processing latency to the
> order of 100 milliseconds.
>
> More details can be found in the SPIP
> [https://docs.google.com/document/d/1CvJvtlTGP6TwQIT4kW6GFT1JbdziAYOBvt60ybb7Dw8/edit?usp=sharing]
>
> SPIP approved by the community:
> [https://lists.apache.org/thread/k93gj0ko54kcslzkjwp95nqvjnkwcb63]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
