[
https://issues.apache.org/jira/browse/BEAM-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amit Sela updated BEAM-851:
---------------------------
Description: Instead of having the user explicilty set
{{StreamingOptions.setStreaming(true)}} ,the SparkRunner could first traverse
the Pipeline (or even better, just it's sources) to identify if at least one of
the sources is an {{UnboundedSource}} (or equivalently if the root
transformations are {{Read.Unbounded}}). (was: Instead of asking the user to
explicilty set {{StreamingOptions.setStreaming(true)}} ,the SparkRunner could
first traverse the Pipeline (or even better, just it's sources) to identify if
at least one of the sources is an {{UnboundedSource}} (or equivalently if the
root transformations are {{Read.Unbounded}}).)
> Identify streaming pipelines implicitly.
> ----------------------------------------
>
> Key: BEAM-851
> URL: https://issues.apache.org/jira/browse/BEAM-851
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Amit Sela
>
> Instead of having the user explicilty set
> {{StreamingOptions.setStreaming(true)}} ,the SparkRunner could first traverse
> the Pipeline (or even better, just it's sources) to identify if at least one
> of the sources is an {{UnboundedSource}} (or equivalently if the root
> transformations are {{Read.Unbounded}}).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
