[
https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251353#comment-15251353
]
Mario Briggs commented on SPARK-14745:
--------------------------------------
Hi Sean,
thanks for 'fixing' the target.
To answer you question, right now the code contains a first cut minimal
implementation that i am hoping others can comment on if there are more
efficient approaches to implement (a). Then there is the task of seeing how to
fit in with structured streaming, now that quite a bit of info is available on
this topic (b). Both b and a would led us to be in a better position to answer
your question. For example with b, would that be a UDF or not and if so what
that means for the implementation and users w.r.t to perf and/or ease of use.
Also in the initial structured streaming proposal
(https://issues.apache.org/jira/secure/attachment/12793419/StreamingDataFrameProposal.pdf)
the 'Event- trigger' section kind of left the impression to me that it was
aiming at pattern matching ( I am not yet up-todate on the new one), so curious
on that. Finally if 'a' leads to some more options, those might lead to looking
at some changes that make sense. Sorry for the slightly long-winded answer, but
i hope it gives an idea of current options.
> CEP support in Spark Streaming
> ------------------------------
>
> Key: SPARK-14745
> URL: https://issues.apache.org/jira/browse/SPARK-14745
> Project: Spark
> Issue Type: New Feature
> Components: Streaming
> Reporter: Mario Briggs
> Attachments: SparkStreamingCEP.pdf
>
>
> Complex Event Processing is a often used feature in Streaming applications.
> Spark Streaming current does not have a DSL/API for it. This JIRA is about
> how/what can we add in Spark Streaming to support CEP out of the box
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
