[
https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259972#comment-14259972
]
Saisai Shao commented on SPARK-4960:
------------------------------------
Hi [~tdas] and [~hshreedharan], these days I think thoroughly about the
solutions of this interceptor pattern in Spark Streaming, currently I found a
relatively simple and less intrusive solution about it. This solution has no
change to current API and easy to use for end user, also its a kind of plug
into the original DStream chain, so there's no difference without interceptor.
Here is the link
(https://docs.google.com/document/d/1-JfFkFlc5APstIcvCeqqv2t5np30ft5qaTIiNCGZfdI/edit?usp=sharing).
Would you mind taking a look at it give me some comments, thanks a lot.
> Interceptor pattern in receivers
> --------------------------------
>
> Key: SPARK-4960
> URL: https://issues.apache.org/jira/browse/SPARK-4960
> Project: Spark
> Issue Type: New Feature
> Components: Streaming
> Reporter: Tathagata Das
>
> Sometimes it is good to intercept a message received through a receiver and
> modify / do something with the message before it is stored into Spark. This
> is often referred to as the interceptor pattern. There should be general way
> to specify an interceptor function that gets applied to all receivers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
