[
https://issues.apache.org/jira/browse/SPARK-26213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16705886#comment-16705886
]
Gabor Somogyi edited comment on SPARK-26213 at 12/3/18 4:27 PM:
----------------------------------------------------------------
On the other hand looks like this is not a feature suggestion but a question to
the community. In such cases you can write a mail to
[d...@spark.apache.org|http://apache-spark-developers-list.1001551.n3.nabble.com/].
[~aarthipa] If you agree please close the jira.
was (Author: gsomogyi):
On the other hand looks like this is not a feature suggestion but a question to
the community. In such cases you can write a mail to
[d...@spark.apache.org|http://apache-spark-developers-list.1001551.n3.nabble.com/].
If you agree please close the jira.
> Custom Receiver for Structured streaming
> ----------------------------------------
>
> Key: SPARK-26213
> URL: https://issues.apache.org/jira/browse/SPARK-26213
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Affects Versions: 2.4.0
> Reporter: Aarthi
> Priority: Major
>
> Hi,
> I have implemented a Custom Receiver for a https/json data source by
> implementing the Receievr abstract class as provided in the documentation
> here [https://spark.apache.org/docs/latest//streaming-custom-receivers.html]
> This approach works on Spark streaming context where the custom receiver
> class is passed it receiverStream. However I would like the implement the
> same for Structured streaming as each of the DStreams have a complex
> structure and need to be joined with each other based on complex rules.
> ([https://stackoverflow.com/questions/53449599/join-two-spark-dstreams-with-complex-nested-structure])
> Structured streaming uses the Spark Session object that takes in
> DataStreamReader which is a final class. Please advice on how to implement
> the custom receiver for Strucutred Streaming.
> Thanks,
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
