[
https://issues.apache.org/jira/browse/SPARK-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466410#comment-16466410
]
Michael Armbrust commented on SPARK-18165:
------------------------------------------
This is great! I'm glad there are more connectors for Structured Streaming!
A few high-level thoughts:
- The current Source/Sink APIs are internal/unstable. We are working on
building public/stable APIs as part of DataSourceV2. Would be great to get
feedback on those APIs if this is ported to them
- In general as the Spark project scales, we are trying to move more of the
connectors out of the core project. I'd suggest looking at contributing this
to Apache Bahir and/or Spark Packages.
> Kinesis support in Structured Streaming
> ---------------------------------------
>
> Key: SPARK-18165
> URL: https://issues.apache.org/jira/browse/SPARK-18165
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Reporter: Lauren Moos
> Priority: Major
>
> Implement Kinesis based sources and sinks for Structured Streaming
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
