[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083836#comment-14083836
]
Chris Fregly commented on SPARK-1981:
-------------------------------------
hey nick-
due to the Kinesis Client Library's ASL license restriction, we ended up
isolating all kinesis-related code to the extras/kinesis-asl module.
this module can be activated at build time by including -Pkinesis-asl in either
sbt or maven.
this is all documented here, btw:
https://github.com/apache/spark/blob/master/docs/streaming-kinesis.md
looks like i messed up the markdown a bit. whoops! but the details are all
there. i'll try to clean that up.
> Add AWS Kinesis streaming support
> ---------------------------------
>
> Key: SPARK-1981
> URL: https://issues.apache.org/jira/browse/SPARK-1981
> Project: Spark
> Issue Type: New Feature
> Components: Streaming
> Reporter: Chris Fregly
> Assignee: Chris Fregly
> Fix For: 1.1.0
>
>
> Add AWS Kinesis support to Spark Streaming.
> Initial discussion occured here: https://github.com/apache/spark/pull/223
> I discussed this with Parviz from AWS recently and we agreed that I would
> take this over.
> Look for a new PR that takes into account all the feedback from the earlier
> PR including spark-1.0-compliant implementation, AWS-license-aware build
> support, tests, comments, and style guide compliance.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
