[ 
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057847#comment-14057847
 ] 

Chris Fregly commented on SPARK-1981:
-------------------------------------

hey guys-

i'm in the final phases of cleanup.  i refactored quite a bit of the original 
code to make things more testable - and easier to understand.  

oh, and i did, indeed, choose the optional-module route.  we'll address the 
additional complexity through documentation.  that's what i'm working on right 
now, actually.

hoping to submit the PR by tomorrow or this weekend at the very latest.  

the goal is to get this in to the 1.1 release which has a timeline outlined 
here:  https://cwiki.apache.org/confluence/display/SPARK/Wiki+Homepage 

thanks!

-chris

> Add AWS Kinesis streaming support
> ---------------------------------
>
>                 Key: SPARK-1981
>                 URL: https://issues.apache.org/jira/browse/SPARK-1981
>             Project: Spark
>          Issue Type: New Feature
>          Components: Streaming
>            Reporter: Chris Fregly
>            Assignee: Chris Fregly
>
> Add AWS Kinesis support to Spark Streaming.
> Initial discussion occured here:  https://github.com/apache/spark/pull/223
> I discussed this with Parviz from AWS recently and we agreed that I would 
> take this over.
> Look for a new PR that takes into account all the feedback from the earlier 
> PR including spark-1.0-compliant implementation, AWS-license-aware build 
> support, tests, comments, and style guide compliance.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to