holdenk commented on SPARK-16407:

The current sink interface output depends on DataFrames - although because of 
limitations doing transformations on them requires converting to RDDs - but if 
you directly go to an action I don't think it depends on RDDs. This does seem a 
little tangential to allowing the user to supply the sink in user friendly 
manner, but improving both are important.

> Allow users to supply custom StreamSinkProviders
> ------------------------------------------------
>                 Key: SPARK-16407
>                 URL: https://issues.apache.org/jira/browse/SPARK-16407
>             Project: Spark
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: holdenk
> The current DataStreamWriter allows users to specify a class name as format, 
> however it could be easier for people to directly pass in a specific provider 
> instance - e.g. for user equivalent of ForeachSink or other sink with 
> non-string parameters.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to