Re: How to use Spark Streaming from an HTTP api?

2014-08-18 Thread Silvio Fiorito
You need to create a custom receiver that submits the HTTP requests then
deserializes the data and pushes it into the Streaming context.

See here for an example:
http://spark.apache.org/docs/latest/streaming-custom-receivers.html


On 8/18/14, 6:20 PM, "bumble123"  wrote:

>I want to send an HTTP request (specifically to OpenTSDB) to get data.
>I've
>been looking at the StreamingContext api and don't seem to see any methods
>that can connect to this. Has anyone tried connecting Spark Streaming to a
>server via HTTP requests before? How have you done it?
>
>
>
>--
>View this message in context:
>http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-Spark-Strea
>ming-from-an-HTTP-api-tp12330.html
>Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
>-
>To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>For additional commands, e-mail: user-h...@spark.apache.org
>


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



How to use Spark Streaming from an HTTP api?

2014-08-18 Thread bumble123
I want to send an HTTP request (specifically to OpenTSDB) to get data. I've
been looking at the StreamingContext api and don't seem to see any methods
that can connect to this. Has anyone tried connecting Spark Streaming to a
server via HTTP requests before? How have you done it?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-Spark-Streaming-from-an-HTTP-api-tp12330.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org