Re: Spark Streaming input data source list

2015-03-09 Thread Tathagata Das
et data from RDBMs, for the details you can > refer to the docs. > > > > Thanks > > Jerry > > > > *From:* Cui Lin [mailto:cui@hds.com] > *Sent:* Tuesday, March 10, 2015 8:36 AM > *To:* Tathagata Das > *Cc:* user@spark.apache.org > *Subject

RE: Spark Streaming input data source list

2015-03-09 Thread Shao, Saisai
user@spark.apache.org Subject: Re: Spark Streaming input data source list Tathagata, Thanks for your quick response. The link is helpful to me. Do you know any API for streaming data from RMDB ? Best regards, Cui Lin From: Tathagata Das mailto:t...@databricks.com>> Date: Monday, March 9,

Re: Spark Streaming input data source list

2015-03-09 Thread Cui Lin
t; Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: Re: Spark Streaming input data source list Spark Streaming has StreamingContext.socketStream() http://spark.apache.org/docs/1.2.1/api/java/org/apache/spark/streaming/StreamingContext.html#s

Re: Spark Streaming input data source list

2015-03-09 Thread Tathagata Das
Spark Streaming has StreamingContext.socketStream() http://spark.apache.org/docs/1.2.1/api/java/org/apache/spark/streaming/StreamingContext.html#socketStream(java.lang.String, int, scala.Function1, org.apache.spark.storage.StorageLevel, scala.reflect.ClassTag) TD On Mon, Mar 9, 2015 at 11:37 AM,

Spark Streaming input data source list

2015-03-09 Thread Cui Lin
Dear all, Could you send me a list for input data source that spark streaming could support? My list is HDFS, Kafka, textfile?… I am wondering if spark streaming could directly read data from certain port (443 e.g.) that my devices directly send to? Best regards, Cui Lin