Re: Spark Streaming reads from stdin or output from command line utility

2015-06-12 Thread Tathagata Das
! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-reads-from-stdin-or-output-from-command-line-utility-tp23289.html https://urldefense.proofpoint.com/v1/url?u=http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-reads-from-stdin

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-12 Thread Heath Guo
@spark.apache.orgmailto:user@spark.apache.org Subject: Re: Spark Streaming reads from stdin or output from command line utility Is it a lot of data that is expected to come through stdin? I mean is it even worth parallelizing the computation using something like Spark Streaming? On Thu, Jun 11, 2015 at 9:56

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-12 Thread Gerard Maas
...@databricks.com Date: Thursday, June 11, 2015 at 11:43 PM To: Heath Guo heath...@fb.com Cc: user user@spark.apache.org Subject: Re: Spark Streaming reads from stdin or output from command line utility Is it a lot of data that is expected to come through stdin? I mean is it even worth

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread Heath Guo
To: Heath Guo heath...@fb.commailto:heath...@fb.com Cc: user user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: Spark Streaming reads from stdin or output from command line utility Are you going to receive data from one stdin from one machine, or many stdins on many machines? On Thu, Jun

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread Tathagata Das
://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-reads-from-stdin-or-output-from-command-line-utility-tp23289.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread foobar
, but it seems that requires an rdd in the first place, which does not apply. Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-reads-from-stdin-or-output-from-command-line-utility-tp23289.html Sent from the Apache Spark User List mailing