Re: not getting output from socket connection

2014-07-13 Thread Walrus theCat
Hah, thanks for tidying up the paper trail here, but I was the OP (and solver) of the recent "reduce" thread that ended in this solution. On Sun, Jul 13, 2014 at 4:26 PM, Michael Campbell < michael.campb...@gmail.com> wrote: > Make sure you use "local[n]" (where n > 1) in your context setup too,

Re: not getting output from socket connection

2014-07-13 Thread Michael Campbell
Make sure you use "local[n]" (where n > 1) in your context setup too, (if you're running locally), or you won't get output. On Sat, Jul 12, 2014 at 11:36 PM, Walrus theCat wrote: > Thanks! > > I thought it would get "passed through" netcat, but given your email, I > was able to follow this tuto

Re: not getting output from socket connection

2014-07-12 Thread Walrus theCat
Thanks! I thought it would get "passed through" netcat, but given your email, I was able to follow this tutorial and get it to work: http://docs.oracle.com/javase/tutorial/networking/sockets/clientServer.html On Fri, Jul 11, 2014 at 1:31 PM, Sean Owen wrote: > netcat is listening for a conn

Re: not getting output from socket connection

2014-07-11 Thread Sean Owen
netcat is listening for a connection on port . It is echoing what you type to its console to anything that connects to and reads. That is what Spark streaming does. If you yourself connect to and write, nothing happens except that netcat echoes it. This does not cause Spark to someho

Re: not getting output from socket connection

2014-07-11 Thread Walrus theCat
I forgot to add that I get the same behavior if I tail -f | nc localhost on a log file. On Fri, Jul 11, 2014 at 1:25 PM, Walrus theCat wrote: > Hi, > > I have a java application that is outputting a string every second. I'm > running the wordcount example that comes with Spark 1.0, and ru

not getting output from socket connection

2014-07-11 Thread Walrus theCat
Hi, I have a java application that is outputting a string every second. I'm running the wordcount example that comes with Spark 1.0, and running nc -lk . When I type words into the terminal running netcat, I get counts. However, when I write the String onto a socket on port , I don't get