RDD pipe example. Is this a bug or a feature?

2014-09-19 Thread Andy Davidson
Hi I am wrote a little java job to try and figure out how RDD pipe works. Bellow is my test shell script. If in the script I turn on debugging I get output. In my console. If debugging is turned off in the shell script, I do not see anything in my console. Is this a bug or feature? I am running

Re: RDD pipe example. Is this a bug or a feature?

2014-09-19 Thread Sean Owen
What is in 'rdd' here, to double check? Do you mean the spark shell when you say console? At the end you're grepping output from some redirected output but where is that from? On Sep 19, 2014 7:21 PM, Andy Davidson a...@santacruzintegration.com wrote: Hi I am wrote a little java job to try and