Hi !
I'm using hadoop-1.0.3 to run streaming jobs with map/reduce shell scripts
such as this
bin/hadoop jar ./contrib/streaming/hadoop-streaming-1.0.3.jar -input /input
-output /output/015 -mapper "streaming-map.sh" -reducer
"streaming-reduce.sh" -file /home/hadoop/streaming/streaming-map.sh -fil
nevermind. the problem has been fixed.
The problem was the trailing {control-v}{control-m} character on the first
line of #!/bin/bash
(which i blame my teammate for writing the script in windows notepad !!)
On Fri, Jan 4, 2013 at 8:09 PM, Ben Kim wrote:
> Hi !
>
> I'm using hadoop-1.0.3 to
org.apache.hadoop.tools.DistCp
Cheers,
Dave
On 4 January 2013 11:47, Kasi Subrahmanyam wrote:
> Hi Guys,
>
> The FsShell class has the code that runs behind for normal operations that
> we perform on HDFS.
> Which classs has the code for distscp?
>
This really should be on the user list so I am moving it over there.
It is probably something about the OS that is killing it. The only thing
that I know of on stock Linux that would do this is the Out of Memory
Killer. Do you have swap enabled on these boxes? You should check the
OOM killer lo
