Ok, a short grep in the sources suggests that the exceptions happen just
in the closeAll method of FileSystem. So no indication what hadoop is
working on :(


Am Montag, den 14.04.2008, 07:26 +0200 schrieb Andreas Kostyrka: 
> Hi!
> 
> I'm getting the following hang, when trying to run a streaming command:
> 
> [EMAIL PROTECTED]:~/hadoop-0.16.2$ time bin/hadoop jar 
> contrib/streaming/hadoop-0.16.2-streaming.jar -mapper '/home/hadoop/bin/llfp 
> -f [EMAIL PROTECTED] -t [EMAIL PROTECTED] -s heaven.kostyrka.org -d 
> gen_dailysites -d fb_memberfind ' -reducer NONE -input run-0003-input/* 
> -output run-0003-output
> additionalConfSpec_:null
> null=@@@userJobConfProps_.get(stream.shipped.hadoopstreaming
> packageJobJar: [/tmp/hadoop-hadoop/hadoop-unjar60050/] [] 
> /tmp/streamjob60051.jar tmpDir=null
> 08/04/14 05:22:10 INFO fs.FileSystem: FileSystem.closeAll() threw an 
> exception:
> org.apache.hadoop.io.MultipleIOException: 2 exceptions [java.io.IOException: 
> S3FileSystem([EMAIL PROTECTED]) and Key([EMAIL PROTECTED]://lokgad) do not 
> match., java.io.IOException: LocalFileSystem([EMAIL PROTECTED]) and 
> Key([EMAIL PROTECTED]://null) do not match.]
> 
> 
> The exception happens only when I press Control-C after many minutes.
> 
> The cluster uses an HDFS/S3 filesystem, and concurrently to this I'm
> issueing many many "relative small" hadoop fs -put requests, copying in
> data to a different folder.
> 
> The above hang happened multiple times, so I wonder what could it be?
> 
> Andreas

Attachment: signature.asc
Description: Dies ist ein digital signierter Nachrichtenteil

Reply via email to