Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-10 Thread Wu Wei
- I've been running into this error the past few days: java.io.IOException: Could not get block locations. Aborting... at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2143) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.access$1400(DFSClient.java:173

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread Scott Whitecross
you have a lot of open files, this problem happens a lot faster. -Bryan On Feb 9, 2009, at 1:01 PM, Scott Whitecross wrote: Hi all - I've been running into this error the past few days: java.io.IOException: Could not get block locations. Aborting... at org.apache.hadoop.dfs.DFSClient $D

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread Brian Bockelman
o this error the past few days: java.io.IOException: Could not get block locations. Aborting... at org.apache.hadoop.dfs.DFSClient $DFSOutputStream.processDatanodeError(DFSClient.java:2143) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.access $1400(DFSClient.java:1735) at org.apache.hadoop

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread jason hadoop
to solve our problems. I >>> think that if you have a lot of open files, this problem happens a lot >>> faster. >>> >>> -Bryan >>> >>> On Feb 9, 2009, at 1:01 PM, Scott Whitecross wrote: >>> >>> Hi all - >>>> &g

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread Bryan Duxbury
and that seems to solve our problems. I think that if you have a lot of open files, this problem happens a lot faster. -Bryan On Feb 9, 2009, at 1:01 PM, Scott Whitecross wrote: Hi all - I've been running into this error the past few days: java.io.IOException: Could not get block l

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread Scott Whitecross
PM, Scott Whitecross wrote: Hi all - I've been running into this error the past few days: java.io.IOException: Could not get block locations. Aborting... at org.apache.hadoop.dfs.DFSClient $DFSOutputStream.processDatanodeError(DFSClient.java:2143) at org.apache.hadoo

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread Bryan Duxbury
t seems to solve our problems. I think that if you have a lot of open files, this problem happens a lot faster. -Bryan On Feb 9, 2009, at 1:01 PM, Scott Whitecross wrote: Hi all - I've been running into this error the past few days: java.io.IOException: Could not get block locations.

Re: java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread jason hadoop
-vs-linux-performance.html On Mon, Feb 9, 2009 at 1:01 PM, Scott Whitecross wrote: > Hi all - > > I've been running into this error the past few days: > java.io.IOException: Could not get block locations. Aborting... >at > org.apac

java.io.IOException: Could not get block locations. Aborting...

2009-02-09 Thread Scott Whitecross
Hi all - I've been running into this error the past few days: java.io.IOException: Could not get block locations. Aborting... at org.apache.hadoop.dfs.DFSClient $DFSOutputStream.processDatanodeError(DFSClient.java:2143) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.access

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-12 Thread lohit
ointing (by looking at secondary namenode logs). Thanks, Lohit - Original Message From: Piotr Kozikowski <[EMAIL PROTECTED]> To: core-user@hadoop.apache.org Sent: Monday, August 11, 2008 12:20:05 PM Subject: Re: java.io.IOException: Could not get block locations. Aborting...

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-11 Thread Piotr Kozikowski
i wrote: > >> > >>> Hi there: > >>> > >>> We would like to know what are the most likely causes of this sort of > >>> error: > >>> > >>> Exception closing > >>> file > >>>

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-11 Thread Steve Loughran
Koji Noguchi wrote: If restarting the entire dfs helped, then you might be hitting http://issues.apache.org/jira/browse/HADOOP-3633 When we were running 0.17.1, I had to grep for OutOfMemory on the datanode ".out" files at least everyday and restart those zombie datanodes. Once datanode gets t

RE: java.io.IOException: Could not get block locations. Aborting...

2008-08-08 Thread Koji Noguchi
:42 PM To: core-user@hadoop.apache.org Subject: Re: java.io.IOException: Could not get block locations. Aborting... Thank you for the reply. Apparently whatever it was is now gone after a hadoop restart, but I'll keep that in mind should it happen again. Piotr On Fri, 2008-08-08 at 17:31 -0700, Dhruba

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-08 Thread Piotr Kozikowski
gt; >>> We would like to know what are the most likely causes of this sort of > >>> error: > >>> > >>> Exception closing > >>> file > >>> /data1/hdfs/tmp/person_url_pipe_59984_3405334/_temporary/_task_200807311534_0055_m_

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-08 Thread Dhruba Borthakur
;> We would like to know what are the most likely causes of this sort of >>> error: >>> >>> Exception closing >>> file >>> /data1/hdfs/tmp/person_url_pipe_59984_3405334/_temporary/_task_200807311534_0055_m_22_0/part-00022 >>> java.io.IOE

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-08 Thread Alexander Aristov
auses of this sort of >> error: >> >> Exception closing >> file >> /data1/hdfs/tmp/person_url_pipe_59984_3405334/_temporary/_task_200807311534_0055_m_000022_0/part-00022 >> java.io.IOException: Could not get block locations. Aborting... >>at

Re: java.io.IOException: Could not get block locations. Aborting...

2008-08-08 Thread Steve Loughran
Piotr Kozikowski wrote: Hi there: We would like to know what are the most likely causes of this sort of error: Exception closing file /data1/hdfs/tmp/person_url_pipe_59984_3405334/_temporary/_task_200807311534_0055_m_22_0/part-00022 java.io.IOException: Could not get block locations

java.io.IOException: Could not get block locations. Aborting...

2008-08-07 Thread Piotr Kozikowski
Hi there: We would like to know what are the most likely causes of this sort of error: Exception closing file /data1/hdfs/tmp/person_url_pipe_59984_3405334/_temporary/_task_200807311534_0055_m_22_0/part-00022 java.io.IOException: Could not get block locations. Aborting... at