Re: Ceph as an alternative to HDFS

2010-08-07 Thread tsuna
On Fri, Aug 6, 2010 at 1:24 AM, Amandeep Khurana ama...@gmail.com wrote: Article published in this months Usenix Login magazine: http://www.usenix.org/publications/login/2010-08/openpdfs/maltzahn.pdf That sounds very promising. Hopefully Ceph will become production ready soon and we'll

Re: GC [ParNew...] took 299 secs causing region server to die

2010-08-07 Thread Steve Kuo
We never did pinpoint the underlying causes but we found a way to resolve this issue -- by upgrading ubuntu from 9.04 to 9.10. The surmise from our SysAdmin was that there was some incompatibility between the new hardware and the old drivers. So it's most definitely out with the old and in with

DFSClient: DataStreamer Exception: java.io.IOException: Broken pipe

2010-08-07 Thread Steve Kuo
I am running a MR import job to hbase and one out of 8 RS' died with the following errors in regionserver and datanode logs. Googling returned a discussion that indicates setting dfs.datandoe.socket.write.timeout=0 may help the situation. Please give me some insight on what this problem is about