Re: [Savannah-hackers-public] Savannah down for several hours December 18

2010-12-19 Thread peabo
 On Sat, Dec 18, 2010 at 11:43:13AM -0500, pe...@fsf.org wrote:
 The Xen host running the Savannah virtual machines failed this morning
 due
 to a RAID array failure.  We have removed the bad drive from the array
 and
 rebooted the machine.  The Savannah virtual machines are now back up,
 with
 one RAID array still resynchronizing.

 Thanks!

 Btw, any ETA for replacing the disks?

 --
 Sylvain


We removed the suspect disk from the arrays, but it crashed again with the
same symptoms (I/O related hung kernel tasks).  We are concerned that it
is a controller/motherboard problem.  I'm waiting on some email from Ward
to see what he thinks before issuing a definite plan.

One complication is that vcs-noshell's root filesystem is on a raid array
which is undergoing resynchronization.  It didn't finish in the interval
between the second crash and the third crash today and has started over.

peabo





Re: [Savannah-hackers-public] Savannah down for several hours December 18

2010-12-19 Thread peabo
The resynchronization of /dev/md3 is complete, so you can restart the VMs
now.

Peter Olson
FSF Senior Systems Administrator






[Savannah-hackers-public] Savannah down for several hours December 18

2010-12-18 Thread peabo
The Xen host running the Savannah virtual machines failed this morning due
to a RAID array failure.  We have removed the bad drive from the array and
rebooted the machine.  The Savannah virtual machines are now back up, with
one RAID array still resynchronizing.

Peter Olson
FSF Senior Systems Administrator





Re: [Savannah-hackers-public] Savannah down for several hours December 18

2010-12-18 Thread Sylvain Beucler
On Sat, Dec 18, 2010 at 11:43:13AM -0500, pe...@fsf.org wrote:
 The Xen host running the Savannah virtual machines failed this morning due
 to a RAID array failure.  We have removed the bad drive from the array and
 rebooted the machine.  The Savannah virtual machines are now back up, with
 one RAID array still resynchronizing.

Thanks!

Btw, any ETA for replacing the disks?

-- 
Sylvain