On Sat, 25 Mar 2017 12:33:57 +0000 Andrew Williams <[email protected]> said:
> Hi, > > I didn't mean that mirroring is an issue I mean that it might help us to > deal with the times when the server is offline etc. thats what i meant... mirroring isn't going to help. phab puts almost all its data in a database... how will you handle reconciling db changes across both mirrors then? as well as non-db content... especially if it's not already designed for it. backups are another matter though... :) > Getting the latest from Git may not be required to be able to work on bug > fixing but accessing the bug data in phab and documentation attached etc is > pretty handy. What I was meaning is can we mirror this data so we don't > have a large single point of failure. this wasn't a server failure. it was a mis-managed upgrade (upgrade steps skipped). any mirror would then suffer from the same issue as it'd mirror the upgrade :) > Additionally is it possible to move off a single huge host that contains > all VMs? Currently an outage slowly spreads across the whole infrastructure > - but if we spilt across even just 2 hosts then we would have half the > impact in a down time. we had 2 hosts for like 10 years. we only used 1. it's all nice in theory... but it was stable. but we didn't use ANY vm's. setup was massively simpler than now. reality is there was some kernel/kvm bug i think and we hit it. :( having multiple machines means buying more and asking for more rack space... i don't think that's a good thing. even if we had 2 hosts. one goes down you still lose stuff - eg phab or www or git or something... and issue still is there. > Just some thoughts. I know that we rely heavily on generosity and time > donated by community members but perhaps we could better distribute things? in this case... test better after an upgrade. or perhaps find a way to trivially switch between versions. given the setup i dont think that is easy/simple... > Thanks, > Andy > > On Thu, 23 Mar 2017 at 00:20 Carsten Haitzler <[email protected]> wrote: > > > On Wed, 22 Mar 2017 21:38:10 +0000 Andrew Williams <[email protected]> > > said: > > > > > Hi, > > > > > > I kicked it again, it had been working for around 12 hours since last > > kick. > > > > > > Now the server is up but phab is broken. > > > > > > Honestly we have to at least mirror all this data as we now have > > > infrastructural issues blocking development blocking release... > > > > > > Anyone know if phab or php got upgraded in the last day or two? > > > > i suspect mirroring isn't the issue. it's some upgrade that is broken. it > > "looks like it works" until you poke a little deeper then it doesn't. > > > > > Andy > > > On Wed, 22 Mar 2017 at 11:05, <[email protected]> wrote: > > > > > > > Am sure this might be known, but I’ll mention anyway: > > > > > > > > 3 days now have had server issues intermittently, this morning (GMT) > > > > server is over capacity and unusable. > > > > > > > > Thanks > > > > > > > > Sent from Mail for Windows 10 > > > > > > > > > > > > > > ------------------------------------------------------------------------------ > > > > Check out the vibrant tech community on one of the world's most > > > > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > > > > _______________________________________________ > > > > enlightenment-devel mailing list > > > > [email protected] > > > > https://lists.sourceforge.net/lists/listinfo/enlightenment-devel > > > > > > > -- > > > http://andywilliams.me > > > http://ajwillia.ms > > > > > ------------------------------------------------------------------------------ > > > Check out the vibrant tech community on one of the world's most > > > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > > > _______________________________________________ > > > enlightenment-devel mailing list > > > [email protected] > > > https://lists.sourceforge.net/lists/listinfo/enlightenment-devel > > > > > > -- > > ------------- Codito, ergo sum - "I code, therefore I am" -------------- > > The Rasterman (Carsten Haitzler) [email protected] > > > > -- > http://andywilliams.me > http://ajwillia.ms -- ------------- Codito, ergo sum - "I code, therefore I am" -------------- The Rasterman (Carsten Haitzler) [email protected] ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot _______________________________________________ enlightenment-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/enlightenment-devel
