Hypervisor host back up. Doing back-ups in case we lose it again, then will restart our CI services. ETA is 1 to 2 hours.
> On Jan 21, 2016, at 9:12 AM, Karl Klashinsky <[email protected]> wrote: > > ... and it's down again. > > Right now we cannot access the hypervisor host, so we have no clear picture > of what is wrong or how bad it is. We will update when we have more info. > >> On Jan 20, 2016, at 7:42 PM, Karl Klashinsky <[email protected]> wrote: >> >> Our CI is up, review.opencontrail.org is now accepting review submissions >> etc. >> >> >>> On Jan 20, 2016, at 12:38 PM, Karl Klashinsky <[email protected]> wrote: >>> >>> Re-imaging is done. Restore of backup images to re-imaged hypervisor is in >>> progress, >>> and will take about four hours. >>> >>> We should have our CI environment completely online by about 6pm PST. >>> >>>> On Jan 19, 2016, at 7:43 PM, Karl Klashinsky <[email protected]> wrote: >>>> >>>> We are currently backup the servers so that we can re-image the hypervisor >>>> that >>>> hosts the servers. The backup will take several hours. Then re-image. Then >>>> restore >>>> the backups to the re-imaged hypervisor. >>>> >>>> Next update will likely be early Wed (SVL time). >>>> >>>>> On Jan 19, 2016, at 6:07 PM, Karl Klashinsky <[email protected]> wrote: >>>>> >>>>> We are having issues bringing our *.opencontrail.org servers back online. >>>>> Thus, >>>>> review.opencontrail.org is not available for submitting and/or updating >>>>> reviews. >>>>> >>>>> Likewise, jenkins, and zuul are not accessible. >>>>> >>>>> Needless to say, this is our #1 priority right now. We will send out >>>>> updates when available. >>>>> >>>>> >>>>> >>>>>> On Jan 18, 2016, at 5:14 PM, Karl Klashinsky <[email protected]> wrote: >>>>>> >>>>>> Have had some ssh/connectivity issues earlier today, so to make sure >>>>>> everything is working, I will be taking the CI cluster offline for >>>>>> about an hour so that I can reboot jenkins, zuul, etc. >>>>>> >>>>>> I will send an update when done. >>>>>> >>>>>> -- >>>>>> Klash >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Dev mailing list >>>>>> [email protected] >>>>>> http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org >>>>> >>>>> -- >>>>> Klash >>>>> >>>>> >>>>> _______________________________________________ >>>>> Dev mailing list >>>>> [email protected] >>>>> http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org >>>> >>>> -- >>>> Klash >>>> >>>> >>>> _______________________________________________ >>>> Dev mailing list >>>> [email protected] >>>> http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org >>> >>> -- >>> Klash >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> [email protected] >>> http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org >> >> -- >> Klash >> >> >> _______________________________________________ >> Dev mailing list >> [email protected] >> http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org > > -- > Klash > > > _______________________________________________ > Dev mailing list > [email protected] > http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org -- Klash _______________________________________________ Dev mailing list [email protected] http://lists.opencontrail.org/mailman/listinfo/dev_lists.opencontrail.org
