[libreoffice-website] Re: Crashtest VM Host

2015-01-09 Thread Michael Meeks
Hi Alex,

On Wed, 2015-01-07 at 12:23 +0100, Alexander Werner wrote:
 the crashtest VM host has arrived.

Great news.

  At the moment the setup is delayed as we ran into a problem with glusterfs:
...
 This shows up during manual gluster setup as well as automatic setup by oVirt.
 I will try to handle this by the end of next week, if that is not
 successful I will fallback to local storage which has some
 disadvantages as the host is then not able to increase the HA of the
 overall platform.

JFYI - all of the work we do inside the main VM is throw-away work - we
only are interested in the output of it. Worse - there are tens of GB of
it generated all the time - so mirroring that across a cluster sounds
like it would bring only pain  aggravation =)

Is there some way we can have the basic VM / OS image on a HA /
mirrored image - but ensure that the scratch data we build, and throw
away repeatedly in really huge bulk doesn't end up just screwing up the
cluster performance ;-) ie. for now local storage sounds just fine to
me ;-)

Thanks !

Michael.

-- 
 michael.me...@collabora.com  , Pseudo Engineer, itinerant idiot


-- 
To unsubscribe e-mail to: website+unsubscr...@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/website/
All messages sent to this list will be publicly archived and cannot be deleted


[libreoffice-website] Re: Crashtest VM Host

2015-01-09 Thread Alexander Werner
Hi,


Am 09.01.2015 um 18:46 schrieb Markus Mohrhard markus.mohrh...@googlemail.com:

 JFYI - all of the work we do inside the main VM is throw-away work - 
 we
 only are interested in the output of it. Worse - there are tens of GB of
 it generated all the time - so mirroring that across a cluster sounds
 like it would bring only pain  aggravation =)
 
 Is there some way we can have the basic VM / OS image on a HA /
 mirrored image - but ensure that the scratch data we build, and throw
 away repeatedly in really huge bulk doesn't end up just screwing up the
 cluster performance ;-) ie. for now local storage sounds just fine to
 me ;-)

for the crashtesting itself nothing else than local storage was ever 
considered. But i want to add the host to the same cluster to have 3 hosts in 
the cluster, so that we can enable server-quorum with gluster to avoid 
split-brain situations. So: Store Crashtest VMs in local storage, but also 
increase the stability of the whole platform. Even VMs with multiple HDDs with 
some with HA and some without can be built. 

Alex

--
Alexander Werner a...@documentfoundation.org
Admin Team of The Document Foundation
The Document Foundation, Kurfürstendamm 188, 10707 Berlin
Rechtsfähige Stiftung des bürgerlichen Rechts
Legal details: http://www.documentfoundation.org/imprint






-- 
To unsubscribe e-mail to: website+unsubscr...@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/website/
All messages sent to this list will be publicly archived and cannot be deleted



[libreoffice-website] Re: Crashtest VM Host

2015-01-09 Thread Michael Meeks

On Fri, 2015-01-09 at 18:51 +0100, Alexander Werner wrote:
 for the crashtesting itself nothing else than local storage was ever
 considered. But i want to add the host to the same cluster to have 3
 hosts in the cluster, so that we can enable server-quorum with gluster
 to avoid split-brain situations.

Fair enough.

  So: Store Crashtest VMs in local storage, but also increase the
 stability of the whole platform. Even VMs with multiple HDDs with some
 with HA and some without can be built. 

Great; thanks !

Michael.

-- 
 michael.me...@collabora.com  , Pseudo Engineer, itinerant idiot


-- 
To unsubscribe e-mail to: website+unsubscr...@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/website/
All messages sent to this list will be publicly archived and cannot be deleted


[libreoffice-website] Re: Crashtest VM Host

2015-01-09 Thread Markus Mohrhard
Hey,

On Fri, Jan 9, 2015 at 5:32 PM, Michael Meeks michael.me...@collabora.com
wrote:

 Hi Alex,

 On Wed, 2015-01-07 at 12:23 +0100, Alexander Werner wrote:
  the crashtest VM host has arrived.

 Great news.

   At the moment the setup is delayed as we ran into a problem with
 glusterfs:
 ...
  This shows up during manual gluster setup as well as automatic setup by
 oVirt.
  I will try to handle this by the end of next week, if that is not
  successful I will fallback to local storage which has some
  disadvantages as the host is then not able to increase the HA of the
  overall platform.

 JFYI - all of the work we do inside the main VM is throw-away work
 - we
 only are interested in the output of it. Worse - there are tens of GB of
 it generated all the time - so mirroring that across a cluster sounds
 like it would bring only pain  aggravation =)

 Is there some way we can have the basic VM / OS image on a HA /
 mirrored image - but ensure that the scratch data we build, and throw
 away repeatedly in really huge bulk doesn't end up just screwing up the
 cluster performance ;-) ie. for now local storage sounds just fine to
 me ;-)


And to add to that. Actually the whole VM does not need a backup. The
scripts are all in dev-tools and the files are either stored on gimli (the
ones that need backup) or can be downloaded by a script. As Michael
mentioned there are many generated files in the VM and we are generating
each day around 120 GB of data that is deleted after the run.

The whole Vm consists currently of:

* source code for different projects
* test files (backup exists either as part of various bug trackers or on
gimli)
* the logs (the official and public version is on gimli)
* some stuff for msan and asan builds
* the sripts (are all from the dev-tools repo)

So there is nothing that needs a backup as part of the VM.

Regards,
Markus

-- 
To unsubscribe e-mail to: website+unsubscr...@global.libreoffice.org
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://listarchives.libreoffice.org/global/website/
All messages sent to this list will be publicly archived and cannot be deleted