Re: [ovirt-users] hosted engine deploy failed 3.5 centos 6.5 host FC20 vm

2014-11-01 Thread Alastair Neil
No need turned out to be pebkac,  I had been using my domain account for so
long I had the wrong admin account thus the hosted-engine failed to
authenticate I have resolved the issue.


On Fri Oct 31 2014 at 4:35:27 AM Jiri Moskovcak  wrote:

> Hi Alastair,
> I need the engine.log to debug it, because the actual problem is logged
> there.
>
> Thanks,
> Jirka
>
> On 10/29/2014 08:58 PM, Alastair Neil wrote:
> > OK I seem to be having some fundamental confusion about this migration.
> >
> >
> > I have an existing ovirt 3.5 (upgraded from 3.4) setup with  a Data
> > Center containing four clusters, 3 VM clusters for 3 differenc classes
> > of CPU hosts (Penryn, Nehalem, and SandyBridge).  I also have a  gluster
> > storage cluster.
> >
> > There are 4 storage domains, an Export domain (Export-Dom1) nfs v1, and
> > ISO domain (Gluster-ISOs) posix FS v1, a Data domain (Gluster Data)
> > GlusterFS V3, and a Data (Master) (Gluster-VM-Store) GlusterFS v3.
> >
> > As Gluster replica 2 is not considered adequate for the hosted-engine
> > storage I created a volume in the gluster store and exported it as NFS.
> > This is what I planned to use as the storage pool for the hosted
> > engine.  So far so good.
> >
> > I have tried the deployment several times now,  and it fails with the
> > following:
> >
> > [ ERROR ] Cannot automatically add the host to cluster None: HTTP
> > Status 401
> > [ ERROR ] Failed to execute stage 'Closing up': Cannot add the host
> > to cluster None
> >
> >
> > 2014-10-29 15:26:11 DEBUG
> > otopi.plugins.ovirt_hosted_engine_setup.engine.add_host
> > add_host._closeup:502 Cannot add the host to cluster None
> > Traceback (most recent call last):
> >File
> > "/usr/share/ovirt-hosted-engine-setup/scripts/../
> plugins/ovirt-hosted-engine-setup/engine/add_host.py",
> > line 426, in _closeup
> >  ca_file=self.cert,
> >File "/usr/lib/python2.6/site-packages/ovirtsdk/api.py", line
> > 154, in __init__
> >  url=''
> >File
> > "/usr/lib/python2.6/site-packages/ovirtsdk/infrastructure/proxy.py",
> > line 118, in request
> >  persistent_auth=self._persistent_auth)
> >File
> > "/usr/lib/python2.6/site-packages/ovirtsdk/infrastructure/proxy.py",
> > line 146, in __doRequest
> >  persistent_auth=persistent_auth
> >File
> > "/usr/lib/python2.6/site-packages/ovirtsdk/web/connection.py", line
> > 134, in doRequest
> >  raise RequestError, response
> > RequestError:
> > status: 401
> > reason: Unauthorized
> > detail: HTTP Status 401
> > 2014-10-29 15:26:11 ERROR
> > otopi.plugins.ovirt_hosted_engine_setup.engine.add_host
> > add_host._closeup:510 Cannot automatically add the host to
> > cluster None:
> > HTTP Status 401
> > 2014-10-29 15:26:11 DEBUG otopi.context context._executeMethod:152
> > method exception
> > Traceback (most recent call last):
> >File "/usr/lib/python2.6/site-packages/otopi/context.py", line
> > 142, in _executeMethod
> >  method['method']()
> >File
> > "/usr/share/ovirt-hosted-engine-setup/scripts/../
> plugins/ovirt-hosted-engine-setup/engine/add_host.py",
> > line 517, in _closeup
> >  cluster=cluster_name,
> > RuntimeError: Cannot add the host to cluster None
> >
> >
> >
> > The hosted-engine host cluster name it seems is set to "None", and then
> > fails to add the host as there is no cluster "None" in the restored
> > engine.  Presumably the storage domain would need to be added too,
> > however I don't ever seem to see any message about this
> >
> > I recall being prompted for a data-center name and even a storage-domain
> > name, but not a cluster name, so am I missing a step.  I could use some
> > guidance as I am stumped.  Is there some pre-migration tasks I am
> > failing to do in the original engine?
> >
> >
> >
> > .
> >
> > On 29 October 2014 03:10, Jiri Moskovcak  > > wrote:
> >
> > On 10/27/2014 06:22 PM, Alastair Neil wrote:
> >
> > After belatedly realising that no engine for EL7 is planned for
> > 3.5 I
> > tried using FC20:
> >
> > I used a database called engine with user engine on the VM to
> > restore to.
> > The engine-backup restore appeared to complete with no errors
> > save the
> > canonical complaint about less that 16GB of memory being
> available.
> > However on completion the host the hosted-engine-deploy threw
> > this error:
> >
> >  Failed to execute stage 'Closing up': The host name
> >  "ovirt-admin-hosted.x.xxx.__edu
> > 
> >   > >" contained in the URL
> >
> >  doesn't match any of the names in the server cert

Re: [ovirt-users] Snapshot deletion gone horribly wrong - Urgent

2014-11-01 Thread Stefan Wendler
After exporting some unused VMs and deleting other snapshots afterwards
I'm back to 500GB. But the partially deleted 1TB Snapshot is still there
and needs to be cleaned up.

Is there a clean way to "cleanup" partially deleted/migrated snapshots
without loosing more disk space? What I don't understand is what is
there to migrate, if it is the last snapshot anyway? Shouldn't the
"Actual VM"-disks be in a consistent state with or without the
snapshots? Or asked another way ... are there documents with an in-depth
description on how snapshots work in oVirt?

Cheers,
Stefan

On 11/01/14 17:56, Stefan Wendler wrote:
> Hi,
> 
> I'm trying to delete a 1TB snapshot on a store with 1.5TB free space.
> should be more than enough and the engine didn't complain.
> The snapshot to delete is the only snapshot for this VM.
> 
> I started snapshot deletion a couple of hours ago. ovirt then started
> filling up the store. I'm sure it happened because of the snapshot
> deletion. I have seen this many times when deleting snapshots.
> Now I have a couple of KBytes left on the store and the snapshot is
> marked as broken. And I cannot delete the snapshot because of not enough
> free space. Is there a way to alter the database and then delete the
> snapshot files by hand?
> 
> I know the files that are the snapshots and could delete them but then
> the vm wouldn't start because it is missing the files.
> 
> Cheers,
> Stefan
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
> 



signature.asc
Description: OpenPGP digital signature
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


[ovirt-users] Snapshot deletion gone horribly wrong - Urgent

2014-11-01 Thread Stefan Wendler
Hi,

I'm trying to delete a 1TB snapshot on a store with 1.5TB free space.
should be more than enough and the engine didn't complain.
The snapshot to delete is the only snapshot for this VM.

I started snapshot deletion a couple of hours ago. ovirt then started
filling up the store. I'm sure it happened because of the snapshot
deletion. I have seen this many times when deleting snapshots.
Now I have a couple of KBytes left on the store and the snapshot is
marked as broken. And I cannot delete the snapshot because of not enough
free space. Is there a way to alter the database and then delete the
snapshot files by hand?

I know the files that are the snapshots and could delete them but then
the vm wouldn't start because it is missing the files.

Cheers,
Stefan
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Hosted-Engine HA problem

2014-11-01 Thread Niels de Vos
On Thu, Oct 30, 2014 at 09:07:24PM +0530, Vijay Bellur wrote:
> On 10/30/2014 06:45 PM, Jiri Moskovcak wrote:
> >On 10/30/2014 09:22 AM, Jaicel R. Sabonsolin wrote:
> >>Hi Guys,
> >>
> >>I need help with my ovirt Hosted-Engine HA setup. I am running on 2
> >>ovirt hosts and 2 gluster nodes with replicated volumes. i already have
> >>VMs running on my hosts and they can migrate normally once i for example
> >>power off the host that they are running on. the problem is that the
> >>engine can't migrate once i switch off the host that hosts the engine.
> >>
> >>oVirt3.4.3-1.el6
> >>KVM 0.12.1.2 - 2.415.el6_5.10
> >>LIBVIRT   libvirt-0.10.2-29.el6_5.9
> >>VDSM  vdsm-4.14.17-0.el6
> >>
> >>
> >>right now, i have this result from hosted-engine --vm-status.
> >>
> >>   File "/usr/lib64/python2.6/runpy.py", line 122, in
> >>_run_module_as_main
> >> "__main__", fname, loader, pkg_name)
> >>   File "/usr/lib64/python2.6/runpy.py", line 34, in _run_code
> >> exec code in run_globals
> >>   File
> >>
> >>"/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py",
> >>
> >>line 111, in 
> >> if not status_checker.print_status():
> >>   File
> >>
> >>"/usr/lib/python2.6/site-packages/ovirt_hosted_engine_setup/vm_status.py",
> >>
> >>line 58, in print_status
> >> all_host_stats = ha_cli.get_all_host_stats()
> >>   File
> >>
> >>"/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py",
> >>
> >>line 137, in get_all_host_stats
> >> return self.get_all_stats(self.StatModes.HOST)
> >>   File
> >>
> >>"/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py",
> >>
> >>line 86, in get_all_stats
> >> constants.SERVICE_TYPE)
> >>   File
> >>
> >>"/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
> >>
> >>line 171, in get_stats_from_storage
> >> result = self._checked_communicate(request)
> >>   File
> >>
> >>"/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
> >>
> >>line 199, in _checked_communicate
> >> .format(message or response))
> >>ovirt_hosted_engine_ha.lib.exceptions.RequestError: Request failed:
> >>
> >>
> >>
> >>restarting ha-broker and ha-agent normalizes the status but eventually
> >>it would become "false" and then return to the result above. hope you
> >>guys could help me with this.
> >>
> >
> >Hi Jaicel,
> >please attach agent.log and broker.log from the host where you trying to
> >run hosted-engine --vm-status. I have a feeling that you ran into a
> >known problem on gluster - stalled file descriptor, in that case the
> >only known solution at this time is to restart the broker & agent as you
> >have already found out.
> >
> 
> Adding Niels and gluster-devel to troubleshoot from Gluster NFS perspective.

I'd welcome any details on this "stalled file descriptor" problem. Is
there a bug filed with some details like logs, sysrq-t and maybe even
tcpdumps? If there is an easy way to reproduce this behaviour, I can
surely look into it and hopefully come up with some advise or fix.

Thanks,
Niels
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


[ovirt-users] Ovirt Node migration

2014-11-01 Thread Juan Carlos YJ. Lin
I like to know if a node adopted by a ovirt engine can safely adopted by a new 
ovirt engine, keeping all running vms in local storage mode, ovirt node 3.4, 
new ovirt engine 3.5 
Thanks 

Juan Carlos Lin 
Unisoft S.A. 
+595-993-288330 


---
"Antes de imprimir, recuérdese de su compromiso con el Medio Ambiente"
"Aviso: Este mensaje es dirigido para su destinatario y contiene informaciones 
que no pueden ser usadas por otras personas que no sean su(s) destinatario(s). 
La retransmisión del contenido no está autorizada fuera del contexto de su 
envío y a quien corresponde. El uso no autorizado de la información en este 
mensaje se halla penado por las leyes vigentes en todo el mundo. Si ha recibido 
este mensaje por error, por favor bórrala y notifique al remitente en la 
brevedad posible. El contenido de este mensaje no es responsabilidad de la 
Empresa y debe ser atribuido siempre a su autor. Gracias."
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] webhook

2014-11-01 Thread Koen Vanoppen
Whoow, just missed a couple of days I see... thanks everybody for your
already given support!! I will discuss this also with my colleague on
Monday. And I must say I'm impressed about all the fedback! This could be
indeed a very nice extension to oVirt, because I guess we are not the only
ones who are in need of this or will be in the future.
Thanks again!

2014-10-31 22:51 GMT+01:00 Yair Zaslavsky :

>
>
> - Original Message -
> > From: "Einav Cohen" 
> > To: "Vojtech Szocs" 
> > Cc: "Oved Ourfali" , users@ovirt.org
> > Sent: Friday, October 31, 2014 9:01:34 PM
> > Subject: Re: [ovirt-users] webhook
> >
> > > - Original Message -
> > > From: "Vojtech Szocs" 
> > > Sent: Friday, October 31, 2014 11:51:53 AM
> > >
> > > Hi,
> > >
> > > if I get this correctly, you'd like to be notified when certain event
> > > happens (VM created/deleted/etc.) and react upon that. I see multiple
> > > possible approaches here:
> > >
> > > 0, improve Engine extension API (refer to Alon Bar-Lev for details)
> > >- if extensions can be packaged as JARs and these JARs could include
> > >  web fragments [1] it would mean the possibility to deploy custom
> > >  servlets onto existing Engine instance (in context of webapp that
> > >  processes extensions)
> > >- your custom Java servlet could query REST interface (or be
> notified
> > >  once something happens, but AFAIK we don't have that implemented
> yet)
> > >  and do whatever logic is needed
> > >- once I asked Alon about ^^ but never got response from him
> > >- IMHO this would be a nice way to deploy custom Java code on Engine
>
> Please allow me to step in as someone who worked on the extensions API as
> well,
> There are more "missing bits" here.
> You are referring to the "webapp side", but this is not enough.
> We have also the engine side which has to become more pluggable.
> In addition, we will probably need to handle all kinds of issues that rise
> from our singletons at engine - class loading might be an issue here, no?
> You don't want the "X-ton" (doubleton, tripleton, etc..) phenomena in your
> setup - you don't want for example X instances of AsyncTaskManager.
> I think that in general we should strive to turn engine into way more
> pluggable/modular than it is now, imagine an "engine microkernel" (for
> those of you who did not hear the term microkernel, I am referring you to
> jboss architecture) - we should have a "thin microkernel" and the rest of
> the code should be pluggable, using the extension API (and perhaps web
> fragments as well).
> What do you think?
>
> > >
> > > [1] https://blogs.oracle.com/swchan/entry/servlet_3_0_web_fragment
> > >
> > > 1, improve UI plugin API
> > >- add "VirtualMachineDataLoaded" event fired upon each refresh of
> > >  VM data in UI table (generalization -> "{Entity}DataLoaded")
> > >- this is similar to existing "{Entity}SelectionChange" events
> >
> > relying on changes in the UI table is a bad idea:
> >
> > (1) potentially missing events:
> > the UI displays paginated data; if my VMs are sorted by name, and
> > I have 1000 VMs in my setup, and I just added a VM named "z", it will
> > be added to the last "page" which is not displayed right now, so I
> > wouldn't even be aware that something was added.
> >
> > (2) potentially "creating" "fake" events:
> > changes in the displayed data in the UI can occur due to change in the
> > Search query; if I have 50 VMs in my setup, and I initially had the
> > "Vms:" search query, and now I change it to "VMs: name = a*", which
> > results in displaying only 10 VMs, this may falsely hint on removal
> > of 40 VMs from the system.
> >
> > >
> > > 2, write UI plugin that uses oVirtJS to periodically check VM events
> >
> > not sure if this is referring to VM-related events in the code (e.g.
> > hooking to the click on "OK" within the New VM / Remove VM dialog,
> > or hooking to the "Success" callback of the action response, or
> > something similar), or to the VM-related "Events" (i.e. the ones that
> > are displayed in the GUI within the Events main-tab / bottom section).
> > If the former: can be done, I assume, though not sure how complex it
> > would be to implement the infrastructure for that.
> > If the latter: this will "catch" actions that were performed either
> > via the GUI or outside the GUI; in this case, it would probably be
> > better to use an Engine extension API (solution "0" above) rather
> > than a UI plugin, since it will be more reliable, will be active
> > even when the GUI is not in use, etc.
> >
> > >
> > > The disadvantage of 1, and 2, is that WebAdmin GUI must be open.
> > > In any case, if you'd like to explore the possibility of doing this
> > > via UI plugin, I'm here to help.
> > >
> > > Vojtech
> > >
> > >
> > > - Original Message -
> > > > From: "Oved Ourfali" 
> > > > To: "Yair Zaslavsky" 
> > > > Cc: "Koen Vanoppen" , users@ovirt.org,
> "Vojtech
> > > > Szocs" 
> > > > Sent: Thurs

Re: [ovirt-users] oVirt 3.5 & NAT

2014-11-01 Thread Phil Daws
Is there anybody who can help with this please ?  Am pretty sure all I need to 
be able to do know is create a network hook that changes a VM XML from:

  










  

to something like:

  






  

so replacing the bridge with a network and setting the network to be the OVS 
one I have defined.

Any ideas please ? Thanks, Phil



- Original Message -
From: "Phil Daws" 
To: users@ovirt.org
Sent: Tuesday, 28 October, 2014 12:18:47 PM
Subject: Re: [ovirt-users] oVirt 3.5 & NAT

Am starting to believe may have to give up on oVirt and move back to straight 
KVM and Openvswitch as that just worked which is a real shame :(

- Original Message -
From: "Phil Daws" 
To: users@ovirt.org
Sent: Monday, 27 October, 2014 5:51:53 PM
Subject: Re: [ovirt-users] oVirt 3.5 & NAT

I believe am really missing the point somewhere along the line :( on my 
straight KVM and OVS system I see:

brctl show
bridge name bridge id   STP enabled interfaces
virbr0  8000.fe5400552ed9   yes vnet5
vnet8
ovs-vsctl show
55a2af2f-daf5-4f01-a757-9bccaf4f6932
Bridge "ovsbr0"
Port "vnet0"
Interface "vnet0"
Port "vnet1"
tag: 8
Interface "vnet1"
Port "vnet13"
tag: 14
Interface "vnet13"
Port "vnet9"
tag: 10
Interface "vnet9"
Port "mgmt0"
Interface "mgmt0"
type: internal
Port "vnet14"
tag: 8
Interface "vnet14"
Port "ovsbr0"
Interface "ovsbr0"
type: internal
Port "vnet11"
tag: 8
Interface "vnet11"

and on the new oVirt system I see:

brctl show
bridge name bridge id   STP enabled interfaces
;vdsmdummy; 8000.   no  
ovirtmgmt   8000.c81f66c42c76   no  em1
vnet0
ovs-vsctl show
08554d11-3ba7-4303-b9d5-6a09f23c9057
Bridge "ovsbr0"
Port "ovsbr0"
Interface "ovsbr0"
type: internal


so I have the ovirtmgmt bridge running fine and that is responding to traffic.  
If I bond an IP to the ovsbr0 it responds okay:

ip add add 88.XXX.XXX.XXX/29 dev ovsbr0

so network traffic is flowing in and out of OVS.  The next step would be to 
create a VM that will act as the firewall with a public facing interface on 
ovsbr0, but then all internal networks would need specific vlans behind that.  
I have already defined a new network called ovs-network:


  ovs-network
  76152e72-34da-43bc-864a-85e727025bc9
  
  
  
  

  

  
  

  

  
  

  

  
  

  

  
  

  

  
  
  


and then I should just be able to assign the network and vlan IDs to each VM 
NIC:


  
  
  
  


  
  
  
  


so where should I start to put all this together please ? I believe am 90% 
there its just how to get the source-network and port-group to be assigned to a 
VM guest when its built ?  Guess probably need to create a new hook similar to 
https://github.com/oVirt/vdsm/blob/master/vdsm_hooks/macspoof/macspoof_vnic.py 
that changes this in each guests VM definition from bridge to a network:

  










  

Thanks, Phil
- Original Message -
From: "Phil Daws" 
To: users@ovirt.org
Sent: Monday, 27 October, 2014 5:16:05 PM
Subject: Re: [ovirt-users] oVirt 3.5 & NAT

How does one add multiple custom properties ? tried: 

engine-config -s 
CustomDeviceProperties='{type=interface;prop={vlan=^[a-zA-Z0-9_ 
---]+$}}{type=interface;prop={bridge=^[a-zA-Z0-9_ ---]+$}}' 

but ended up with one call vlan and the other prop :) If can add vlan and 
bridge then should be able to use a vNIC profile for adding an interface 
directly to OVS using a custom hook. 

Thanks, Phil 

- Original Message - 
From: "Phil Daws"  
To: users@ovirt.org 
Sent: Monday, 27 October, 2014 3:04:20 PM 
Subject: Re: [ovirt-users] oVirt 3.5 & NAT 

Well, in fact have got something to work now! Left ovirtmgmt and em1 alone but 
ran: 

$ ovs-vsctl add-br ovsbr0 
$ ip link add name veth0 type veth peer name veth1 
$ brctl addif ovirtmgmt veth0 
$ ovs-vsctl add-port ovsbr veth1 
$ ip add add XXX.XXX.XXX.XXX/29 dev veth1 
$ ip link set veth0 up && ip link set veth1 up 

and now veth1 is responding as-well as veth0. 

ovs-vsctl show 
08554d11-3ba7-4303-b9d5-6a09f23c9057 
Bridge "ovsbr0" 
Port "veth1" 
Interface "veth1" 
Port "ovsbr0" 
Interface "ovsbr0" 
type: internal 

so what I think should do now is create a custom parameter on the Engine 
M