[one-users] How to get information of actual VMs from inside a cluster

2011-12-14 Thread Akihiko Ota
Hi,

I intend to build VM clusters for high-performance computing by OpenNebula.
Each cluster shares /home by NFS and run MPI job individually.
And I would provide them as private cluster to several users.

I expect that NFS configuration can make using some way.
(e.g. static config in VM image, dynamic config by context)

But, in order to submit MPI job, it is necessary to know actual
compute-node (hostname, IP address, cores, etc...).
The number of VM of cluster can change on-demand by OpenNebula.
But maybe each VM cannot know change of member of cluster.

I cannot conceive the smart way how to know information of actual VMs
from inside a cluster environment.

Does anyone have any idea?

Thanks, 

-- 
Akihiko Ota

___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] How to get information of actual VMs from inside a cluster

2011-12-14 Thread Steffen Neumann
Hi,

On Wed, 2011-12-14 at 18:24 +0900, Akihiko Ota wrote:
 I intend to build VM clusters for high-performance computing by
 OpenNebula.
We have a virtual HPC cluster, using the SGE,
and the nodes register themselves as SGE hosts during bootup.

 But, in order to submit MPI job, it is necessary to know actual
 compute-node (hostname, IP address, cores, etc...).
 The number of VM of cluster can change on-demand by OpenNebula.
 But maybe each VM cannot know change of member of cluster.
Another possibility would be to run ganglia on the virtual nodes,
and query ganglia for the running hosts available for the MPI jobs.

Yours,
Steffen


-- 
IPB HalleAG Massenspektrometrie  Bioinformatik
Dr. Steffen Neumann  http://www.IPB-Halle.DE
Weinberg 3   http://msbi.bic-gh.de
06120 Halle  Tel. +49 (0) 345 5582 - 1470
  +49 (0) 345 5582 - 0
sneumann(at)IPB-Halle.DE Fax. +49 (0) 345 5582 - 1409


___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Creating virtual machines from scratch

2011-12-14 Thread Carlos Martín Sánchez
Hi,

You can also create an empty image with a template similar to this one (see
[1] for more info):

NAME  = new_img
TYPE  = DATABLOCK
SIZE  = 512000
FSTYPE= ext3

Or create an empty disk instead, as explained in [2].

You can change the boot device with the OS/BOOT attribute, see [3].
Regarding your last question, Do I really have to delete and recreate it?,
you can change the template with the command 'onetemplate update', and the
next instance will use the new boot attribute.

Regards.

[1] http://opennebula.org/documentation:rel3.0:img_template
[2]
http://opennebula.org/documentation:rel3.2:template#declaring_the_disk_type
[3]
http://opennebula.org/documentation:rel3.2:template#os_and_boot_options_section
[4]
http://lists.opennebula.org/pipermail/users-opennebula.org/2011-April/004893.html
[5]
http://lists.opennebula.org/pipermail/users-opennebula.org/2011-May/005188.html
--
Carlos Martín, MSc
Project Engineer
OpenNebula - The Open Source Toolkit for Data Center Virtualization
www.OpenNebula.org | cmar...@opennebula.org |
@OpenNebulahttp://twitter.com/opennebulacmar...@opennebula.org


On Fri, Dec 9, 2011 at 5:22 PM, richard -rw- weinberger 
richard.weinber...@gmail.com wrote:

 Fabian,

 On Fri, Dec 9, 2011 at 5:10 PM, Fabian Wenk fab...@wenks.ch wrote:
  Hello Richard
 
 
  On 08.12.2011 17:45, richard -rw- weinberger wrote:
 
  I'm a bit confused how to create a vm from scratch.
  Assume I want a vm running with CentOS6 and a new virtual hard disk of
  500GiB.
 
  How can I create a new disk using OpenNebula (especially with Sunstone)?
 
 
  I do not know how to do this steps in Sunstone, I did it with the command
  line tools.
 
  Create the image manually (outside of OpenNebula) with this steps (for
 KVM):
 
  On a system which has KVM available:
  qemu-img create -f raw servername.img 10G
  qemu-system-x86_64 -hda servername.img -cdrom /path/to/install.iso -boot
 d
  -m 512
  Connect through VNC for installation, the above command will report you
 the
  used port (default 5900), see blow as qemu-system-x86_64 listen only on
  localhost for VNC
  qemu-system-x86_64 servername.img -m 512  # to test after install
  Connect through VNC
  login and run 'poweroff' as root or with sudo
 
  Now on the front-end:
  Create an image template (servername-image.one)
  oneimage register servername-image.one
  Create an VM template for the host (servername.one)
  onevm create servername.one
 
 
  Connect to VNC on the cluster node:
  I do not know about your workstation, but from my Mac client I use
 Chicken
  [1], which supports connection through ssh. I guess there is a VNC client
  for the OS of your workstation available which also can do this. Else you
  could run it with manual ssh forwarding like this:
  ssh -L localhost:5900:localhost:5907 server-with-KVM
  replace 5907 with the port which qemu-system-x86_64 as reported and then
 use
  the local VNC client to connect to localhost port 5900.
 
[1] http://sourceforge.net/projects/chicken/
 
 
  In my setup each vm will have it's own disk image, thus no disk image
  needs to be copied.
  Is there a way to enforce this?
 
 
  The best is to register each image in the Image Repository with 'oneimage
  register ...'
 
 
  A final question, is it possible to change the boot order of a vm?
  Do I really have to delete and recreate it?
 
 
  You need to shutdown and recreate the VM. Best done with the command line
  tool 'onevm create template' and the template you can modify.
 

 Hmm, I feared these kind of answers. :-(
 Such a workflow unacceptable for my end-users.

 --
 Thanks,
 //richard
 ___
 Users mailing list
 Users@lists.opennebula.org
 http://lists.opennebula.org/listinfo.cgi/users-opennebula.org

___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] How opennebula use vmware drivers addon to manage esx/esxi4.1?

2011-12-14 Thread Tino Vazquez
Hi,

VMware Server is a not stand-alone hypervisor, previous to ESX.
OpenNebula doesn't currently support full integration with vCenter,
although there is work in progress to use it to provide livemigration
capabilities with vMotion through OpenNebula.

For now, the alternative is to manage each host individually adding
them to OpenNebula through onehost create command.

Regards,

-Tino

--
Constantino Vázquez Blanco, MSc
Project Engineer
OpenNebula - The Open Source Toolkit for Data Center Virtualization
www.OpenNebula.org | @tinova79 | @OpenNebula



2011/12/13 张光鹏 zhan...@neusoft.com:

 Hi:
 The VMware Drivers Addon enables the management of an OpenNebula cloud based
 on VMware ESX and/or VMware Server hypervisors.

 Is VMware Server means vCenter server?

 I read the document(http://www.opennebula.org/documentation:rel3.0:evmwareg
 ), i found it introduced the configuration of esx. But my esxesxi hosts are
 managed by vCenter server , should it work if i follow the comment -When
 using VMware Server, the connection string set under LIBVIRT_URI needs to
 have its prefix changed from esx to gsx. I mean some more configuration of
 how connect to vCenter server should be metioned.

 How could I configure this file-/etc/one/vmwarerc to connect to vCenter ?

 Could someone give me some guidance?

 Thanks All !
 Best Regards

 zhan...@neusoft.com
 ---
 Confidentiality Notice: The information contained in this e-mail and any
 accompanying attachment(s)
 is intended only for the use of the intended recipient and may be
 confidential and/or privileged of
 Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
 of this communication is
 not the intended recipient, unauthorized use, forwarding, printing,
 storing, disclosure or copying
 is strictly prohibited, and may be unlawful.If you have received this
 communication in error,please
 immediately notify the sender by return e-mail, and delete the original
 message and all copies from
 your system. Thank you.
 ---

 ___
 Users mailing list
 Users@lists.opennebula.org
 http://lists.opennebula.org/listinfo.cgi/users-opennebula.org

___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Mixed mode UBUNTU+ RH KVM

2011-12-14 Thread Valentin Bud
Hello Nikolay,

On Wed, Dec 14, 2011 at 4:06 PM, Nikolay Gar nikolay@gmail.com wrote:

 Hello folks .,

 Quick question ..

 If it possible to use as FrontEnd based on Ubuntu 11.04 and 2 Cluster
 Nodes on RH ES 6.0 as KVM nodes?


Thank a lot
 Nikolay


SSH is used to communicate with the nodes in order to either transfer the
VM image, if SSH Transfer Manager is being used of course, or to gather
status information about the load/health of the node.

If you are using NFS as storage backend the nodes must have a compatible
NFS client in order to mount the shares.

libvirt is setup on the nodes in order to start/stop/deploy VMs on top of
KVM.

SSH, NFS are protocols and libvirt is a standard library, so your mix
should work. I'm not trying to be condescending or something, just that I'm
approaching your question using the mentioned logic. The docs don't
specifically talk about mixing distributions.

Enjoy life,
v
-- 
w: http://databus.ro/blog
in: http://www.linkedin.com/pub/valentin-bud/9/881/830
t: https://twitter.com/valentinbud
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Mixed mode UBUNTU+ RH KVM

2011-12-14 Thread Poul Kristensen
Hello Nikolay

Just a little correction concerning Linux distros. There is no ES/AS
in RH version 6.0 - just RH 6.0 32/64 bit.

I think ES/AS ended with RH version 4.0. It was a concern of RAM
limitations of 16GB in RH ES 4.0.

BTW:
I would not recommend your setup / IT-softwareinfrastructure as you
have to update some time in future and
might meet problems with versions.

Furthermore you have to pay for updates from Redhat. Ubuntu is free
unless you need support.

Cheers

Poul

2011/12/14 Valentin Bud valentin@gmail.com:
 Hello Nikolay,

 On Wed, Dec 14, 2011 at 4:06 PM, Nikolay Gar nikolay@gmail.com wrote:

 Hello folks .,

 Quick question ..

 If it possible to use as FrontEnd based on Ubuntu 11.04 and 2 Cluster
 Nodes on RH ES 6.0 as KVM nodes?


 Thank a lot
 Nikolay


 SSH is used to communicate with the nodes in order to either transfer the VM
 image, if SSH Transfer Manager is being used of course, or to gather status
 information about the load/health of the node.

 If you are using NFS as storage backend the nodes must have a compatible NFS
 client in order to mount the shares.

 libvirt is setup on the nodes in order to start/stop/deploy VMs on top of
 KVM.

 SSH, NFS are protocols and libvirt is a standard library, so your mix should
 work. I'm not trying to be condescending or something, just that I'm
 approaching your question using the mentioned logic. The docs don't
 specifically talk about mixing distributions.

 Enjoy life,
 v
 --
 w: http://databus.ro/blog
 in: http://www.linkedin.com/pub/valentin-bud/9/881/830
 t: https://twitter.com/valentinbud


 ___
 Users mailing list
 Users@lists.opennebula.org
 http://lists.opennebula.org/listinfo.cgi/users-opennebula.org

___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Creating virtual machines from scratch

2011-12-14 Thread Carlos Martín Sánchez
Hi,

Images can be created from Sunstone.
Please use this list to ask for support if you are having trouble with this
functionality.

Regards.
--
Carlos Martín, MSc
Project Engineer
OpenNebula - The Open Source Toolkit for Data Center Virtualization
www.OpenNebula.org | cmar...@opennebula.org |
@OpenNebulahttp://twitter.com/opennebulacmar...@opennebula.org


On Wed, Dec 14, 2011 at 1:02 PM, cat fa boost.subscrib...@gmail.com wrote:

 You cannot create an image with Sunstone. You should create an image with
 kvm.


 2011/12/9 richard -rw- weinberger richard.weinber...@gmail.com

 Hi!

 I'm a bit confused how to create a vm from scratch.
 Assume I want a vm running with CentOS6 and a new virtual hard disk of
 500GiB.

 How can I create a new disk using OpenNebula (especially with Sunstone)?

 In my setup each vm will have it's own disk image, thus no disk image
 needs to be copied.
 Is there a way to enforce this?

 A final question, is it possible to change the boot order of a vm?
 Do I really have to delete and recreate it?

 --
 Thanks,
 //richard
 ___
 Users mailing list
 Users@lists.opennebula.org
 http://lists.opennebula.org/listinfo.cgi/users-opennebula.org



 ___
 Users mailing list
 Users@lists.opennebula.org
 http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


[one-users] [Help] How to reboot a VM when the VM crashes?

2011-12-14 Thread cat fa
If a VM crashes, what can I do? I cannot find any command to reboot that
 VM. Suppose, I have some import data in that VM.
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org


Re: [one-users] Error from quota module when trying to create a vm or instantiate a template

2011-12-14 Thread Graeme Gillies
Hi,

I've done some more investigating and I've got a handle on what the problem is.

My VM templates don't define a CPU attribute (as I'm just letting it
use the default values) and therefore the code errors out trying to
get a CPU value from my vm template which don't have one.

This sounds like a bug to me, I'm assuming I should file it at
dev.opennebula.org?

Regards,

Graeme

On Mon, Dec 5, 2011 at 3:36 PM, Graeme Gillies
graeme.r.gill...@gmail.com wrote:
 Hi,

 I have enabled the quota module on my opennebula 3 installation and
 now whenever I try and create a vm image, either from a template or
 file from disk, I get the quota module denying me. I have checked the
 quota limits for the user are ok. Running the command from the
 oned.log with ruby debug gives the following error message

 /var/lib/one/remotes/auth/quota/authorize:38: warning: ambiguous first
 argument; put parentheses or even spaces
 /var/lib/one/remotes/auth/quota/authorize:57: warning: ambiguous first
 argument; put parentheses or even spaces
 Exception `LoadError' at /usr/lib/ruby/site_ruby/1.8/rubygems.rb:1113
 - no such file to load -- rubygems/defaults/operating_system
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/config_file.rb:50 - no such file
 to load -- Win32API
 Exception `NoMethodError' at /usr/lib/ruby/1.8/rational.rb:78 -
 undefined method `gcd' for Rational(1, 2):Rational
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31 - no such
 file to load -- nokogiri
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31 - no such
 file to load -- xmlparser
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:38 - no such
 file to load -- xmlparser
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31 - no such
 file to load -- sequel
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/model/base.rb:817:
 warning: `*' interpreted as argument prefix
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/model/base.rb:631:
 warning: instance variable @dataset not initialized
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/model/base.rb:631:
 warning: instance variable @dataset not initialized
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31 - no such
 file to load -- sqlite3
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31 - no such
 file to load -- sqlite3/1.8/sqlite3_native
 Exception `LoadError' at
 /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:38 - no such
 file to load -- sqlite3/1.8/sqlite3_native
 Exception `SQLite3::SQLException' at
 /usr/lib/ruby/gems/1.8/gems/sqlite3-1.3.3/lib/sqlite3/database.rb:91 -
 index quotas_uid_index already exists
 Exception `Sequel::DatabaseError' at
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/database/misc.rb:254
 - SQLite3::SQLException: index quotas_uid_index already exists
 Exception `SQLite3::SQLException' at
 /usr/lib/ruby/gems/1.8/gems/sqlite3-1.3.3/lib/sqlite3/database.rb:91 -
 index usage_uid_index already exists
 Exception `Sequel::DatabaseError' at
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/database/misc.rb:254
 - SQLite3::SQLException: index usage_uid_index already exists
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/dataset/actions.rb:130:
 warning: instance variable @row_proc not initialized
 /usr/lib/ruby/gems/1.8/gems/sequel-3.29.0/lib/sequel/dataset/actions.rb:130:
 warning: instance variable @row_proc not initialized
 Exception `TypeError' at /usr/lib/one/ruby/quota.rb:199 - can't
 convert nil into Float
 /usr/lib/one/ruby/quota.rb:199:in `Float': can't convert nil into
 Float (TypeError)
        from /usr/lib/one/ruby/quota.rb:199:in `send'
        from /usr/lib/one/ruby/quota.rb:199:in `check_quotas'
        from /usr/lib/one/ruby/quota.rb:194:in `each'
        from /usr/lib/one/ruby/quota.rb:194:in `check_quotas'
        from /usr/lib/one/ruby/quota.rb:184:in `authorize'
        from /var/lib/one/remotes/auth/quota/authorize:53
        from /var/lib/one/remotes/auth/quota/authorize:52:in `each'
        from /var/lib/one/remotes/auth/quota/authorize:52

 output for onequota show 1

  uid          cpu       memory      num_vms      storage
   1          0/3   5120/10240         4/10      0/20480

 Any help would be much appreciated.

 Regards,

 Graeme
___
Users mailing list
Users@lists.opennebula.org
http://lists.opennebula.org/listinfo.cgi/users-opennebula.org