Re: [PVE-User] Windows & Gluster 3.8
On 16/12/16 11:03, Maxence Sartiaux wrote: [2016-12-14 11:08:29.212590] I [MSGID: 114057] [client- handshake.c:1446:select_server_supported_programs] 0-vm-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330) AFAIK, this is unrelevant, some developer put the version on the log and never was updated. -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Hierarchical pools
On 08/11/16 10:12, Dominik Csapak wrote: if i understand you correctly, you want to achieve something like this: vms: Pool System: vm 100 - 105 Pool Development: vm 106 - 110 Pool Lab: vm 111 - 115 Not exactly, what I want is to nest a pool inside another pool in order to inherit the permissions of the father into the child, like this: /---> root, where Administrator has all the permissions. /pool/Development ---> root of the "Development" pool, where root and selected people/groups can access with custom permissions /pool/Development/Lab---> "Lab" subpool, where inherited permissions from "Development" pool can access, and add some others like group "System" /pool/Systems ---> root of "Systems" pool, where root and selected people/groups can access with custom permissions In this way, we can inherit permissions from the parent pool without the need of specify permissions in each and every pool, simplifying the management of pools greatly. Furthermore, on Datacenter --> Permissions --> Add, I can see a checkbox called "propagate", which seems to mean that we can avoid to inherit the permissions on the subpools, but we can only create pools on the first level... which IMO seems that proxmox is ready to inherit permissions on pools and nest pools but is not yet implemented (in fact, we can actually create a permission on Datacenter --> Permissions --> Add, and specify the path /pool/Develepment/Lab, but it does not appear as a pool, and it cannot be deleted! :S ) Hope I have explained better now. What do you think? Best, -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
[PVE-User] Hierarchical pools
Hello, I would like to suggest a feature, or to know how do you do to (if you do it), when want to add the VMs to more than a pool. As an example, if I have several pools of VMs, say "Development", "Systems" and "Lab", I would like to let some users/groups both from developer and system groups to control the VMs from pool "Lab" with some elevated privileges like poweroff, CDROM, etc to install and configure the VM before entering production. I cannot see how to acomplish this, because one reource (VM/storage) can belong only to one Pool. As far as I can see, there are two options, let the pools be hierarchical or let the resources belong to more than one pool. Can this feature be useful enough to suggest it to the Proxmox team? Anyone achieve this with some workaround I didn't thought? Best, -- [cid:part1.74F14D67.C6327600@dltec.net] Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 Nota Legal<http://www.dltec.net/aviso-legal> ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] VM Won't start
On 13/01/16 17:24, Gilberto Nunes wrote: But, when I point the virtual CD/DVD to an ISO image, I get that message... There is no special requirement to this VM... ISO is Centos 7 x64. VM config: Can it start without CD? -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Debugging Proxmox kernel
Nevermind, I'm compilling it from sources. On 30/10/15 10:47, Angel Docampo wrote: Hi list, I need to debug the kernel on proxmox to try to solve a ZFS hang... I cannot find the needed package, pve-kernel-3.10.0-12-pve-dbg. Is it somewhere on the Net? Best, -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 Nota Legal <http://www.dltec.net/aviso-legal> ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] ZFSOnLinux packages on Proxmox 3.4
On 15/10/15 08:01, Lindsay Mathieson wrote: Ok, thanks Lindsay Mathieson From: Dietmar Maurer <mailto:diet...@proxmox.com> Sent: 15/10/2015 4:12 PM To: PVE User List <mailto:pve-user@pve.proxmox.com>; Lindsay Mathieson <mailto:lindsay.mathie...@gmail.com> Subject: Re: [PVE-User] ZFSOnLinux packages on Proxmox 3.4 > On October 14, 2015 at 11:21 PM Lindsay Mathieson > <lindsay.mathie...@gmail.com> wrote: > > > Would there be any problems with using the ZOL debian wheezy repo on > proxmox 3.4? they are more up to date (0.6.5.3) then the std ones. We do not test those packages, and you may run into package dependency problems. ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user I always use the official repos from ZoL, there are repos for wheezy so there should be no problem to upgrade them. I didn't upgrade it yet, but I'll do as soon as I can. -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] VDI on Proxmox anyone?
On 06/10/15 13:56, Hermann Himmelbauer wrote: Am 06.10.2015 um 13:53 schrieb Dimitris Beletsiotis: Hi there, __ __ Correct me if I am wrong but below solutions (Windows TS and Linux X clients) are not VDI with Proxmox.__ Windows Terminal services and Linux X desktops are totally different and can be implemented on every virtualization platform (or bare metal). The advantage of using Proxmox with Spice is the integration between the virtualization environment and the (thin) client's desktop/experience. VDI is more appealing on platforms like VMware Horizon where desktop and applications are virtualized and management of images is much easier (with high cost of course :-) ) Exactly. And that was my initial question - if anyone has any idea of how to implement this with Proxmox or if he already has done this. AFAIK Redhat provides some kind of KVM/SPICE-based solution, although I doubt that it's ready for production? Best Regards, Hermann Well, I wrote about x2go client because I found it better in network traffic than spice client itself. Two years ago we implemented a very simple spice-based application which asked for a credentials and connected to proxmox using those credentials and then it shown the VMs where that user could connect to, as many users only have one VM (or VDI in this case), the desktop showed directly. That was done with bash and zenity mainly, on the forums is said how to download the proxmox ticket from the command line and use it as parameter to remote-viewer. So, if you want a spice approach, it can be done by you with some work, I do not know if Proxmox team will develop a desktop client for this in the future, but it can be acomplished with some bash scripting or using promox API. Anyway, I reiterate, spice client is... "network expensive", and you'll need a good connection to work properly, in a LAN it shouldn't be a problem, but for remote clients is unbearable. -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] [pve-devel] Proxmox VE 4.0 released!
On 07/10/15 06:20, Alexandre DERUMIER wrote: It's possible to upgrade all nodes to jessie/proxmox 4.0, at the same time, without reboot host. (and without stop the vms) A wiki entry should be extremely useful, I would try by myself, but I do not have enough hardware at the moment to make the test, perhaps in some days I can get new hardware and try it out. -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] VDI on Proxmox anyone?
Hi there! I have set up proxmox as VDI infrastructure for a while and it works great. While the experience is quite good on enterprise environments, is true that online videos are too expensive in network terms. What I'm using to connect to the VDIs is x2go TCE (http://wiki.x2go.org/doku.php/wiki:advanced:tce:install), is based on nx and it's jpeg compression or whatever it uses reduces it's bandwidth to a level you can connect even through a DSL connection from home. Highly recommended to test it out. Online videos, far from perfect, are pretty less laggy than on spice. Regards, On 30/09/15 15:59, Dimitris Beletsiotis wrote: Hello, >>Is youtube not working due to the network speed, or are there generally >>problems with video compression/transfer via SPICE? Youtube is working but not like the native experience (there are some glitches in audio and video). I see 50-70 Mbps net traffic between the spice-server (proxmox) and the spice-client when youtube video is running, I consider this too high. Normal traffic is around 1-2 Mbps and some times is reaching 10 Mbps. >>What I moreover would like to know is how you do updates on the Win7 >>desktops - do you do this on each single machine or do you somehow do >>these updates on a "golden image" from where you clone your current >>working image? To accomplish above with proxmox I believe that you need to use the linked clones feature (I have not tested in production), see: https://www.proxmox.com/en/news/press-releases/proxmox-ve-3-0-released https://pve.proxmox.com/wiki/VM_Templates_and_Clones Just tried a simple test: -Create a template from an existing win7 image to use as the base image, vmid 301 -Create a linked clone from the above for a user, vmid 302 -Create a full clone from vmid 301 to update the base image (e.g. perform software updates), vmid 303 -Create a linked clone from the above to update the image to the user, vmid 303 As you can see below sizes of linked clones are very low (it always depends to the size of changes applied) compared to the base image of 100G. The time required to create the linked clones from the template is few secs. ./301: total 82G -r--r--r-- 1 root root 101G Sep 30 13:02 base-301-disk-1.qcow2 ./302: total 210M -rw-r--r-- 1 root root 210M Sep 30 13:47 vm-302-disk-1.qcow2 ./303: total 81G -r--r--r-- 1 root root 100G Sep 30 13:36 base-303-disk-1.raw ./304: total 307M -rw-r--r-- 1 root root 307M Sep 30 13:47 vm-304-disk-1.qcow2 Best Regards, Dimitris On Tue, Sep 29, 2015 at 5:18 PM, Hermann Himmelbauer <herm...@qwer.tk <mailto:herm...@qwer.tk>> wrote: Am 29.09.2015 um 15:39 schrieb Dimitris Beletsiotis: > Hello, > > For VDI on proxmox you can use Spice protocol/console, for more info > see https://pve.proxmox.com/wiki/SPICE > Win7 desktop is working perfectly stable and is fine for basic office usage. > Audio works fine, youtube streaming is problematic for me. > > If you have many workstations you can use ZFS storage with deduplication > enabled to save big on storage needs. Thanks for info, very interesting! Is youtube not working due to the network speed, or are there generally problems with video compression/transfer via SPICE? What I moreover would like to know is how you do updates on the Win7 desktops - do you do this on each single machine or do you somehow do these updates on a "golden image" from where you clone your current working image? Best Regards, Hermann -- herm...@qwer.tk <mailto:herm...@qwer.tk> PGP/GPG: 299893C7 (on keyservers) ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] VDI on Proxmox anyone?
Oh, I forgot to say we mainly use Linux as desktops, so no need to golden image as linux is multi-user, so I need only to upgrade one VM. We have some windows server with terminal services and with some windows-only software on them, but as said, VDI infrastructure relys on linux desktops ;) Anyway, you can have windows VM and access through a thinclient booting x2go (or other lightweight linux distro bootable via PXE) and access your windows VDI throught rdesktop instead of x2go client, I've just tried the same youtube video both in windows and in linux and while in linux trought x2go protocol the video seems smoother while not in full screen, seems that rdesktop protocol in windows handles full screen videos a bit better... anyway, in a enterprise environment, where watching videos is sporadical and they can be seen perfectly in a windowed size, all virtual environments, from KVM to commercial, offers a pretty but limited performance. As you can see, my approach is different from yours: instead to have one VM for each users (even each VM is a linked clone from a template) I have one VM for many users, one linux and one windows. In linux is free and in windows I must use TS licenses (well, if you're legal, you should use them also in windows clones). The benefeits in having several users on the same VM is shared memory, resources from the VM are shared amongst the users, but in echange having a machine-user ratio of 1:1 you can isolate the processes, in both approaches, you only must maintain only one VM. On 05/10/15 14:02, Hermann Himmelbauer wrote: Am 05.10.2015 um 09:44 schrieb Angel Docampo: Hi there! I have set up proxmox as VDI infrastructure for a while and it works great. While the experience is quite good on enterprise environments, is true that online videos are too expensive in network terms. What I'm using to connect to the VDIs is x2go TCE (http://wiki.x2go.org/doku.php/wiki:advanced:tce:install), is based on nx and it's jpeg compression or whatever it uses reduces it's bandwidth to a level you can connect even through a DSL connection from home. Highly recommended to test it out. Online videos, far from perfect, are pretty less laggy than on spice. Very interesting, thanks! I'd like to know how you set up the VDI - simply as a single-instance installation? Or do you have some kind of setup with a cloned golden image or the like? Btw.: Why not use the simple Remote Desktop, which is already integrated in Windows? Is the latest RDP protocol not already highly optimized, especially for video and the like? Best Regards, Hermann -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE ZFS replication manager released (pve-zsync)
Hi there! Is it based on zfs send-receive? I thought it was buggy on linux... perhaps it was on 0.6.3? Anyway, that's a great feature, thank you! :) On 30/06/15 12:19, Martin Maurer wrote: Hi all, We just released the brand new Proxmox VE ZFS replication manager (pve-zsync)! This CLI tool synchronizes your virtual machine (virtual disks and VM configuration) or directory stored on ZFS between two servers - very useful for backup and replication tasks. A big Thank-you to our active community for all feedback, testing, bug reporting and patch submissions. Documentation http://pve.proxmox.com/wiki/PVE-zsync Git https://git.proxmox.com/?p=pve-zsync.git;a=summary Bugtracker https://bugzilla.proxmox.com/ -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE ZFS replication manager released (pve-zsync)
Oh, I didn't realized of that line Fixed multiple 'zfs send/recv' failure modes. I hope fixed multiple failure modes means that was finally (and completely) fixed... :P On 30/06/15 14:23, Wolfgang Link wrote: There where some issues in 0.6.4 but they are fixed in 0.6.4! https://github.com/zfsonlinux/zfs/releases/tag/zfs-0.6.4 On 06/30/2015 02:08 PM, Angel Docampo wrote: Hi there! Is it based on zfs send-receive? I thought it was buggy on linux... perhaps it was on 0.6.3? Anyway, that's a great feature, thank you! :) On 30/06/15 12:19, Martin Maurer wrote: Hi all, We just released the brand new Proxmox VE ZFS replication manager (pve-zsync)! This CLI tool synchronizes your virtual machine (virtual disks and VM configuration) or directory stored on ZFS between two servers - very useful for backup and replication tasks. A big Thank-you to our active community for all feedback, testing, bug reporting and patch submissions. Documentation http://pve.proxmox.com/wiki/PVE-zsync Git https://git.proxmox.com/?p=pve-zsync.git;a=summary Bugtracker https://bugzilla.proxmox.com/ -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 114 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
[PVE-User] Delay fencing
I would like to know if there are any way to delay fencing. I had some network microcuts, and fencing immediately stonith the node who had them... Is there any way to make cluster to delay fencing some seconds or make another comprovation prior to fencing the offending node? Regards -- [cid:part1.05040409.0909@dltec.net] Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 Nota Legalhttp://www.dltec.net/aviso-legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Delay fencing
I forgot to mention I'd already tried --delay option, but it isn't working for me, perhaps I'm doing it wrong. What I'm doing to test it is setting the link down and up on the cluster network interface, simulating a network microcut. My scenario is a HA two-cluster with quorum disk. The relevant cluster.conf configuration is ... fencedevices fencedevice agent=fence_ipmilan cipher=1 ipaddr=192.168.1.111 lanplus=1 login=username name=fenceAtlantis passwd=password power_wait=60 delay=30/ fencedevice agent=fence_ipmilan cipher=1 ipaddr=192.168.1.112 lanplus=1 login=username name=fenceBree passwd=password power_wait=60 delay=30/ /fencedevices ... clusternodes clusternode name=atlantis nodeid=1 votes=1 fence method name=1 device action=off name=fenceAtlantis/ /method /fence /clusternode clusternode name=bree nodeid=2 votes=1 fence method name=1 device action=off name=fenceBree/ /method /fence /clusternode /clusternodes What I think is --delay option is accepted once fencing it's on its way, but it will be irremediably executed after this period. On 19/01/15 14:23, Steffen Wagner wrote: There should be some parameter like the following + parameter name=delay unique=0 required=0 + getopt mixed=--delay=[seconds] / + content type=string default=0 / + shortdesc lang=enWait X seconds before fencing is started/shortdesc + /parameter https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Cluster_Administration/ap-fence-device-param-CA.html *From:* Angel Docampo mailto:adoca...@dltec.net *Sent:* Monday, January 19, 2015 2:12 PM *To:* ProxMox Users mailto:pve-user@pve.proxmox.com *Subject:* [PVE-User] Delay fencing I would like to know if there are any way to delay fencing. I had some network microcuts, and fencing immediately stonith the node who had them... Is there any way to make cluster to delay fencing some seconds or make another comprovation prior to fencing the offending node? Regards -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 Nota Legal http://www.dltec.net/aviso-legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Delay fencing
Sorry, I've sent the message before I complete to write it... What I think is --delay option is accepted once fencing it's on its way, but it will be irremediably executed after this period. On 19/01/15 15:20, Angel Docampo wrote: I forgot to mention I'd already tried --delay option, but it isn't working for me, perhaps I'm doing it wrong. What I'm doing to test it is setting the link down and up on the cluster network interface, simulating a network microcut. My scenario is a HA two-cluster with quorum disk. The relevant cluster.conf configuration is ... fencedevices fencedevice agent=fence_ipmilan cipher=1 ipaddr=192.168.1.111 lanplus=1 login=username name=fenceAtlantis passwd=password power_wait=60 delay=30/ fencedevice agent=fence_ipmilan cipher=1 ipaddr=192.168.1.112 lanplus=1 login=username name=fenceBree passwd=password power_wait=60 delay=30/ /fencedevices ... clusternodes clusternode name=atlantis nodeid=1 votes=1 fence method name=1 device action=off name=fenceAtlantis/ /method /fence /clusternode clusternode name=bree nodeid=2 votes=1 fence method name=1 device action=off name=fenceBree/ /method /fence /clusternode /clusternodes What I think is --delay option is On 19/01/15 14:23, Steffen Wagner wrote: There should be some parameter like the following + parameter name=delay unique=0 required=0 + getopt mixed=--delay=[seconds] / + content type=string default=0 / + shortdesc lang=enWait X seconds before fencing is started/shortdesc + /parameter https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Cluster_Administration/ap-fence-device-param-CA.html *From:* Angel Docampo mailto:adoca...@dltec.net *Sent:* Monday, January 19, 2015 2:12 PM *To:* ProxMox Users mailto:pve-user@pve.proxmox.com *Subject:* [PVE-User] Delay fencing I would like to know if there are any way to delay fencing. I had some network microcuts, and fencing immediately stonith the node who had them... Is there any way to make cluster to delay fencing some seconds or make another comprovation prior to fencing the offending node? Regards -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 Nota Legal http://www.dltec.net/aviso-legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Ceph is the preferred proxmox shared storage?
On 29/10/14 05:43, Lindsay Mathieson wrote: Sorry to keep coming back to this :( but we're adding a 3rd node to our cluster which brings ceph back into the picture ... Is there a particular reason that ceph is preferred to glusterfs? better performance? more fault tolerant? Ceph provides block storage while Gluster doesn't, but the latest it's far easier to setup. As block storage, Ceph is faster than Gluster, but I have all my proxmox virtual environment with gluster running perfectly. On its day, I relied on Gluster because it was a more mature product than Ceph, ready for production, but now I'm toying in a second cluster with Ceph because now it's becoming a mature product as well... both have pros and cons, and both are good, so I think there isn't a winner between them at the moment. Also - my third proxmox node is just a lightweight intel nuc for quorum - it won't be running VM's or contributing storage. Does the following setup make sense? Node1: OSD1 + Monitor Node2: OSD3 + Monitor Node1: Monitor Only Node1 Node2 are connected via Dual Bonded 1GB Ethernet Node3 Only has 1GB Ethernet Bonded interfaces on linux are active-backup, so you have a 1Gb connexion on the storage side. Consider to upgrade to a faster ethernet/fiberchannel/infiniband. You will have no problems with your intel nuc as quorum node, I have a 512MB RAM VM with 8GB HDD with debian and proxmox for that purpose. -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] GlusterFS Questions
On 23/10/14 03:32, Lindsay Mathieson wrote: I'm playing around with GlusterFS and have a few questions. Have got a test setup running on a 2 node cluster (using external USB Drives!) that works surprisingly well :) and I must say it was very easy to setup. 1. I wanted to implement a distributed/replicated file system. Is GlusterFS the best choice for a 2 node system? Would it be easy to add a third node later? 2. When launching a VM off Node 1 or Node 2, is it accessing the local hard disk directly, or does it all go through a network share? Our network is only 1GB and it would be nice to take some of the load off it. Should I be asking these question on the forum rather than the list? Thanks, -- Lindsay ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user I'm using successfully Proxmox with GlusterFS. Each proxmox node is also a gluster node, and now I have two nodes (using a third proxmox node on vmware for proxmox quorum). I must say it works pretty nice, I even provide Windows VDIs with this system. Adding a third (with a fourth -it's a replica, you know-) and more nodes, it's pretty straight forward. Just prepare them, add to the gluster and the data will be rebalanced, with a 10Gb network, the data will be rebalanced hugely faster than with a 1Gb network. I also suggest to you to use a better network because glusterfs writes are synchronous. The benefit of this is that if one node comes down, all the information is in the other node, so there are chances that the VMs even didn't notice when a node comes down. When you write on gluster, even you have mounted it using the IP of one of them, the writes are randomly (not really random) send to any node, and then, replicated amongst them, it's the internal operation. You could set up a georeplica instead a replica, designed to replicate two gluster clusters amongst remote offices, and then you could use your 1Gb network to make asynchronous writes. The cons I see are you don't have *exactly* the same data on the both clusters at each time, and in case of a node comes down, you should reconfigure all VMs to point their disks to the other GlusterFS, because they are two different clusters. So, summarizing: Yes, you can use gluster in a two-node gluster setup, I do not know if Ceph its better though, I can only share my positive experiences with gluster. I would recommend you to use a 10Gb network dedicated for gluster communication, it will be useful to replicate data synchronously and essential for rebalance the data when in a future you will need to add more nodes. -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE 3.3 released!
On 15/09/14 12:05, Martin Maurer wrote: Hi all! We just released Proxmox VE 3.3, introducing great new features and security enhancements! Including the new HTML5 Console, http://pve.proxmox.com/wiki/Proxmox_VE_Firewall, http://pve.proxmox.com/wiki/Two-Factor_Authentication, ZFS storage plugin, http://pve.proxmox.com/wiki/Proxmox_VE_Mobile interface for mobile touch devices and more! Check our short video tutorial - http://www.proxmox.com/training/video-tutorials/item/what-s-new-in-proxmox-ve-3-3 A big Thank-you to our active community for all feedback, testing, bug reporting and patch submissions. Release notes http://pve.proxmox.com/wiki/Roadmap#Proxmox_VE_3.3 Video Tutorials http://www.proxmox.com/training/video-tutorials Download http://www.proxmox.com/downloads/cat...iso-images-pve Package Repositories http://pve.proxmox.com/wiki/Package_repositories __ Best regards, Martin Maurer Proxmox VE project leader ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user Wow, so many cool features! Thank you devs! -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox Wishlist
Changing the topic but not the subject of the thread, my whishlist would be mainly changes from the GUI. - gluster upload fixed (it never worked) - dropdown editables, not only selectables (when assigning a user to a VM from a 3000+ users LDAP its a PITA) El vie 27 jun 2014 12:24:45 CEST, piccardi escribió: Il 2014-06-24 23:22 Alexandre DERUMIER ha scritto: 4.) I completely agree, JAVA is a pain for some situations, and with HTML5 gaining traction, I do think it should be considered, if it isn't already. But SPICE is already supported, and works well enough to be a replacement for JAVA. The only downside being the person has to install the client. html5 novnc console is available in proxmox git ;) That's a good news, because last chrome is losing Java plugin support, so the java console cannot used with recent chrome versions. Any idea on when it will be released? Simone ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Debian 7.5 and Proxmox...
You can try to mount the filesystem with allocsize=64K as suggested here: http://forum.proxmox.com/archive/index.php/t-17462.html I had problems with xfs also, and befeore I saw these thread, I re-formated the FS to ext4, and it worked... On Thu May 15 12:00:29 2014, Gilberto Nunes wrote: Yes... I am using XFS. But I always do! Why should this trouble appears just know!! And worst: why it is works fine with the Pve kernel?? When boot using the Pve kernel, I do not change the filesystem either... Btw, thanks for answer... Em 15/05/2014 03:58, Angel Docampo adoca...@dltec.net mailto:adoca...@dltec.net escreveu: What filesystem do you have in the slow system? XFS perhaps? I think there is a bug on XFS with preallocation. Enviado desde mi móvil LG -- Mensaje original -- De: Gilberto Nunes Fecha: 15/05/2014 3:24 Para: pve-user@pve.proxmox.com mailto:pve-user@pve.proxmox.com; Asunto:[PVE-User] Debian 7.5 and Proxmox... Hello guys I remember that I already installed Proxmox over Debian 7.4 sometimes ago and everything running smootlhy even when I used default Debian Kernel - i.e. 3.2.x something... Now I backup to install Proxmox 2.6.32 and I notice that when I use kernel 3.2.0-4-amd64, the creation of hard disk took a lot of time!!! Sometimes, it took 5 or 8 minutes, to create a virtio disk with 8G size... But when I reboot my host, a simple laptop, with Intel Core i5, 4 gb of memory, when I reboot and start the laptop with Proxmox kernel, i.e. 2.6.32-29-pve, everything running smootlhy... ii pve-qemu-kvm 1.7-8 amd64Full virtualization on x86 hardware ii qemu-server 3.1-16 amd64Qemu Server Tools So I image that qemu-img create perform a full space allocation into file image... But I wonder why with Debian default kernel took a lot of time and with pve kernel everything works well! Some explanation?? Thanks a lot... A note: Right now I'm running pve kernel while I write this mail... And everything works well, but qemu-img create still perform a fully space allocation into file image... I don't know if this is a default behavior or not! -- Gilberto Ferreira -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Debian 7.5 and Proxmox...
Congrats! Finally did you use the xfs mount option? On Thu May 15 12:46:07 2014, Gilberto Nunes wrote: THANKS A LOT BUDDY! It's work as a charm!... 2014-05-15 7:29 GMT-03:00 Gilberto Nunes gilberto.nune...@gmail.com mailto:gilberto.nune...@gmail.com: well.. I will try it and report later... thanks a lot 2014-05-15 7:09 GMT-03:00 Angel Docampo adoca...@dltec.net mailto:adoca...@dltec.net: You can try to mount the filesystem with allocsize=64K as suggested here: http://forum.proxmox.com/__archive/index.php/t-17462.html http://forum.proxmox.com/archive/index.php/t-17462.html I had problems with xfs also, and befeore I saw these thread, I re-formated the FS to ext4, and it worked... On Thu May 15 12:00:29 2014, Gilberto Nunes wrote: Yes... I am using XFS. But I always do! Why should this trouble appears just know!! And worst: why it is works fine with the Pve kernel?? When boot using the Pve kernel, I do not change the filesystem either... Btw, thanks for answer... Em 15/05/2014 03:58, Angel Docampo adoca...@dltec.net mailto:adoca...@dltec.net mailto:adoca...@dltec.net mailto:adoca...@dltec.net escreveu: What filesystem do you have in the slow system? XFS perhaps? I think there is a bug on XFS with preallocation. Enviado desde mi móvil LG -- Mensaje original -- De: Gilberto Nunes Fecha: 15/05/2014 3:24 Para: pve-user@pve.proxmox.com mailto:pve-user@pve.proxmox.com mailto:pve-user@pve.proxmox.__com mailto:pve-user@pve.proxmox.com; Asunto:[PVE-User] Debian 7.5 and Proxmox... Hello guys I remember that I already installed Proxmox over Debian 7.4 sometimes ago and everything running smootlhy even when I used default Debian Kernel - i.e. 3.2.x something... Now I backup to install Proxmox 2.6.32 and I notice that when I use kernel 3.2.0-4-amd64, the creation of hard disk took a lot of time!!! Sometimes, it took 5 or 8 minutes, to create a virtio disk with 8G size... But when I reboot my host, a simple laptop, with Intel Core i5, 4 gb of memory, when I reboot and start the laptop with Proxmox kernel, i.e. 2.6.32-29-pve, everything running smootlhy... ii pve-qemu-kvm 1.7-8 amd64Full virtualization on x86 hardware ii qemu-server 3.1-16 amd64Qemu Server Tools So I image that qemu-img create perform a full space allocation into file image... But I wonder why with Debian default kernel took a lot of time and with pve kernel everything works well! Some explanation?? Thanks a lot... A note: Right now I'm running pve kernel while I write this mail... And everything works well, but qemu-img create still perform a fully space allocation into file image... I don't know if this is a default behavior or not! -- Gilberto Ferreira -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 -- Gilberto Ferreira -- Gilberto Ferreira -- *Angel Docampo * *Datalab Tecnologia, s.a.* Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Online migration leaves firewall vm without service
Iptables Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 De: Adam Thompson athom...@athompso.net Enviado: lunes, 10 de marzo de 2014 22:02 Para: Angel Docampo Cc: proxmoxve (pve-user@pve.proxmox.com) Asunto: Re: [PVE-User] Online migration leaves firewall vm without service I don't experience this. What kind of firewall? -Adam On Mar 10, 2014 11:04 AM, Angel Docampo adoca...@dltec.net wrote: I would like to ask here if you suffer the same issue than me. When upgrading proxmox, I must move the virtual machines fron node to node in order to reboot the node. Everything works fine except for the firewalls I have virtualized. All of them, without exception, stop working. My laptop cannot ping the Internet and everything is restablished when I reboot the VM. Any of you have the same issue? There is some workaround? Thanks, -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 Nota Legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE 3.2 released!
Hello Dietmar, Could you please put the link to the updated API docs? Or the place where those changes are reflected, because I still cannot see the changes or I'm seeing the outdated doc. Thank you! Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 De: Dietmar Maurer diet...@proxmox.com Enviado: martes, 11 de marzo de 2014 6:21 Para: Angel Docampo; Martin Maurer; Guy Cc: proxmoxve (pve-user@pve.proxmox.com) Asunto: RE: [PVE-User] Proxmox VE 3.2 released! I juts updated the API docs. Basically spiceproxy API changed from GET to POST (so you need to pass the CSRF token). ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE 3.2 released!
Damn ExtJS cache... Thank you Dietmar :) Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 De: Dietmar Maurer diet...@proxmox.com Enviado: martes, 11 de marzo de 2014 13:58 Para: Angel Docampo; Martin Maurer; Guy Cc: proxmoxve (pve-user@pve.proxmox.com) Asunto: RE: [PVE-User] Proxmox VE 3.2 released! Could you please put the link to the updated API docs? Or the place where those changes are reflected, because I still cannot see the changes or I'm seeing the outdated doc. http://pve.proxmox.com/pve2-api-doc/ ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE 3.2 released!
_ Best regards, Martin Maurer Proxmox VE project leader ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Proxmox VE 3.2 released!
El 10/03/14 14:41, Martin Maurer escribi: From: pve-user [mailto:pve-user-boun...@pve.proxmox.com] On Behalf Of Angel Docampo Sent: Montag, 10. Mrz 2014 14:31 To: Guy; Martin Maurer Cc: proxmoxve (pve-user@pve.proxmox.com); pve-de...@pve.proxmox.com Subject: Re: [PVE-User] Proxmox VE 3.2 released! I've upgraded only doing an "apt-get update; apt-get upgrade" without problems. Now, but, I have problems on a script I wrote to connect via spice to a single desktop using proxmoxer did you make some changes on the API, perhaps? Yes, see https://git.proxmox.com/?p=pve-manager.git;a=blob;f=spice-example-sh;h=45bfb131bc7e6c16fc1a4d4c893416984dff43a2;hb=b282dec20f48ed5ecbe13c85242ff3e943671380 Martin Mmm, that script is damn similar to my first one... now it has evolved to a python one, taking the benefits of proxmoxer wrapper (https://pypi.python.org/pypi/proxmoxer/0.1.4). Furthermore, the bash script does not work in a cluster and you do not know exactly in which node the VM is. That's why I used one of the nodes as a broker Anyway, the API documentation hasn't changed since months, so I guess you didn't change the API, don't ypu? -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
[PVE-User] Online migration leaves firewall vm without service
I would like to ask here if you suffer the same issue than me. When upgrading proxmox, I must move the virtual machines fron node to node in order to reboot the node. Everything works fine except for the firewalls I have virtualized. All of them, without exception, stop working. My laptop cannot ping the Internet and everything is restablished when I reboot the VM. Any of you have the same issue? There is some workaround? Thanks, -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 Nota Legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] System extremely slow when creating a VM...
El 24/02/14 21:22, Gilberto Nunes escribi: A note: I install PVE from ISO, no on top Debian Well, I never, a part from the very first time, installed PVE from ISO... and pveperf gave to me far worse results than yours CPU BOGOMIPS: 47999.36 REGEX/SECOND: 1153521 HD SIZE: 12.91 GB (/dev/mapper/pve02-root) BUFFERED READS: 69.72 MB/sec AVERAGE SEEK TIME: 0.26 ms FSYNCS/SECOND: 209.98 DNS EXT: 82.69 ms But I have no slowlyness when creating a VM, it is created instantly, so I guess -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
[PVE-User] Typeable combobox
Hi, As proxmox spice support works great, I began to implement it as VDI solution. I faced some kind of problem when assigning AD/LDAP users to a VM. The combobox to do that only interacts with the mouse and is not typeable, so when selecting one user amongst a thousand it's a bit slow, and if you need to set some users... well, I think it could be better if that combo would be typeable, and yet greater if as you're writing, it filters the possible results. I wrote this feature here because I do not know if I should open a feature request on bugzilla. If I must to do so, please, tell me. Regards, -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 Nota Legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] storage migration failed: mirroring error: VM xyz not running
Both in gluster and local? Then is not the allocsize mount option... I had an issue very similar toy you but I had XFS, I changed to ext4 and I solved it. Then I saw another guy who set allocsize=64k on his XFS and it also worked for him... but with ext3... :| Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 De: Giampaolo Bozzali Enviado: mi?rcoles, 19 de febrero de 2014 10:55 Para: Angel Docampo Cc: pve-user@pve.proxmox.com Asunto: Re: [PVE-User] storage migration failed: mirroring error: VM xyz not running 2014-02-19 10:48 GMT+01:00 Angel Docampo adoca...@dltec.netmailto:adoca...@dltec.net: What FS has under GlusterFS? XFS perhaps? no, it's an ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=0,data=ordered) -- Giampaolo Bozzali a.k.a Panda^(funk) - http://pandafunk.blogspot.com ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Memory
El 19/02/14 17:14, Diaolin escribió: Il 2014-02-19 17:06 ad...@extremeshok.com ha scritto: Talk about overselling Yeah! Very interesting In a similar case i didn't receive my room in an Italian Hotel but this is overBooking :-) Diaolin --- S’à destacà l’ultima föia dal bósch nét crodàda l’ei, solàgna, ‘n mèzz ai sàssi e ‘ntant fis-ciava ‘n zìfol de oseleti a tegnìr vìo ‘l pensér che vèn matìna [Diaolin] ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user I was wrong. The node has 128GB not 64. But anyway, it works perfect. Those VM are windows VDIs and rearely are all of them at 100% of RAM, so no, is not oversized, oversold nor overbooked :P -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] problems with 3.2-beta
El 02/02/14 19:00, Adam Thompson escribi: (This isn't really new...) SPICE continues to be a major PITA when running Ubuntu 12.04LTS as the management client. Hmm, I just found a PPA with virt-viewer packages that work. I should update the Wiki with that info, too. Do you have a spice sound working version? It seems that sound support is broken in ubuntu. -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] abort clone
El 28/01/14 12:14, Fábio Rabelo escribió: Hi to all I started a clone task, and after that everything are extremely slow ... I have to abort that command, and I do not find a way to do that How can I abort a clone task ? Fábio Rabelo ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user Hi, Mmmm, as far as I can see I do not see a "cancel". Perhaps killing the process? Doing ps -ef | grep clone and with the returning PID kill -9 PID Just my two cents. -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] GlusterFS VM failover
Hi there, Mmmm, if you use /etc/fstab or glusterfs client, you will be accessing the gluster via FUSE. And that s*cks. I do a trick on my proxmox cluster, as well gluster cluster. I do have one 10Gb interface dedicated to gluster on each node, and another 1Gb interface dedicated to proxmox cluster. So, in hosts, my config is more or less this one. #PROXMOX NODES 10.0.0.1 pve01 10.0.0.2 pve02 #GLUSTER NODE 192.168.100.10 g01 192.168.100.20 g02 Until this point, completely normal, now, on the first node (pve01/g01) y put on hosts 192.168.100.10 gluster And this other hosts line on node pve02/g02 192.168.100.20 gluster So, on proxmox GUI I mount gluster:VOLUMENAME. Each node mounts its own mountpoint and on the redhat cluster, the resource is called the same: gluster. Its a trick if your virtualization nodes are also storage nodes, which is my case. Hope it helps. El 28/01/14 17:41, Leslie-Alexandre DENIS escribi: Hello, As I think that I reply to my own question after searching in GlusterFS documentation, I'm wondering if anybody from Proxmox's staff here can guide me. In fact, GlusterFS has an option to specify a backup node to the primary one. In a replicated setup, it permits to be sure that the client points to the healthy node. It's specified in the mount command or /etc/fstab on the client side, like : # mount -t glusterfs -o backupvolfile-server=volfile_server2,fetchattempts= 2,log-level=WARNING,log-file=/var/log/gluster.log server1:/testvolume /mnt/glusterfs If backupvolfile-server option is added while mounting fuse client, when the first volfile server fails, then the server specified in backupvolfile-server option is used as volfile server to mount the client. Basically my question is : Where can I find the GlusterFS client mount entry on Promox ? And do you plan to implement that functionality in the GUI and qemu ? (It would be awesome) For anybody on that topic, you can find more information here : - http://www.jamescoyle.net/how-to/439-mount-a-glusterfs-volume or in the official Administration Guide Thanks, Regards ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Several issues with gluster as storage.
El 27/01/14 14:38, Leslie-Alexandre DENIS escribi: Hello Angel, Did you figure it out why you had timeout problem ? Yes, I did. The main problem was the underlying filesystem. I do not know why, but XFS does not thin provision the space of the hard disk when create the virtual machine. Then proxmox times out at 30 seconds, or so. Because it should be matter of one or two seconds. Changing it to ext4 solved the main problem. Another issue, even with ext4, was the timing when in the gluster cluster (2 nodes), there were one node down. There is a bug on gfapi that times out the proxmox cluster when trying to start a VM on that gluster storage. While gluster developers fix that bug. I lowered the value on /proc/sys/net/ipv4/tcp_syn_retries from 5 to 3 to reduce the time necessary to start the VM and now everything works, Regards Regards, Le 11/12/2013 17:28, Angel Docampo a crit : Hello, There is no special topology between the nodes, it's a 10Gb dedicated segment only for that purpose. To mount glusterfs into PVE you can follow this tutorial http://www.jamescoyle.net/how-to/533-glusterfs-storage-mount-in-proxmox That is the proxmox way, and it's supposed to not to use FUSE, but to use the gluster translator (correct me if I'm wrong) and therefore no mount options are needed. Regards, Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
[PVE-User] Several issues with gluster as storage.
Hi there, I'm having several problems with using gluster as a storage. I'm using a gluster replica 2 between two buildings, the connection is 10Gb. I can access gluster and write so far so good. But when using proxmox the problems arise... I cannot upload iso files (I think I've readed on the forum that its a bug) and in fact it's a minor issue. The problem comes when I want to create a VM. It takes a long time (I guess depending the hard disk size) and if I try to access via ssh when it is trying to create the VM, when I cd to the glusterfs mountpoint it seems to be stalled (I cannot do a double-tab for autocomplete the name, for instance). After a while, the GUI shows, TASK ERROR: create failed - unable to create image: got lock timeout - aborting command I can create the VM on a local storage (I didn't try a NFS share, iSCSI or another network destination) flawlessly, and then move the disk to the gluster storage without problems. I can even mount via FUSE the gluster and the I CAN create the VM on it (but it is considered then a local storage and I cannot do a live migration, etc). So, there is any problem with replicas? I tried on a distributed-only gluster on the lab and it worked perfect, but on my client's house I'm facing this... Any idea? I can post any log if you want, but I would also know your experience with this scenario. I have quite experience with gluster, so I'm pretty sure that this gluster is working as it should. Thank you everyone, Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 Nota Legalhttp://www.dltec.net/notalegal.html ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Several issues with gluster as storage.
Hello, There is no special topology between the nodes, it's a 10Gb dedicated segment only for that purpose. To mount glusterfs into PVE you can follow this tutorial http://www.jamescoyle.net/how-to/533-glusterfs-storage-mount-in-proxmox That is the proxmox way, and it's supposed to not to use FUSE, but to use the gluster translator (correct me if I'm wrong) and therefore no mount options are needed. Regards, Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 De: pve-user-boun...@pve.proxmox.com en nombre de Leslie-Alexandre DENIS Enviado: miércoles, 11 de diciembre de 2013 15:55 Para: pve-user@pve.proxmox.com Asunto: Re: [PVE-User] Several issues with gluster as storage. Hello, What kind of topology do you have between your replicas ? Maybe you have a congestion between them which results as a timeout on file creation. While on the topic I would love to know where is the mounting command of glusterfs into PVE architecture ? It can be very useful to tweak the mounting options like relatime or atime to increase performance. Regards Le 11/12/2013 15:13, Angel Docampo a écrit : Hi there, I'm having several problems with using gluster as a storage. I'm using a gluster replica 2 between two buildings, the connection is 10Gb. I can access gluster and write so far so good. But when using proxmox the problems arise... I cannot upload iso files (I think I've readed on the forum that its a bug) and in fact it's a minor issue. The problem comes when I want to create a VM. It takes a long time (I guess depending the hard disk size) and if I try to access via ssh when it is trying to create the VM, when I cd to the glusterfs mountpoint it seems to be stalled (I cannot do a double-tab for autocomplete the name, for instance). After a while, the GUI shows, TASK ERROR: create failed - unable to create image: got lock timeout - aborting command I can create the VM on a local storage (I didn't try a NFS share, iSCSI or another network destination) flawlessly, and then move the disk to the gluster storage without problems. I can even mount via FUSE the gluster and the I CAN create the VM on it (but it is considered then a local storage and I cannot do a live migration, etc). So, there is any problem with replicas? I tried on a distributed-only gluster on the lab and it worked perfect, but on my client's house I'm facing this... Any idea? I can post any log if you want, but I would also know your experience with this scenario. I have quite experience with gluster, so I'm pretty sure that this gluster is working as it should. Thank you everyone, Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93.476.69.10 - 6711 Nota Legalhttp://www.dltec.net/notalegal.html ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Spice and Proxmox VE
El 15/11/13 19:27, Gilberto Nunes escribi: So mean that I am able to create a local shortcut on my desktop, pointing to app installed on a VM hosted in a Proxmox VE??? That is it?? You'll need to write some code and play with the proxmox API in order to get a working "shorcut". It's quite easy, but for each connection, you will need to log into the proxmox and get a valid ticket, the the remote-viewer application will connect to the selected machine, create one from a template or whatever you need. Regards, -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] howto use gluster fs
El 15/11/13 20:16, Yoslan Raul Jimenez Carvajal escribi: hello someone with experience using GlusterFS to put 2 vm writing in a directory with gluster "Acreditando 30 aos de historia seguimos la marcha" ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user Hello, You mean using gluster as storage? Sure, no problem. Proxmox has the gluster client (and the server too), so If you have a gluster volume you can add this storage throught the GUI. Regards, -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Moving from XenServer to Proxmox... slowly
Hi, Here we user as third|quorum machine, a VMWare machine. It worked perfectly as far as it does not host any VM itself. To migrate linux machines, we created a new VM on proxmox, booted it up with a sysresCD and then netcat the whole system from the xen VM to the new PVE machine. Hope it helps, El 24/10/13 15:49, Gerald Brandt escribi: Hi, I'd considered that, but I'm having trouble finding a system that supports VT-d/VT-x. Any hiccups converting Xen to KVM? I imagine the Windows boxes will move easily enough, just using clonezilla or similar. The rest of my servers are Ubuntu based, and PVM's so I'll need to add a kernel, so I'm looking at http://www.blog.turmair.de/2010/12/xen-to-kvm-or-physical-vmware-migration/ Any performance issues? Gerald - Original Message - From: "Kurt Bauer" kurt.ba...@univie.ac.at To: "Gerald Brandt" g...@majentis.com Cc: pve-user@pve.proxmox.com Sent: Thursday, October 24, 2013 8:42:54 AM Subject: Re: [PVE-User] Moving from XenServer to Proxmox... slowly Hi, we did pretty much the same thing over the past weeks, ie. changing fom XEN to KVM (Proxmox) reusing the hardware already in place and production. But we didn't went down the 2-Node cluster road, what we did instead was, that we used an old server machine as a third node, just for the sake of quorum and not having to deal with all the problems, that may occur on a 2-Node cluster. No guests on that machine and as soon as the 3rd production machine was free, we added it to the cluster and removed the old one. I guess performance is not an issue for that 3rd machine, as long as it has no guests. Hope that helps a little, best regards, Kurt Gerald Brandt schrieb: Hi, We've pretty much made the decision to move from Citrix XenServer to KVM (Proxmox) for our Virtual solution. Unfortunately, I don't have all the computers available to me at the start, since migration will use the existing XenServer computers. To start, I'll have two servers, using a single iSCSI, in an HA cluster. Once they are running and some of the virtual machines are migrated, I can add a third server. Finally, I can add the fourth server. Is there anything I need to look out for when creating the 2 server HA cluster and then converting it to a 3 and 4 node cluster? Has anyone done this, and created a HOWTO I can follow? Thanks, Gerald ps: Been using Citrix XenServer since Jan 2009. We've had enough issues with VM disk corruption to haunt me for year (using LVMoveriSCSI). It's a bloody house of cards. ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Moving from XenServer to Proxmox... slowly
Hi Gerald, I'm pretty sure that were both full and paravirtualized machines, but primarily were HVM. Regards, El 24/10/13 16:17, Gerald Brandt escribió: Hi Angel, Were you transferring HVM or PVM servers to KVM? Gerald From: "Angel Docampo" adoca...@dltec.net To: pve-user@pve.proxmox.com Sent: Thursday, October 24, 2013 9:08:43 AM Subject: Re: [PVE-User] Moving from XenServer to Proxmox... slowly Hi, Here we user as third|quorum machine, a VMWare machine. It worked perfectly as far as it does not host any VM itself. To migrate linux machines, we created a new VM on proxmox, booted it up with a sysresCD and then netcat the whole system from the xen VM to the new PVE machine. Hope it helps, El 24/10/13 15:49, Gerald Brandt escribió: Hi, I'd considered that, but I'm having trouble finding a system that supports VT-d/VT-x. Any hiccups converting Xen to KVM? I imagine the Windows boxes will move easily enough, just using clonezilla or similar. The rest of my servers are Ubuntu based, and PVM's so I'll need to add a kernel, so I'm looking at http://www.blog.turmair.de/2010/12/xen-to-kvm-or-physical-vmware-migration/ Any performance issues? Gerald - Original Message - From: "Kurt Bauer" kurt.ba...@univie.ac.at To: "Gerald Brandt" g...@majentis.com Cc: pve-user@pve.proxmox.com Sent: Thursday, October 24, 2013 8:42:54 AM Subject: Re: [PVE-User] Moving from XenServer to Proxmox... slowly Hi, we did pretty much the same thing over the past weeks, ie. changing fom XEN to KVM (Proxmox) reusing the hardware already in place and production. But we didn't went down the 2-Node cluster road, what we did instead was, that we used an old server machine as a third node, just for the sake of quorum and not having to deal with all the problems, that may occur on a 2-Node cluster. No guests on that machine and as soon as the 3rd production machine was free, we added it to the cluster and removed the old one. I guess performance is not an issue for that 3rd machine, as long as it has no guests. Hope that helps a little, best regards, Kurt Gerald Brandt schrieb: Hi, We've pretty much made the decision to move from Citrix XenServer to KVM (Proxmox) for our Virtual solution. Unfortunately, I don't have all the computers available to me at the start, since migration will use the existing XenServer computers. To start, I'll have two servers, using a single iSCSI, in an HA cluster. Once they are running and some of the virtual machines are migrated, I can add a third server. Finally, I can add the fourth server. Is there anything I need to look out for when creating the 2 server HA cluster and then converting it to a 3 and 4 node cluster? Has anyone done this, and created a HOWTO I can follow? Thanks, Gerald ps: Been using Citrix XenServer since Jan 2009. We've had enough issues with VM disk corruption to haunt me for year (using LVMoveriSCSI). It's a bloody house of cards. ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 706 Mob. 670.299.381 ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- Angel Docampo Datalab Tecnologia, s.a. Castillejos, 352 - 08025 Barcelona Tel. 93 476 69 14 - Ext: 7
[PVE-User] Custom fencing scripts
Hi there, I wrote two scripts in order to turn off the nodes with my fence devices, two APC smart-ups 1400, accessible only via telnet or web and each connected to one node, and IBM bladecenter which blade9 is my third node. Those scripts have been tested and works in the command line. My question could be pretty dumb, but I didn't found it on the wiki or the forums. It's my first attempt to make fencing work, so I have some doubts you may resolve... Those two scripts are named fence_apc_expect and fence_bladecenter_expect, the first will have only one parameter, the IP of the mangement network interface of the UPS, and the second script, two parameters, the management network IP of the bladecenter and the number of the blade we want to turn off. I won't pass the user and password of the UPS/Bladecenter because they are embedded on the script. To make work them, must I place them on /usr/sbin/ and call them like if they were a normal fence agent? For example: fencedevices fencedevice agent=fence_apc_expect ipaddr=192.168.200.82 name=fenceap01/ fencedevice agent=fence_apc_expect ipaddr=192.168.200.85 name=fenceap03/ fencedevice agent=fence_bladecenter_expect ipaddr=192.168.199.106 name=fencebladecenter /fencedevices clusternode name=p01 votes=1 nodeid=1 fence method name=power device name=fenceap01/ /method /fence /clusternode clusternode name=p02 votes=1 nodeid=2 fence method name=power device port=9 name=chassis_fence/ /method /fence /clusternode clusternode name=p03 votes=1 nodeid=3 fence method name=power device name=fencep03/ /method /fence /clusternode That configuration will be ok? Thank you very much, -- Angel Docampo Nota Legalhttp://www.dltec.net/notalegal.html ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Custom fencing scripts
Oh, I see a typo on the p02 node definition, it should be like this. clusternode name=p02 votes=1 nodeid=2 fence method name=power device port=9 name=fencebladecenter/ /method /fence /clusternode On mié, 2 de oct 2013 a las 1:05 , Angel Docampo adoca...@dltec.net wrote: Hi there, I wrote two scripts in order to turn off the nodes with my fence devices, two APC smart-ups 1400, accessible only via telnet or web and each connected to one node, and IBM bladecenter which blade9 is my third node. Those scripts have been tested and works in the command line. My question could be pretty dumb, but I didn't found it on the wiki or the forums. It's my first attempt to make fencing work, so I have some doubts you may resolve... Those two scripts are named fence_apc_expect and fence_bladecenter_expect, the first will have only one parameter, the IP of the mangement network interface of the UPS, and the second script, two parameters, the management network IP of the bladecenter and the number of the blade we want to turn off. I won't pass the user and password of the UPS/Bladecenter because they are embedded on the script. To make work them, must I place them on /usr/sbin/ and call them like if they were a normal fence agent? For example: fencedevices fencedevice agent=fence_apc_expect ipaddr=192.168.200.82 name=fenceap01/ fencedevice agent=fence_apc_expect ipaddr=192.168.200.85 name=fenceap03/ fencedevice agent=fence_bladecenter_expect ipaddr=192.168.199.106 name=fencebladecenter /fencedevices clusternode name=p01 votes=1 nodeid=1 fence method name=power device name=fenceap01/ /method /fence /clusternode clusternode name=p02 votes=1 nodeid=2 fence method name=power device port=9 name=chassis_fence/ /method /fence /clusternode clusternode name=p03 votes=1 nodeid=3 fence method name=power device name=fencep03/ /method /fence /clusternode That configuration will be ok? Thank you very much, -- Angel Docampo Nota Legal ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Impossible to create two nodes cluster.
El 27/09/13 23:33, Ric Moore escribió: On 09/26/2013 09:26 AM, Angel Docampo wrote: El 26/09/13 15:16, Luis G. Coralle escribió: I think they should be in same network. How is configured the other proxmox cluster? 2013/9/26 Angel Docampo adoca...@dltec.net mailto:adoca...@dltec.net Everytime I need to create a cluster in proxmox I suffer a bit PITA. But now I simply can't do it. I've reinstalled several times and deleted and recreated the cluster again and again. No luck. Multicast does not work in this network, so I used unicast. There are another proxmox cluster in the same network and it's working (it was very painfull also to install, but once I realized the problem was unicast and the mtu size, it works very well, except when adding a node, that always is another pain). So, I would like to explain how I'm doing this and perhaps I'm pretty obfuscated to see what is happening. I've installed two debian 7.1, LVM partitions (not necessary, but I did it anyway), and installed proxmox. The servers works as expected separately. The server p01 have the IP: 192.168.200.197 The server p02 have the IP: 192.168.201.191 The two networks are visible each other, and as cluster protocol is udp, it should work. Am I wrong? Then on p01, I've created the cluster with pvecm create testcluster, it worked I've copied /etc/pve/cluster.conf to /etc/pve/cluster.conf.new, increased the version number and add transport=udpu to the cman section and added the section totem netmtu=1400 / (I tried without it also). Then I've activated the new configuration throught the GUI. I've double checked /etc/hosts to assure they resolve the names through this mechanism. Then on p02 I tried to add the node with pvecm add p01 (also tried with IP and also tried this command from p01, both with hostname and IP of the p02 node). root@p02:~# pvecm add p01 root@p01's password: copy corosync auth key stopping pve-cluster service Stopping pve cluster filesystem: pve-cluster. backup old database Starting pve cluster filesystem : pve-cluster. Starting cluster: Checking if cluster has been disabled at boot... [ OK ] Checking Network Manager... [ OK ] Global setup... [ OK ] Loading kernel modules... [ OK ] Mounting configfs... [ OK ] Starting cman... [ OK ] Waiting for quorum... [FAILED] Waiting for quorum... I had to issue, on the master, pvecm e 1 to resolve the quorum error. Running like a charm now. That is in the HOWTOS. Ric Thank you very much. It's not so easy, yet even /etc/pve now was writeable, and cluster.conf was the same in each node, it still showed a split brain situation. But your advice gave me some direction to investigate. I found that pvecm e 1 its the same than edit cluster.conf and add the parameter expected_votes=1 on directive cman. I also added the parameters transport=udpu (I have no multicast support) and two_node=1 and rebooted the main node. After that, I could add the second node and restart pve-cluster and cman daemons on both nodes (or restart the machines) in order to see them clustered. It has been pretty hard to made it work, but I think now I got the concepts. Thank you very much. -- Angel Docampo ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] New Kernel for Proxmox VE 3.1 and bug fixes
El 26/09/13 08:29, Martin Maurer escribió: Hi all, We released a new kernel for Proxmox VE 3.1 and a lot of fixes. All this can be updated via GUI with just a few clicks, or as always via apt-get update apt-get dist-upgrade. A big Thank-you to our active community for all feedback, testing, bug reporting and patch submissions. Perhaps a dumb question, but this upgrade is for everyone or only for paid customers? Because I have nothing to upgrade and I have the repos configured as written here http://pve.proxmox.com/wiki/Package_repositories#Proxmox_VE_No-Subscription_Repository Kind regards, -- Angel Docampo ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] empty page on web interface
El 26/09/13 10:52, Frederic Van Espen escribió: Hi, A while ago I installed a new node which I now wanted to validate and do some tests. However, when connecting to the webinterface (https://node:8006) I receive an empty page when using chromium. It present the warning about the certificate, and then just an empty page. In my iceweasel (debian's firefox) the page loads correctly. Anyone else ran into this? Try to delete the cache (Ctrl+Shift+Del) and reload. Regards -- Angel Docampo ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] empty page on web interface
El 26/09/13 11:45, Frederic Van Espen escribió: On 09/26/2013 10:54 AM, Angel Docampo wrote: Try to delete the cache (Ctrl+Shift+Del) and reload. Thanks, but no game :-( Frederic ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user Sorry, I've just reproduced the situation (by deleting all cluster information) and clearing the browser cache in chromium seems to work for me. -- Angel Docampo ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
[PVE-User] Impossible to create two nodes cluster.
Everytime I need to create a cluster in proxmox I suffer a bit PITA. But now I simply can't do it. I've reinstalled several times and deleted and recreated the cluster again and again. No luck. Multicast does not work in this network, so I used unicast. There are another proxmox cluster in the same network and it's working (it was very painfull also to install, but once I realized the problem was unicast and the mtu size, it works very well, except when adding a node, that always is another pain). So, I would like to explain how I'm doing this and perhaps I'm pretty obfuscated to see what is happening. I've installed two debian 7.1, LVM partitions (not necessary, but I did it anyway), and installed proxmox. The servers works as expected separately. The server p01 have the IP: 192.168.200.197 The server p02 have the IP: 192.168.201.191 The two networks are visible each other, and as cluster protocol is udp, it should work. Am I wrong? Then on p01, I've created the cluster with pvecm create testcluster, it worked I've copied /etc/pve/cluster.conf to /etc/pve/cluster.conf.new, increased the version number and add transport=udpu to the cman section and added the section totem netmtu=1400 / (I tried without it also). Then I've activated the new configuration throught the GUI. I've double checked /etc/hosts to assure they resolve the names through this mechanism. Then on p02 I tried to add the node with pvecm add p01 (also tried with IP and also tried this command from p01, both with hostname and IP of the p02 node). root@p02:~# pvecm add p01 root@p01's password: copy corosync auth key stopping pve-cluster service Stopping pve cluster filesystem: pve-cluster. backup old database Starting pve cluster filesystem : pve-cluster. Starting cluster: Checking if cluster has been disabled at boot... [ OK ] Checking Network Manager... [ OK ] Global setup... [ OK ] Loading kernel modules... [ OK ] Mounting configfs... [ OK ] Starting cman... [ OK ] Waiting for quorum... [FAILED] Waiting for quorum... Well, it never works. The node waits for a quorum forever. I can see the p02 node on the p01 GUI (with a red light), but I have no access. If I run: root@p01:~# pvecm status Version: 6.2.0 Config Version: 2 Cluster Name: testcluster Cluster Id: 692 Cluster Member: Yes Cluster Generation: 1276 Membership state: Cluster-Member Nodes: 1 Expected votes: 1 Total votes: 1 Node votes: 1 Quorum: 1 Active subsystems: 5 Flags: Ports Bound: 0 Node name: p01 Node ID: 1 Multicast addresses: 239.192.2.182 Node addresses: 192.168.200.197 root@p02:~# pvecm status Version: 6.2.0 Config Version: 2 Cluster Name: testcluster Cluster Id: 692 Cluster Member: Yes Cluster Generation: 24 Membership state: Cluster-Member Nodes: 1 Expected votes: 2 Total votes: 1 Node votes: 1 Quorum: 2 Activity blocked Active subsystems: 1 Flags: Ports Bound: 0 Node name: p02 Node ID: 2 Multicast addresses: 239.192.2.182 Node addresses: 192.168.201.191 root@p01:~# pvecm nodes Node Sts Inc JoinedName 1 M 1276 2013-09-26 13:02:19 p01 2 X 0 p02 root@p02:~# pvecm nodes Node Sts Inc Joined Name 1 X 0p01 2 M 24 2013-09-26 13:04:02 p02 And trying to access from p01 GUI to the local resources of p02, Appears the message can't open '/etc/pve/authkey.pub' - No such file or directory (401) As the /etc/pve/ mountpoint on p02 is a) read only and b) not the same than p01 (i.e: on p01 there are more files), and /etc/pve/authkey.pub is not in p02. Some help is very appretiated Regards, -- Angel Docampo Nota Legalhttp://www.dltec.net/notalegal.html ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Re: [PVE-User] Impossible to create two nodes cluster.
El 26/09/13 15:16, Luis G. Coralle escribió: I think they should be in same network. How is configured the other proxmox cluster? 2013/9/26 Angel Docampo adoca...@dltec.net mailto:adoca...@dltec.net Everytime I need to create a cluster in proxmox I suffer a bit PITA. But now I simply can't do it. I've reinstalled several times and deleted and recreated the cluster again and again. No luck. Multicast does not work in this network, so I used unicast. There are another proxmox cluster in the same network and it's working (it was very painfull also to install, but once I realized the problem was unicast and the mtu size, it works very well, except when adding a node, that always is another pain). So, I would like to explain how I'm doing this and perhaps I'm pretty obfuscated to see what is happening. I've installed two debian 7.1, LVM partitions (not necessary, but I did it anyway), and installed proxmox. The servers works as expected separately. The server p01 have the IP: 192.168.200.197 The server p02 have the IP: 192.168.201.191 The two networks are visible each other, and as cluster protocol is udp, it should work. Am I wrong? Then on p01, I've created the cluster with pvecm create testcluster, it worked I've copied /etc/pve/cluster.conf to /etc/pve/cluster.conf.new, increased the version number and add transport=udpu to the cman section and added the section totem netmtu=1400 / (I tried without it also). Then I've activated the new configuration throught the GUI. I've double checked /etc/hosts to assure they resolve the names through this mechanism. Then on p02 I tried to add the node with pvecm add p01 (also tried with IP and also tried this command from p01, both with hostname and IP of the p02 node). root@p02:~# pvecm add p01 root@p01's password: copy corosync auth key stopping pve-cluster service Stopping pve cluster filesystem: pve-cluster. backup old database Starting pve cluster filesystem : pve-cluster. Starting cluster: Checking if cluster has been disabled at boot... [ OK ] Checking Network Manager... [ OK ] Global setup... [ OK ] Loading kernel modules... [ OK ] Mounting configfs... [ OK ] Starting cman... [ OK ] Waiting for quorum... [FAILED] Waiting for quorum... Well, it never works. The node waits for a quorum forever. I can see the p02 node on the p01 GUI (with a red light), but I have no access. If I run: root@p01:~# pvecm status Version: 6.2.0 Config Version: 2 Cluster Name: testcluster Cluster Id: 692 Cluster Member: Yes Cluster Generation: 1276 Membership state: Cluster-Member Nodes: 1 Expected votes: 1 Total votes: 1 Node votes: 1 Quorum: 1 Active subsystems: 5 Flags: Ports Bound: 0 Node name: p01 Node ID: 1 Multicast addresses: 239.192.2.182 Node addresses: 192.168.200.197 root@p02:~# pvecm status Version: 6.2.0 Config Version: 2 Cluster Name: testcluster Cluster Id: 692 Cluster Member: Yes Cluster Generation: 24 Membership state: Cluster-Member Nodes: 1 Expected votes: 2 Total votes: 1 Node votes: 1 Quorum: 2 Activity blocked Active subsystems: 1 Flags: Ports Bound: 0 Node name: p02 Node ID: 2 Multicast addresses: 239.192.2.182 Node addresses: 192.168.201.191 root@p01:~# pvecm nodes Node Sts Inc JoinedName 1 M 1276 2013-09-26 13:02:19 p01 2 X 0 p02 root@p02:~# pvecm nodes Node Sts Inc Joined Name 1 X 0p01 2 M 24 2013-09-26 13:04:02 p02 And trying to access from p01 GUI to the local resources of p02, Appears the message can't open '/etc/pve/authkey.pub' - No such file or directory (401) As the /etc/pve/ mountpoint on p02 is a) read only and b) not the same than p01 (i.e: on p01 there are more files), and /etc/pve/authkey.pub is not in p02. Some help is very appretiated Regards, -- Angel Docampo Nota Legalhttp://www.dltec.net/notalegal.html ___ pve-user mailing list pve-user@pve.proxmox.com mailto:pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user -- Luis G. Coralle May be. Im not sure, but I think that I already mount once a proxmox cluster with nodes in two different networks... But the actual working cluster nodes
Re: [PVE-User] md installer?
I think, I may be wrong, that the Barebone Installer is not customizable at all, and won't be. If you want to customize your partition layout, you must install first Debian, and then add the proxmox repos and install it. As explained on the wiki. http://pve.proxmox.com/wiki/Install_Proxmox_VE_on_Debian_Wheezy I did it myself and is really painless, so I suggest to you to try out. Regards Angel Docampo De: pve-user-boun...@pve.proxmox.com [pve-user-boun...@pve.proxmox.com] en nombre de Paul Gray [g...@cs.uni.edu] Enviado: jueves, 04 de julio de 2013 3:49 Para: pve-user@pve.proxmox.com Asunto: [PVE-User] md installer? Has anyone put together their own version of an installer that supports software raid on the root partition, such as raid1 on /dev/md0 as root? (Is there any interest in this in the future?) ___ pve-user mailing list pve-user@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user