Re: Strange size of template from snapshot on XenServer
> up in commit “8a3fd10” it’s broken. During storage refactoring > > changes in > > > commit “8caf52c” optimization was done to send CopyCommand to > > Hypervisor > > > resource instead of SSVM. Now with commit “8a3fd10” it’s again > going > > to > > > SSVM so it’s working fine for first snapshot but broken for > linked > > snapshot. > > > > > > Regards, > > > Anshul > > > > > > On 04/11/17, 7:20 PM, "Rafael Weingärtner" < > > rafaelweingart...@gmail.com> > > > wrote: > > > > > > Anshul, I tried with ACS 4.5.2 where commit “8a3fd10” is > not > > present. > > > This > > > is the commit where Daan and I removed some code that > seemed > > (is? at > > > least > > > for me) logicless (https://github.com/apache/ > > cloudstack/pull/1124 and > > > https://github.com/apache/cloudstack/pull/1056). > > > > > > I tested with ACS 4.5.2, which I have in a test > environment. I > > have ACS > > > 4.5.2, NFS as the primary storage, and XenServer 6.5 as > hosts. I > > > managed to > > > reproduce the problem as Lotic is having. > > > > > > I spin up a VM, then I created a file of 2GB in this VM, > and > > later I > > > took a > > > snapshot of the root volume of it (the VM only has the root > > volume). > > > The > > > VHD “687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd” is the > first > > snapshot > > > of the > > > root volume. If I create a template from this snapshot, > > everything > > > works. I > > > created a new VM from the template of the first snapshot, > and it > > > worked, > > > and the 2GB file was there. Then, I returned for the first > VM > > (from > > > which I > > > took the snapshot), I created another 1GB file. Then I > stopped > > the VM > > > again > > > and took the second snapshot (27d37d21-13a6-488d-b2f0- > > > 0ac54236b83a.vhd). > > > The interesting thing here is that the file size reduced!? > And I > > also > > > noticed that there is no hierarchy in the VHDs files. I > tried to > > start > > > a VM > > > from a template that I created with the second snapshot, > and it > > did not > > > work as the problem Lotic is having. > > > > > > [root@xenserver-1 ~]# ls -lah > > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > snapshots/2/8/ > > > > total 6.9G > > > > drwxr-xr-x 2 root root 4.0K Nov 4 10:33 . > > > > drwxr-xr-x 3 root root 4.0K Nov 4 09:49 .. > > > > -rw-r--r-- 1 root root 3.2G Nov 4 10:38 > > > > 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > > > -rw-r--r-- 1 root root 3.7G Nov 4 09:55 > > > > 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > > snapshots/2/8/687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > > > vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > capacity=21474836480 > > > > size=3916767744 hidden=0 parent=none > > > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > > snapshots/2/8/27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > > > vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > capacity=21474836480 > > > > size=3420873216 hidden=0 parent=none > > > > > > > > > > > > > Was it not working way before “8a3fd10”?! I think we will > need > > help > > > from > > > more folks here to see if this is a problem that only > affects > > XenServer > > > deploym
Re: Strange size of template from snapshot on XenServer
g. > > > > I spin up a VM, then I created a file of 2GB in this VM, and > later I > > took a > > snapshot of the root volume of it (the VM only has the root > volume). > > The > > VHD “687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd” is the first > snapshot > > of the > > root volume. If I create a template from this snapshot, > everything > > works. I > > created a new VM from the template of the first snapshot, and it > > worked, > > and the 2GB file was there. Then, I returned for the first VM > (from > > which I > > took the snapshot), I created another 1GB file. Then I stopped > the VM > > again > > and took the second snapshot (27d37d21-13a6-488d-b2f0- > > 0ac54236b83a.vhd). > > The interesting thing here is that the file size reduced!? And I > also > > noticed that there is no hierarchy in the VHDs files. I tried to > start > > a VM > > from a template that I created with the second snapshot, and it > did not > > work as the problem Lotic is having. > > > > [root@xenserver-1 ~]# ls -lah > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > snapshots/2/8/ > > > total 6.9G > > > drwxr-xr-x 2 root root 4.0K Nov 4 10:33 . > > > drwxr-xr-x 3 root root 4.0K Nov 4 09:49 .. > > > -rw-r--r-- 1 root root 3.2G Nov 4 10:38 > > > 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > > -rw-r--r-- 1 root root 3.7G Nov 4 09:55 > > > 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > snapshots/2/8/687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > > vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > capacity=21474836480 > > > size=3916767744 hidden=0 parent=none > > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > snapshots/2/8/27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > > vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > capacity=21474836480 > > > size=3420873216 hidden=0 parent=none > > > > > > > > > Was it not working way before “8a3fd10”?! I think we will need > help > > from > > more folks here to see if this is a problem that only affects > XenServer > > deployments. I will also test on my 4.9.2.0 environment again to > see > > if I > > miss anything. > > > > On Thu, Nov 2, 2017 at 6:30 AM, Anshul Gangwar < > > anshul.gang...@accelerite.com> wrote: > > > > > Hi Lotic, > > > > > > Can you try with any release between 4.6 to 4.8 and see if > this bug > > is > > > there? > > > > > > Basically, any release which contains commit > > 2c4ea503f92bcf9c611f409d5cdecb42b0115b69 > > > and missing commit 8a3fd10. > > > > > > On 02/11/17, 1:14 AM, "Lotic Lists" > wrote: > > > > > > Rafael, I know and appreciate your help :) > > > > > > I recognize all effort of CloudStack community. > > > I think all admins use snapshot to backup your virtual > disks, I > > think > > > it is not a isolated problem. Imagine a crash on your storage > and > > you need > > > convert your snapshots to templates. > > > > > > Thanks > > > Marcelo > > > > > > -Original Message- > > > From: Rafael Weingärtner [mailto:rafaelweingartner@ > gmail.com] > > > Sent: quarta-feira, 1 de novembro de 2017 17:17 > > > To: dev@cloudstack.apache.org > > > Subject: Re: Strange size of template fr
Re: Strange size of template from snapshot on XenServer
ic is having. > > > > [root@xenserver-1 ~]# ls -lah > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > snapshots/2/8/ > > > total 6.9G > > > drwxr-xr-x 2 root root 4.0K Nov 4 10:33 . > > > drwxr-xr-x 3 root root 4.0K Nov 4 09:49 .. > > > -rw-r--r-- 1 root root 3.2G Nov 4 10:38 > > > 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > > -rw-r--r-- 1 root root 3.7G Nov 4 09:55 > > > 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > snapshots/2/8/687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > > vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > capacity=21474836480 > > > size=3916767744 hidden=0 parent=none > > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > > snapshots/2/8/27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > > vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > capacity=21474836480 > > > size=3420873216 hidden=0 parent=none > > > > > > > > > Was it not working way before “8a3fd10”?! I think we will need > help > > from > > more folks here to see if this is a problem that only affects > XenServer > > deployments. I will also test on my 4.9.2.0 environment again to > see > > if I > > miss anything. > > > > On Thu, Nov 2, 2017 at 6:30 AM, Anshul Gangwar < > > anshul.gang...@accelerite.com> wrote: > > > > > Hi Lotic, > > > > > > Can you try with any release between 4.6 to 4.8 and see if > this bug > > is > > > there? > > > > > > Basically, any release which contains commit > > 2c4ea503f92bcf9c611f409d5cdecb42b0115b69 > > > and missing commit 8a3fd10. > > > > > > On 02/11/17, 1:14 AM, "Lotic Lists" > wrote: > > > > > > Rafael, I know and appreciate your help :) > > > > > > I recognize all effort of CloudStack community. > > > I think all admins use snapshot to backup your virtual > disks, I > > think > > > it is not a isolated problem. Imagine a crash on your storage > and > > you need > > > convert your snapshots to templates. > > > > > > Thanks > > > Marcelo > > > > > > -Original Message- > > > From: Rafael Weingärtner [mailto:rafaelweingartner@ > gmail.com] > > > Sent: quarta-feira, 1 de novembro de 2017 17:17 > > > To: dev@cloudstack.apache.org > > > Subject: Re: Strange size of template from snapshot on > XenServer > > > > > > Well, I could not reproduce the problem in ACS 4.9.2.0. So, > > before > > > fixing anything, the person that might take on this should > first > > find the > > > root of the problem. > > > > > > I understand what you are saying that it is a critical > problem, > > but > > > you have to understand that this is an open-source and free > software. > > > > > > Having said that, ALL of my work here has been pro-bono; > even > > though I > > > am a committer and PMC, I am not willing to dive deeper into > this > > issue now > > > as it does not affect me. It does not mean that I would not > help > > people if > > > I have time, as you can notice whenever I have some free time > I try > > to be > > > around and guide or check things for other people in this list. > > > > > > If this is a huge problem for you right now, I suggest you > > looking for > > > companies that provide enterprise support for ACS. > > > > > > On Wed, Nov 1, 2017 at 7:35 PM, Lotic Lists < > li...@lotic.com.br> > > > wrote: > > > > > > > Hi Rafael > > > > > > > > Tested on ACS 4.5.2.2, 4.9.2.0,
Re: Strange size of template from snapshot on XenServer
> > Rafael, I know and appreciate your help :)
> >
> > I recognize all effort of CloudStack community.
> > I think all admins use snapshot to backup your virtual disks, I
> think
> > it is not a isolated problem. Imagine a crash on your storage and
> you need
> > convert your snapshots to templates.
> >
> > Thanks
> > Marcelo
> >
> > -Original Message-
> > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> > Sent: quarta-feira, 1 de novembro de 2017 17:17
> > To: dev@cloudstack.apache.org
> > Subject: Re: Strange size of template from snapshot on XenServer
> >
> > Well, I could not reproduce the problem in ACS 4.9.2.0. So,
> before
> > fixing anything, the person that might take on this should first
> find the
> > root of the problem.
> >
> > I understand what you are saying that it is a critical problem,
> but
> > you have to understand that this is an open-source and free
software.
> >
> > Having said that, ALL of my work here has been pro-bono; even
> though I
> > am a committer and PMC, I am not willing to dive deeper into this
> issue now
> > as it does not affect me. It does not mean that I would not help
> people if
> > I have time, as you can notice whenever I have some free time I try
> to be
> > around and guide or check things for other people in this list.
> >
> > If this is a huge problem for you right now, I suggest you
> looking for
> > companies that provide enterprise support for ACS.
> >
> > On Wed, Nov 1, 2017 at 7:35 PM, Lotic Lists
> > wrote:
> >
> > > Hi Rafael
> > >
> > > Tested on ACS 4.5.2.2, 4.9.2.0, 4.9.3.0 and 4.10. All versions
> with
> > > same issue
> > >
> > > Description and steps to reproduce
> > > https://issues.apache.org/jira/browse/CLOUDSTACK-10128
> > >
> > > Again, it is a critical problem for production environments.
> > >
> > > Regards
> > > Marcelo
> > >
> > > -Original Message-
> > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> > > Sent: terça-feira, 31 de outubro de 2017 17:10
> > > To: dev@cloudstack.apache.org
> > > Subject: Re: Strange size of template from snapshot on
> XenServer
> > >
> > > Yes, it is a big problem. I have not checked the code that
> creates
> > the
> > > template, but I am not sure if the problem you are
> experiencing is
> > > related to 9025. It might be a problem in some other place.
> > >
> > > My suggestion is for you to create a Jira ticket detailing the
> > > situation and wait until someone fixes it. Have you tested on
> ACS
> > > 4.10? If 4.9.2.0 works, it might be something that went only
> into
> > 4.9.3.0.
> > >
> > > On Tue, Oct 31, 2017 at 8:04 PM, Lotic Lists <
> li...@lotic.com.br>
> > wrote:
> > >
> > > > I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5
> with
> > all
> > > > patches and primary storage NFS, we have same problem
> > > >
> > > > - Snapshot files
> > > > [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/
> total
> > > > 2.8G
> > > > -rw-r--r-- 1 root root 1.7G Oct 31 16:48
> > > > cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd
> > > > <-- snap-base
> > > > -rw-r--r-- 1 root root 1.1G Oct 31 16:49
> > > > fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd
> > > > <-- snap-diff
> > > > https://i.imgur.com/bWupsAS.png
> > > >
> > > > [root@acs01 203]# m
Re: Strange size of template from snapshot on XenServer
r linked snapshot. > > Regards, > Anshul > > On 04/11/17, 7:20 PM, "Rafael Weingärtner" > wrote: > > Anshul, I tried with ACS 4.5.2 where commit “8a3fd10” is not present. > This > is the commit where Daan and I removed some code that seemed (is? at > least > for me) logicless (https://github.com/apache/cloudstack/pull/1124 and > https://github.com/apache/cloudstack/pull/1056). > > I tested with ACS 4.5.2, which I have in a test environment. I have ACS > 4.5.2, NFS as the primary storage, and XenServer 6.5 as hosts. I > managed to > reproduce the problem as Lotic is having. > > I spin up a VM, then I created a file of 2GB in this VM, and later I > took a > snapshot of the root volume of it (the VM only has the root volume). > The > VHD “687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd” is the first snapshot > of the > root volume. If I create a template from this snapshot, everything > works. I > created a new VM from the template of the first snapshot, and it > worked, > and the 2GB file was there. Then, I returned for the first VM (from > which I > took the snapshot), I created another 1GB file. Then I stopped the VM > again > and took the second snapshot (27d37d21-13a6-488d-b2f0- > 0ac54236b83a.vhd). > The interesting thing here is that the file size reduced!? And I also > noticed that there is no hierarchy in the VHDs files. I tried to start > a VM > from a template that I created with the second snapshot, and it did not > work as the problem Lotic is having. > > [root@xenserver-1 ~]# ls -lah > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/ > > total 6.9G > > drwxr-xr-x 2 root root 4.0K Nov 4 10:33 . > > drwxr-xr-x 3 root root 4.0K Nov 4 09:49 .. > > -rw-r--r-- 1 root root 3.2G Nov 4 10:38 > > 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > -rw-r--r-- 1 root root 3.7G Nov 4 09:55 > > 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > snapshots/2/8/687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > > vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd capacity=21474836480 > > size=3916767744 hidden=0 parent=none > > [root@xenserver-1 ~]# vhd-util scan -f -a -p > > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/ > snapshots/2/8/27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > > vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd capacity=21474836480 > > size=3420873216 hidden=0 parent=none > > > > > Was it not working way before “8a3fd10”?! I think we will need help > from > more folks here to see if this is a problem that only affects XenServer > deployments. I will also test on my 4.9.2.0 environment again to see > if I > miss anything. > > On Thu, Nov 2, 2017 at 6:30 AM, Anshul Gangwar < > anshul.gang...@accelerite.com> wrote: > > > Hi Lotic, > > > > Can you try with any release between 4.6 to 4.8 and see if this bug > is > > there? > > > > Basically, any release which contains commit > 2c4ea503f92bcf9c611f409d5cdecb42b0115b69 > > and missing commit 8a3fd10. > > > > On 02/11/17, 1:14 AM, "Lotic Lists" wrote: > > > > Rafael, I know and appreciate your help :) > > > > I recognize all effort of CloudStack community. > > I think all admins use snapshot to backup your virtual disks, I > think > > it is not a isolated problem. Imagine a crash on your storage and > you need > > convert your snapshots to templates. > > > > Thanks > > Marcelo > > > > -Original Message- > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > Sent: quarta-feira, 1 de novembro de 2017 17:17 > > To: dev@cloudstack.apache.org > > Subject: Re: Strange size of template from snapshot on XenServer > > > > Well, I could not reproduce the problem in ACS 4.9.2.0. So, > before > > fixing anything, the person that might take on this should first > find the > > root of the problem. > > > > I understand what you are saying that it is a critical problem, > but > > you have to understand that this is an open-source and free software. > > > > Having said that, ALL of my work here has been pro-bono; even > though I > > am a committer and PMC
Re: Strange size of template from snapshot on XenServer
Rafael, In ACS 4.5.2 you are facing issue due to XenServer version (was only
working on xenserver 6.2 with some patches) which got fixed in 4.6 with commit
2c4ea503f92bcf9c611f409d5cdecb42b0115b69. Now with code clean up in commit
“8a3fd10” it’s broken. During storage refactoring changes in commit “8caf52c”
optimization was done to send CopyCommand to Hypervisor resource instead of
SSVM. Now with commit “8a3fd10” it’s again going to SSVM so it’s working fine
for first snapshot but broken for linked snapshot.
Regards,
Anshul
On 04/11/17, 7:20 PM, "Rafael Weingärtner" wrote:
Anshul, I tried with ACS 4.5.2 where commit “8a3fd10” is not present. This
is the commit where Daan and I removed some code that seemed (is? at least
for me) logicless (https://github.com/apache/cloudstack/pull/1124 and
https://github.com/apache/cloudstack/pull/1056).
I tested with ACS 4.5.2, which I have in a test environment. I have ACS
4.5.2, NFS as the primary storage, and XenServer 6.5 as hosts. I managed to
reproduce the problem as Lotic is having.
I spin up a VM, then I created a file of 2GB in this VM, and later I took a
snapshot of the root volume of it (the VM only has the root volume). The
VHD “687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd” is the first snapshot of the
root volume. If I create a template from this snapshot, everything works. I
created a new VM from the template of the first snapshot, and it worked,
and the 2GB file was there. Then, I returned for the first VM (from which I
took the snapshot), I created another 1GB file. Then I stopped the VM again
and took the second snapshot (27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd).
The interesting thing here is that the file size reduced!? And I also
noticed that there is no hierarchy in the VHDs files. I tried to start a VM
from a template that I created with the second snapshot, and it did not
work as the problem Lotic is having.
[root@xenserver-1 ~]# ls -lah
> /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/
> total 6.9G
> drwxr-xr-x 2 root root 4.0K Nov 4 10:33 .
> drwxr-xr-x 3 root root 4.0K Nov 4 09:49 ..
> -rw-r--r-- 1 root root 3.2G Nov 4 10:38
> 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd
> -rw-r--r-- 1 root root 3.7G Nov 4 09:55
> 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd
> [root@xenserver-1 ~]# vhd-util scan -f -a -p
>
/var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd
> vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd capacity=21474836480
> size=3916767744 hidden=0 parent=none
> [root@xenserver-1 ~]# vhd-util scan -f -a -p
>
/var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd
> vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd capacity=21474836480
> size=3420873216 hidden=0 parent=none
>
Was it not working way before “8a3fd10”?! I think we will need help from
more folks here to see if this is a problem that only affects XenServer
deployments. I will also test on my 4.9.2.0 environment again to see if I
miss anything.
On Thu, Nov 2, 2017 at 6:30 AM, Anshul Gangwar <
anshul.gang...@accelerite.com> wrote:
> Hi Lotic,
>
> Can you try with any release between 4.6 to 4.8 and see if this bug is
> there?
>
> Basically, any release which contains commit
2c4ea503f92bcf9c611f409d5cdecb42b0115b69
> and missing commit 8a3fd10.
>
> On 02/11/17, 1:14 AM, "Lotic Lists" wrote:
>
> Rafael, I know and appreciate your help :)
>
> I recognize all effort of CloudStack community.
> I think all admins use snapshot to backup your virtual disks, I think
> it is not a isolated problem. Imagine a crash on your storage and you need
> convert your snapshots to templates.
>
> Thanks
> Marcelo
>
> -Original Message-
> From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com]
> Sent: quarta-feira, 1 de novembro de 2017 17:17
> To: dev@cloudstack.apache.org
> Subject: Re: Strange size of template from snapshot on XenServer
>
> Well, I could not reproduce the problem in ACS 4.9.2.0. So, before
> fixing anything, the person that might take on this should first find the
> root of the problem.
>
> I understand what you are saying that it is a critical problem, but
> you have to understand that this is an open-source and free software.
>
> Having said that, ALL of my work here has been pro-bono; even though I
> am a committer and PMC, I am not willing to dive deeper into this issue
RE: Strange size of template from snapshot on XenServer
Hi Anshul, Rafael, I tested on 4.8, 4.7 and 4.6. On all versions coalesce of snapshot works very well ACS 4.8.1.1 [root@acs01-4-8 secondary]# ls -lh /exports/secondary/snapshots/2/3/ total 4.0G -rw-r--r-- 1 root root 1.7G Nov 7 12:08 604a583e-82ee-4778-b01f-f2620561eb9b.vhd -rw-r--r-- 1 root root 1.1G Nov 7 12:10 e14a5bb4-a700-4fc0-b4bd-256b6b86a149.vhd [root@acs01-4-8 secondary]# ls -lh /exports/secondary/template/tmpl/2/202/ total 2.7G -rw-r--r-- 1 root root 2.7G Nov 7 12:12 a3c2edb9-c90c-47ef-a821-936d5ed05365.vhd -rw-rw-rw- 1 root root 343 Nov 7 12:12 template.properties ACS 4.7.1.1 [root@acs01-4-7 secondary]# ls -lhrt /exports/secondary/snapshots/2/3/ total 2.8G -rw-r--r-- 1 root root 1.7G Nov 7 12:49 eee72b96-78f1-4ac9-acac-6cc8fd3eccd2.vhd -rw-r--r-- 1 root root 1.1G Nov 7 12:50 e33c2ec9-6071-4f18-94e4-739f25a2dfb4.vhd [root@acs01-4-7 secondary]# ls -lhrt /exports/secondary/template/tmpl/2/202/ total 4.0G -rw-r--r-- 1 root root 2.7G Nov 7 12:51 cbb90ec3-c512-4712-8386-fa9518d29707.vhd -rw-rw-rw- 1 root root 343 Nov 7 12:51 template.properties ACS 4.6.2.1 [root@acs01-4-6 secondary]# ls -lhrt /exports/secondary/snapshots/2/3/ total 4.0G -rw-r--r-- 1 root root 1.7G Nov 7 13:37 50aeb3d6-b159-416b-b565-133758f7db1a.vhd -rw-r--r-- 1 root root 1.1G Nov 7 13:38 98c492f9-c43d-4c96-a79c-13d9fb3d6f0f.vhd [root@acs01-4-6 secondary]# ls -lhrt /exports/secondary/template/tmpl/2/202/ total 4.0G -rw-r--r-- 1 root root 2.7G Nov 7 13:39 3765caa1-3987-4ab7-95c9-a117313f0564.vhd -rw-rw-rw- 1 root root 343 Nov 7 13:39 template.properties Regards Marcelo -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: sábado, 4 de novembro de 2017 11:50 To: dev@cloudstack.apache.org Subject: Re: Strange size of template from snapshot on XenServer Anshul, I tried with ACS 4.5.2 where commit “8a3fd10” is not present. This is the commit where Daan and I removed some code that seemed (is? at least for me) logicless (https://github.com/apache/cloudstack/pull/1124 and https://github.com/apache/cloudstack/pull/1056). I tested with ACS 4.5.2, which I have in a test environment. I have ACS 4.5.2, NFS as the primary storage, and XenServer 6.5 as hosts. I managed to reproduce the problem as Lotic is having. I spin up a VM, then I created a file of 2GB in this VM, and later I took a snapshot of the root volume of it (the VM only has the root volume). The VHD “687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd” is the first snapshot of the root volume. If I create a template from this snapshot, everything works. I created a new VM from the template of the first snapshot, and it worked, and the 2GB file was there. Then, I returned for the first VM (from which I took the snapshot), I created another 1GB file. Then I stopped the VM again and took the second snapshot (27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd). The interesting thing here is that the file size reduced!? And I also noticed that there is no hierarchy in the VHDs files. I tried to start a VM from a template that I created with the second snapshot, and it did not work as the problem Lotic is having. [root@xenserver-1 ~]# ls -lah > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/ > total 6.9G > drwxr-xr-x 2 root root 4.0K Nov 4 10:33 . > drwxr-xr-x 3 root root 4.0K Nov 4 09:49 .. > -rw-r--r-- 1 root root 3.2G Nov 4 10:38 > 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > -rw-r--r-- 1 root root 3.7G Nov 4 09:55 > 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > [root@xenserver-1 ~]# vhd-util scan -f -a -p > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/68 > 7f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd capacity=21474836480 > size=3916767744 hidden=0 parent=none > [root@xenserver-1 ~]# vhd-util scan -f -a -p > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/27 > d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd capacity=21474836480 > size=3420873216 hidden=0 parent=none > Was it not working way before “8a3fd10”?! I think we will need help from more folks here to see if this is a problem that only affects XenServer deployments. I will also test on my 4.9.2.0 environment again to see if I miss anything. On Thu, Nov 2, 2017 at 6:30 AM, Anshul Gangwar < anshul.gang...@accelerite.com> wrote: > Hi Lotic, > > Can you try with any release between 4.6 to 4.8 and see if this bug is > there? > > Basically, any release which contains commit > 2c4ea503f92bcf9c611f409d5cdecb42b0115b69 > and missing commit 8a3fd10. > > On 02/11/17, 1:14 AM, "Lotic Lists" wrote: > > Rafael, I know and appreciate your help :) > > I recognize all effort of CloudStack community. > I think all admins use snapshot to backup your virtual disks, I >
Re: Strange size of template from snapshot on XenServer
Anshul, I tried with ACS 4.5.2 where commit “8a3fd10” is not present. This is the commit where Daan and I removed some code that seemed (is? at least for me) logicless (https://github.com/apache/cloudstack/pull/1124 and https://github.com/apache/cloudstack/pull/1056). I tested with ACS 4.5.2, which I have in a test environment. I have ACS 4.5.2, NFS as the primary storage, and XenServer 6.5 as hosts. I managed to reproduce the problem as Lotic is having. I spin up a VM, then I created a file of 2GB in this VM, and later I took a snapshot of the root volume of it (the VM only has the root volume). The VHD “687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd” is the first snapshot of the root volume. If I create a template from this snapshot, everything works. I created a new VM from the template of the first snapshot, and it worked, and the 2GB file was there. Then, I returned for the first VM (from which I took the snapshot), I created another 1GB file. Then I stopped the VM again and took the second snapshot (27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd). The interesting thing here is that the file size reduced!? And I also noticed that there is no hierarchy in the VHDs files. I tried to start a VM from a template that I created with the second snapshot, and it did not work as the problem Lotic is having. [root@xenserver-1 ~]# ls -lah > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/ > total 6.9G > drwxr-xr-x 2 root root 4.0K Nov 4 10:33 . > drwxr-xr-x 3 root root 4.0K Nov 4 09:49 .. > -rw-r--r-- 1 root root 3.2G Nov 4 10:38 > 27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > -rw-r--r-- 1 root root 3.7G Nov 4 09:55 > 687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > [root@xenserver-1 ~]# vhd-util scan -f -a -p > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd > vhd=687f86f2-1aee-4e90-a64a-3b3c28376fcd.vhd capacity=21474836480 > size=3916767744 hidden=0 parent=none > [root@xenserver-1 ~]# vhd-util scan -f -a -p > /var/cloud_mount/963e9072-0fa1-3448-bf48-ffde1f522104/snapshots/2/8/27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd > vhd=27d37d21-13a6-488d-b2f0-0ac54236b83a.vhd capacity=21474836480 > size=3420873216 hidden=0 parent=none > Was it not working way before “8a3fd10”?! I think we will need help from more folks here to see if this is a problem that only affects XenServer deployments. I will also test on my 4.9.2.0 environment again to see if I miss anything. On Thu, Nov 2, 2017 at 6:30 AM, Anshul Gangwar < anshul.gang...@accelerite.com> wrote: > Hi Lotic, > > Can you try with any release between 4.6 to 4.8 and see if this bug is > there? > > Basically, any release which contains commit > 2c4ea503f92bcf9c611f409d5cdecb42b0115b69 > and missing commit 8a3fd10. > > On 02/11/17, 1:14 AM, "Lotic Lists" wrote: > > Rafael, I know and appreciate your help :) > > I recognize all effort of CloudStack community. > I think all admins use snapshot to backup your virtual disks, I think > it is not a isolated problem. Imagine a crash on your storage and you need > convert your snapshots to templates. > > Thanks > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: quarta-feira, 1 de novembro de 2017 17:17 > To: dev@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > Well, I could not reproduce the problem in ACS 4.9.2.0. So, before > fixing anything, the person that might take on this should first find the > root of the problem. > > I understand what you are saying that it is a critical problem, but > you have to understand that this is an open-source and free software. > > Having said that, ALL of my work here has been pro-bono; even though I > am a committer and PMC, I am not willing to dive deeper into this issue now > as it does not affect me. It does not mean that I would not help people if > I have time, as you can notice whenever I have some free time I try to be > around and guide or check things for other people in this list. > > If this is a huge problem for you right now, I suggest you looking for > companies that provide enterprise support for ACS. > > On Wed, Nov 1, 2017 at 7:35 PM, Lotic Lists > wrote: > > > Hi Rafael > > > > Tested on ACS 4.5.2.2, 4.9.2.0, 4.9.3.0 and 4.10. All versions with > > same issue > > > > Description and steps to reproduce > > https://issues.apache.org/jira/browse/CLOUDSTACK-10128 > > > > Again, it is a critical problem for production environments. > > > > Regards > > Marcelo > > > > -Original Message- > &g
Re: Strange size of template from snapshot on XenServer
Hi Lotic, Can you try with any release between 4.6 to 4.8 and see if this bug is there? Basically, any release which contains commit 2c4ea503f92bcf9c611f409d5cdecb42b0115b69 and missing commit 8a3fd10. On 02/11/17, 1:14 AM, "Lotic Lists" wrote: Rafael, I know and appreciate your help :) I recognize all effort of CloudStack community. I think all admins use snapshot to backup your virtual disks, I think it is not a isolated problem. Imagine a crash on your storage and you need convert your snapshots to templates. Thanks Marcelo -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: quarta-feira, 1 de novembro de 2017 17:17 To: dev@cloudstack.apache.org Subject: Re: Strange size of template from snapshot on XenServer Well, I could not reproduce the problem in ACS 4.9.2.0. So, before fixing anything, the person that might take on this should first find the root of the problem. I understand what you are saying that it is a critical problem, but you have to understand that this is an open-source and free software. Having said that, ALL of my work here has been pro-bono; even though I am a committer and PMC, I am not willing to dive deeper into this issue now as it does not affect me. It does not mean that I would not help people if I have time, as you can notice whenever I have some free time I try to be around and guide or check things for other people in this list. If this is a huge problem for you right now, I suggest you looking for companies that provide enterprise support for ACS. On Wed, Nov 1, 2017 at 7:35 PM, Lotic Lists wrote: > Hi Rafael > > Tested on ACS 4.5.2.2, 4.9.2.0, 4.9.3.0 and 4.10. All versions with > same issue > > Description and steps to reproduce > https://issues.apache.org/jira/browse/CLOUDSTACK-10128 > > Again, it is a critical problem for production environments. > > Regards > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: terça-feira, 31 de outubro de 2017 17:10 > To: dev@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > Yes, it is a big problem. I have not checked the code that creates the > template, but I am not sure if the problem you are experiencing is > related to 9025. It might be a problem in some other place. > > My suggestion is for you to create a Jira ticket detailing the > situation and wait until someone fixes it. Have you tested on ACS > 4.10? If 4.9.2.0 works, it might be something that went only into 4.9.3.0. > > On Tue, Oct 31, 2017 at 8:04 PM, Lotic Lists wrote: > > > I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5 with all > > patches and primary storage NFS, we have same problem > > > > - Snapshot files > > [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/ total > > 2.8G > > -rw-r--r-- 1 root root 1.7G Oct 31 16:48 > > cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd > > <-- snap-base > > -rw-r--r-- 1 root root 1.1G Oct 31 16:49 > > fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > <-- snap-diff > > https://i.imgur.com/bWupsAS.png > > > > [root@acs01 203]# md5sum /exports/secondary/snapshots/ > > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/snapshots/ > > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > > > - Template files > > [root@acs01 203]# ls -lh /exports/secondary/template/tmpl/2/203 > > total 2.0G > > -rw-r--r-- 1 root root 1.1G Oct 31 16:50 e9def45d-1b9e-4c2e-b843- > > 852fe40f00b2.vhd > > -rw-r--r-- 1 root root 303 Oct 31 16:50 template.properties > > > > [root@acs01 203]# md5sum /exports/secondary/template/ > > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/template/ > > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > > > It's a huge problem!!! I think issue 9025 is not resolved > > > > Regards > > Marcelo > > > > -Original Message- > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > Sent: terça-feira, 31 de outubro de 2017 16:00 > > To: us...@cloudstack.apache.org > > Subject: Re: Strange size of template from snapshot on XenServer > > > > Well, reading the descr
RE: Strange size of template from snapshot on XenServer
Rafael, I know and appreciate your help :) I recognize all effort of CloudStack community. I think all admins use snapshot to backup your virtual disks, I think it is not a isolated problem. Imagine a crash on your storage and you need convert your snapshots to templates. Thanks Marcelo -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: quarta-feira, 1 de novembro de 2017 17:17 To: dev@cloudstack.apache.org Subject: Re: Strange size of template from snapshot on XenServer Well, I could not reproduce the problem in ACS 4.9.2.0. So, before fixing anything, the person that might take on this should first find the root of the problem. I understand what you are saying that it is a critical problem, but you have to understand that this is an open-source and free software. Having said that, ALL of my work here has been pro-bono; even though I am a committer and PMC, I am not willing to dive deeper into this issue now as it does not affect me. It does not mean that I would not help people if I have time, as you can notice whenever I have some free time I try to be around and guide or check things for other people in this list. If this is a huge problem for you right now, I suggest you looking for companies that provide enterprise support for ACS. On Wed, Nov 1, 2017 at 7:35 PM, Lotic Lists wrote: > Hi Rafael > > Tested on ACS 4.5.2.2, 4.9.2.0, 4.9.3.0 and 4.10. All versions with > same issue > > Description and steps to reproduce > https://issues.apache.org/jira/browse/CLOUDSTACK-10128 > > Again, it is a critical problem for production environments. > > Regards > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: terça-feira, 31 de outubro de 2017 17:10 > To: dev@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > Yes, it is a big problem. I have not checked the code that creates the > template, but I am not sure if the problem you are experiencing is > related to 9025. It might be a problem in some other place. > > My suggestion is for you to create a Jira ticket detailing the > situation and wait until someone fixes it. Have you tested on ACS > 4.10? If 4.9.2.0 works, it might be something that went only into 4.9.3.0. > > On Tue, Oct 31, 2017 at 8:04 PM, Lotic Lists wrote: > > > I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5 with all > > patches and primary storage NFS, we have same problem > > > > - Snapshot files > > [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/ total > > 2.8G > > -rw-r--r-- 1 root root 1.7G Oct 31 16:48 > > cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd > > <-- snap-base > > -rw-r--r-- 1 root root 1.1G Oct 31 16:49 > > fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > <-- snap-diff > > https://i.imgur.com/bWupsAS.png > > > > [root@acs01 203]# md5sum /exports/secondary/snapshots/ > > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/snapshots/ > > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > > > - Template files > > [root@acs01 203]# ls -lh /exports/secondary/template/tmpl/2/203 > > total 2.0G > > -rw-r--r-- 1 root root 1.1G Oct 31 16:50 e9def45d-1b9e-4c2e-b843- > > 852fe40f00b2.vhd > > -rw-r--r-- 1 root root 303 Oct 31 16:50 template.properties > > > > [root@acs01 203]# md5sum /exports/secondary/template/ > > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/template/ > > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > > > It's a huge problem!!! I think issue 9025 is not resolved > > > > Regards > > Marcelo > > > > -Original Message- > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > Sent: terça-feira, 31 de outubro de 2017 16:00 > > To: us...@cloudstack.apache.org > > Subject: Re: Strange size of template from snapshot on XenServer > > > > Well, reading the description of the issue it seems to be related to > > the problem you are describing. However, I compared the classes that > > were changed with PR > > (https://github.com/apache/cloudstack/pull/1176) > > and they are the same in ACS 4.9.2.0 and 4.9.3.0. > > > > On Tue, Oct 31, 2017 at 6:36 PM, Lotic Lists wrote: > > > > > Hi Rafael, thanks for test. > > > > > > I found the issue > > > https://issues.apache.org/jira/browse/CLOUDSTACK-9025 > > > I think is a same case. I will up a new lab environment now for > > > simulate the issue > > >
Re: Strange size of template from snapshot on XenServer
Well, I could not reproduce the problem in ACS 4.9.2.0. So, before fixing anything, the person that might take on this should first find the root of the problem. I understand what you are saying that it is a critical problem, but you have to understand that this is an open-source and free software. Having said that, ALL of my work here has been pro-bono; even though I am a committer and PMC, I am not willing to dive deeper into this issue now as it does not affect me. It does not mean that I would not help people if I have time, as you can notice whenever I have some free time I try to be around and guide or check things for other people in this list. If this is a huge problem for you right now, I suggest you looking for companies that provide enterprise support for ACS. On Wed, Nov 1, 2017 at 7:35 PM, Lotic Lists wrote: > Hi Rafael > > Tested on ACS 4.5.2.2, 4.9.2.0, 4.9.3.0 and 4.10. All versions with same > issue > > Description and steps to reproduce > https://issues.apache.org/jira/browse/CLOUDSTACK-10128 > > Again, it is a critical problem for production environments. > > Regards > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: terça-feira, 31 de outubro de 2017 17:10 > To: dev@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > Yes, it is a big problem. I have not checked the code that creates the > template, but I am not sure if the problem you are experiencing is related > to 9025. It might be a problem in some other place. > > My suggestion is for you to create a Jira ticket detailing the situation > and wait until someone fixes it. Have you tested on ACS 4.10? If 4.9.2.0 > works, it might be something that went only into 4.9.3.0. > > On Tue, Oct 31, 2017 at 8:04 PM, Lotic Lists wrote: > > > I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5 with all > > patches and primary storage NFS, we have same problem > > > > - Snapshot files > > [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/ total 2.8G > > -rw-r--r-- 1 root root 1.7G Oct 31 16:48 > > cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd > > <-- snap-base > > -rw-r--r-- 1 root root 1.1G Oct 31 16:49 > > fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > <-- snap-diff > > https://i.imgur.com/bWupsAS.png > > > > [root@acs01 203]# md5sum /exports/secondary/snapshots/ > > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/snapshots/ > > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > > > - Template files > > [root@acs01 203]# ls -lh /exports/secondary/template/tmpl/2/203 > > total 2.0G > > -rw-r--r-- 1 root root 1.1G Oct 31 16:50 e9def45d-1b9e-4c2e-b843- > > 852fe40f00b2.vhd > > -rw-r--r-- 1 root root 303 Oct 31 16:50 template.properties > > > > [root@acs01 203]# md5sum /exports/secondary/template/ > > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/template/ > > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > > > It's a huge problem!!! I think issue 9025 is not resolved > > > > Regards > > Marcelo > > > > -Original Message- > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > Sent: terça-feira, 31 de outubro de 2017 16:00 > > To: us...@cloudstack.apache.org > > Subject: Re: Strange size of template from snapshot on XenServer > > > > Well, reading the description of the issue it seems to be related to > > the problem you are describing. However, I compared the classes that > > were changed with PR (https://github.com/apache/cloudstack/pull/1176) > > and they are the same in ACS 4.9.2.0 and 4.9.3.0. > > > > On Tue, Oct 31, 2017 at 6:36 PM, Lotic Lists wrote: > > > > > Hi Rafael, thanks for test. > > > > > > I found the issue > > > https://issues.apache.org/jira/browse/CLOUDSTACK-9025 > > > I think is a same case. I will up a new lab environment now for > > > simulate the issue > > > > > > Regards. > > > Marcelo > > > > > > -Original Message- > > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > > Sent: segunda-feira, 30 de outubro de 2017 12:08 > > > To: us...@cloudstack.apache.org > > > Subject: Re: Strange size of template from snapshot on XenServer > > > > > > I just did, and the size of the template is the size of the root > > > disk > > > + the 1GB file I created in the test vm. > > > > > >
RE: Strange size of template from snapshot on XenServer
Hi Rafael Tested on ACS 4.5.2.2, 4.9.2.0, 4.9.3.0 and 4.10. All versions with same issue Description and steps to reproduce https://issues.apache.org/jira/browse/CLOUDSTACK-10128 Again, it is a critical problem for production environments. Regards Marcelo -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: terça-feira, 31 de outubro de 2017 17:10 To: dev@cloudstack.apache.org Subject: Re: Strange size of template from snapshot on XenServer Yes, it is a big problem. I have not checked the code that creates the template, but I am not sure if the problem you are experiencing is related to 9025. It might be a problem in some other place. My suggestion is for you to create a Jira ticket detailing the situation and wait until someone fixes it. Have you tested on ACS 4.10? If 4.9.2.0 works, it might be something that went only into 4.9.3.0. On Tue, Oct 31, 2017 at 8:04 PM, Lotic Lists wrote: > I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5 with all > patches and primary storage NFS, we have same problem > > - Snapshot files > [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/ total 2.8G > -rw-r--r-- 1 root root 1.7G Oct 31 16:48 > cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd > <-- snap-base > -rw-r--r-- 1 root root 1.1G Oct 31 16:49 > fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > <-- snap-diff > https://i.imgur.com/bWupsAS.png > > [root@acs01 203]# md5sum /exports/secondary/snapshots/ > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/snapshots/ > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > - Template files > [root@acs01 203]# ls -lh /exports/secondary/template/tmpl/2/203 > total 2.0G > -rw-r--r-- 1 root root 1.1G Oct 31 16:50 e9def45d-1b9e-4c2e-b843- > 852fe40f00b2.vhd > -rw-r--r-- 1 root root 303 Oct 31 16:50 template.properties > > [root@acs01 203]# md5sum /exports/secondary/template/ > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/template/ > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > It's a huge problem!!! I think issue 9025 is not resolved > > Regards > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: terça-feira, 31 de outubro de 2017 16:00 > To: us...@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > Well, reading the description of the issue it seems to be related to > the problem you are describing. However, I compared the classes that > were changed with PR (https://github.com/apache/cloudstack/pull/1176) > and they are the same in ACS 4.9.2.0 and 4.9.3.0. > > On Tue, Oct 31, 2017 at 6:36 PM, Lotic Lists wrote: > > > Hi Rafael, thanks for test. > > > > I found the issue > > https://issues.apache.org/jira/browse/CLOUDSTACK-9025 > > I think is a same case. I will up a new lab environment now for > > simulate the issue > > > > Regards. > > Marcelo > > > > -----Original Message- > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > Sent: segunda-feira, 30 de outubro de 2017 12:08 > > To: us...@cloudstack.apache.org > > Subject: Re: Strange size of template from snapshot on XenServer > > > > I just did, and the size of the template is the size of the root > > disk > > + the 1GB file I created in the test vm. > > > > The system I tested this is an ACS 4.9.2, XenServer 6.5, Primary Stg > > ISCSI > > > > On Mon, Oct 30, 2017 at 10:20 AM, Lotic Lists > wrote: > > > > > Good morning > > > > > > Guys, who could execute the test below? > > > > > > 1. Create a manual snapshot of a volume 2. Create a file (1GB) > > > with dd on VM 3. Create second snapshot of a volume 4. Convert > > > latest snapshot to a template 5. Verify the size of vhd of new > > > template in secondary storage. > > > > > > Here the template have 1GB, exactly the size of latest snapshot. > > > > > > ACS 4.9.3, XenServer 6.5, Primary Stg ISCSI > > > > > > > > > -Original Message- > > > From: Lotic Lists [mailto:li...@lotic.com.br] > > > Sent: quinta-feira, 26 de outubro de 2017 15:03 > > > To: us...@cloudstack.apache.org > > > Subject: RE: Strange size of template from snapshot on XenServer > > > > > > I test the same case on other environment, create template from > > > snapshot, acs 4.9.2.0 and XenServer 6.5/iscsi > > > > > > 1. Was created two snapshots > > >
Re: Strange size of template from snapshot on XenServer
Yes, it is a big problem. I have not checked the code that creates the template, but I am not sure if the problem you are experiencing is related to 9025. It might be a problem in some other place. My suggestion is for you to create a Jira ticket detailing the situation and wait until someone fixes it. Have you tested on ACS 4.10? If 4.9.2.0 works, it might be something that went only into 4.9.3.0. On Tue, Oct 31, 2017 at 8:04 PM, Lotic Lists wrote: > I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5 with all > patches and primary storage NFS, we have same problem > > - Snapshot files > [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/ > total 2.8G > -rw-r--r-- 1 root root 1.7G Oct 31 16:48 > cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd > <-- snap-base > -rw-r--r-- 1 root root 1.1G Oct 31 16:49 > fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > <-- snap-diff > https://i.imgur.com/bWupsAS.png > > [root@acs01 203]# md5sum /exports/secondary/snapshots/ > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/snapshots/ > 2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd > > - Template files > [root@acs01 203]# ls -lh /exports/secondary/template/tmpl/2/203 > total 2.0G > -rw-r--r-- 1 root root 1.1G Oct 31 16:50 e9def45d-1b9e-4c2e-b843- > 852fe40f00b2.vhd > -rw-r--r-- 1 root root 303 Oct 31 16:50 template.properties > > [root@acs01 203]# md5sum /exports/secondary/template/ > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/template/ > tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd > > It's a huge problem!!! I think issue 9025 is not resolved > > Regards > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: terça-feira, 31 de outubro de 2017 16:00 > To: us...@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > Well, reading the description of the issue it seems to be related to the > problem you are describing. However, I compared the classes that were > changed with PR (https://github.com/apache/cloudstack/pull/1176) and they > are the same in ACS 4.9.2.0 and 4.9.3.0. > > On Tue, Oct 31, 2017 at 6:36 PM, Lotic Lists wrote: > > > Hi Rafael, thanks for test. > > > > I found the issue > > https://issues.apache.org/jira/browse/CLOUDSTACK-9025 > > I think is a same case. I will up a new lab environment now for > > simulate the issue > > > > Regards. > > Marcelo > > > > -Original Message- > > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > > Sent: segunda-feira, 30 de outubro de 2017 12:08 > > To: us...@cloudstack.apache.org > > Subject: Re: Strange size of template from snapshot on XenServer > > > > I just did, and the size of the template is the size of the root disk > > + the 1GB file I created in the test vm. > > > > The system I tested this is an ACS 4.9.2, XenServer 6.5, Primary Stg > > ISCSI > > > > On Mon, Oct 30, 2017 at 10:20 AM, Lotic Lists > wrote: > > > > > Good morning > > > > > > Guys, who could execute the test below? > > > > > > 1. Create a manual snapshot of a volume 2. Create a file (1GB) with > > > dd on VM 3. Create second snapshot of a volume 4. Convert latest > > > snapshot to a template 5. Verify the size of vhd of new template in > > > secondary storage. > > > > > > Here the template have 1GB, exactly the size of latest snapshot. > > > > > > ACS 4.9.3, XenServer 6.5, Primary Stg ISCSI > > > > > > > > > -Original Message- > > > From: Lotic Lists [mailto:li...@lotic.com.br] > > > Sent: quinta-feira, 26 de outubro de 2017 15:03 > > > To: us...@cloudstack.apache.org > > > Subject: RE: Strange size of template from snapshot on XenServer > > > > > > I test the same case on other environment, create template from > > > snapshot, acs 4.9.2.0 and XenServer 6.5/iscsi > > > > > > 1. Was created two snapshots > > > > > > # ls -lh /var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/ > > > snapshots/131/617/ > > > total 3.0G > > > -rw-r--r-- 1 4294967294 root 13G Oct 26 13:46 > > > 42c7c51d-4aa7-40d2-b5eb- cb56fc963974.vhd > > > -rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:42 > > > 53b33a5a-a7d9-4efa-b126- 38eec5482b05.vhd > > > > > > https://i.imgur.com/cSHZAJ3.png > > > > > > 2. create a template from latest snapshot > > > >
RE: Strange size of template from snapshot on XenServer
I tested on a fresh environment, acs 4.9.3.0, xenserver 6.5 with all patches and primary storage NFS, we have same problem - Snapshot files [root@acs01 203]# ls -lh /exports/secondary/snapshots/2/6/ total 2.8G -rw-r--r-- 1 root root 1.7G Oct 31 16:48 cad96f0c-de49-4255-b0a0-9aea5e2297cb.vhd <-- snap-base -rw-r--r-- 1 root root 1.1G Oct 31 16:49 fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd <-- snap-diff https://i.imgur.com/bWupsAS.png [root@acs01 203]# md5sum /exports/secondary/snapshots/2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/snapshots/2/6/fa4e7e4d-531d-42dd-8a80-df6b274584a8.vhd - Template files [root@acs01 203]# ls -lh /exports/secondary/template/tmpl/2/203 total 2.0G -rw-r--r-- 1 root root 1.1G Oct 31 16:50 e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd -rw-r--r-- 1 root root 303 Oct 31 16:50 template.properties [root@acs01 203]# md5sum /exports/secondary/template/tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd 17eec8d4f6d4c128b34b9e2e1876ceb7 /exports/secondary/template/tmpl/2/203/e9def45d-1b9e-4c2e-b843-852fe40f00b2.vhd It's a huge problem!!! I think issue 9025 is not resolved Regards Marcelo -Original Message- From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] Sent: terça-feira, 31 de outubro de 2017 16:00 To: us...@cloudstack.apache.org Subject: Re: Strange size of template from snapshot on XenServer Well, reading the description of the issue it seems to be related to the problem you are describing. However, I compared the classes that were changed with PR (https://github.com/apache/cloudstack/pull/1176) and they are the same in ACS 4.9.2.0 and 4.9.3.0. On Tue, Oct 31, 2017 at 6:36 PM, Lotic Lists wrote: > Hi Rafael, thanks for test. > > I found the issue > https://issues.apache.org/jira/browse/CLOUDSTACK-9025 > I think is a same case. I will up a new lab environment now for > simulate the issue > > Regards. > Marcelo > > -Original Message- > From: Rafael Weingärtner [mailto:rafaelweingart...@gmail.com] > Sent: segunda-feira, 30 de outubro de 2017 12:08 > To: us...@cloudstack.apache.org > Subject: Re: Strange size of template from snapshot on XenServer > > I just did, and the size of the template is the size of the root disk > + the 1GB file I created in the test vm. > > The system I tested this is an ACS 4.9.2, XenServer 6.5, Primary Stg > ISCSI > > On Mon, Oct 30, 2017 at 10:20 AM, Lotic Lists wrote: > > > Good morning > > > > Guys, who could execute the test below? > > > > 1. Create a manual snapshot of a volume 2. Create a file (1GB) with > > dd on VM 3. Create second snapshot of a volume 4. Convert latest > > snapshot to a template 5. Verify the size of vhd of new template in > > secondary storage. > > > > Here the template have 1GB, exactly the size of latest snapshot. > > > > ACS 4.9.3, XenServer 6.5, Primary Stg ISCSI > > > > > > -Original Message----- > > From: Lotic Lists [mailto:li...@lotic.com.br] > > Sent: quinta-feira, 26 de outubro de 2017 15:03 > > To: us...@cloudstack.apache.org > > Subject: RE: Strange size of template from snapshot on XenServer > > > > I test the same case on other environment, create template from > > snapshot, acs 4.9.2.0 and XenServer 6.5/iscsi > > > > 1. Was created two snapshots > > > > # ls -lh /var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/ > > snapshots/131/617/ > > total 3.0G > > -rw-r--r-- 1 4294967294 root 13G Oct 26 13:46 > > 42c7c51d-4aa7-40d2-b5eb- cb56fc963974.vhd > > -rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:42 > > 53b33a5a-a7d9-4efa-b126- 38eec5482b05.vhd > > > > https://i.imgur.com/cSHZAJ3.png > > > > 2. create a template from latest snapshot > > > > # ls -lh > > total 37M > > -rw-r--r-- 1 4294967294 root 1.2G Oct 26 14:43 > > 637604a6-3085-444e-ba09- b9aab11a2c16.vhd > > -rw-r--r-- 1 4294967294 root 303 Oct 26 14:43 template.properties > > > > # cat template.properties > > #Thu Oct 26 16:43:54 UTC 2017 > > filename=637604a6-3085-444e-ba09-b9aab11a2c16.vhd > > id=1 > > vhd=true > > vhd.filename=637604a6-3085-444e-ba09-b9aab11a2c16.vhd > > public=true > > uniquename=637604a6-3085-444e-ba09-b9aab11a2c16 > > vhd.virtualsize=21474836480 > > virtualsize=21474836480 > > hvm= > > vhd.size=1197752832 > > size=1197752832 > > > > # md5sum /var/cloud_mount/e5921d9a-70b0-3501-9fda-6097e721fffb/ > > snapshots/131/617/53b33a5a-a7d9-4efa-b126-38eec5482b05.vhd > > 9d2078a6f41ca5e1eab824848c06df53 /var/cloud_mount/e5921d9a- > > 70b0-3501-9fda-6097e721fffb
