Re: Issue with Snapshots

2021-03-09 Thread Edward St Pierre
Hi, Yes it was working on the previous version which 4.13 Regards On Mon, 8 Mar 2021 at 13:02, Gabriel Bräscher wrote: > Hi, > > I think that we might have a bug on snapshot backed up on secondary. I have > checked my tests and the image on secondary storage is not deleted as well; > it has b

Re: Issue with Snapshots

2021-03-08 Thread Gabriel Bräscher
Hi, I think that we might have a bug on snapshot backed up on secondary. I have checked my tests and the image on secondary storage is not deleted as well; it has been passed more than enough time for CloudStack cleanup sec storage garbage. One question. Was it working before upgrading to 4.15? Wh

Re: Issue with Snapshots

2021-03-05 Thread Edward St Pierre
Hi, Thanks for that information and pointers on where to look, I have checked it out and the data was also on the secondary storage and the storage VM is mounting the NFS servers etc. (I have redeployed it just incase) I have gone through some of the older snapshots that are not getting removed,

Re: Issue with Snapshots

2021-03-05 Thread Gabriel Bräscher
Before seeing the last reply I had just tested on CloudStack 4.15 + Ceph + KVM, and it worked fine; however, I did the test with one snapshot of the volume. Maybe the scheduled/incremental snapshotting adds a different variable to the equation. >From my tests, the DB holds one reference as Ready o

Re: Issue with Snapshots

2021-03-05 Thread Edward St Pierre
Hi The issue happens multiple snapshots, I have run a test with scheduled hourly volume snapshots for a test, here are the logs: 2021-03-05 10:03:43,277 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-65993d1d job-6141/job-6142 ctx-43a8373c) (logid:fc7d7320) Execute VM work job: c

Re: Issue with Snapshots

2021-03-04 Thread Gabriel Bräscher
There was an open issue indeed but a PR solved it for 4.15. The issue reported on this email looks a bit different than the ones I have seen. Background on a recent issue: - Issue #4498 "RBD Snapshot fails when snapshot.backup.to.secondary: true" has been fixed by PR #4568 "kvm: Fix double-escape

Re: Issue with Snapshots

2021-03-04 Thread Rakesh v
If I remember properly there is already an issue raised for it in github Sent from my iPhone > On Mar 4, 2021, at 9:48 PM, Andrija Panic wrote: > > @Gabriel Beims Bräscher does this rings any bells > for you? I haven't played with Ceph / snap clean-up issue on 4.15 myself. > > Best, > >> On

Re: Issue with Snapshots

2021-03-04 Thread Andrija Panic
@Gabriel Beims Bräscher does this rings any bells for you? I haven't played with Ceph / snap clean-up issue on 4.15 myself. Best, On Tue, 2 Mar 2021 at 17:16, Edward St Pierre wrote: > Hi All, > > I Wonder if someone could help me. > > Currently using ceph for primary storage and have > 'snaps