Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted

2021-10-27 Thread benoit lair
I found why the other templates didn't were migrated on 2nd sec storage
server
Mgmt Server was blocked on template vm id1 (system vm template)

In fact in initialised sys template vm from ACS mgmt server to 2nd sec
storage server with : cloud-install-sys-tmplt

So it was blocked to this operation
Finally i tried to help ACS server, moving the template id1 folder from 1st
sec storage to 2nd sec storage

I finally got the other templates downloaded onto my 2nd sec storage server

But after restarting ACS mgmt server, the template id1 folder has been
deleted on both secondary storage servers
I still have entries on BDD for template id1 on store_id 1 and store_id 2,
but the folder does not exist anymore ! :/

How can i get back my system vm template ? i cant start any system vm
routers

Thanks for your help

Regards, Benoit

Le mar. 26 oct. 2021 à 16:56, Pearl d'Silva  a
écrit :

> One way to identify it would be to check the vm_template table for
> templates that are marked as public but do not have a url (i.e., null) -
> such templates should be migrated, but maybe skipped, as in 4.15, public
> templates aren't migrated as they get downloaded on all stores in a zone.
> However, such templates i.e., templates created from volumes / snapshots
> that are marked as public do not get synced. This was addressed in
> https://github.com/apache/cloudstack/pull/5404
>
>
> Thanks,
> 
> From: benoit lair 
> Sent: Tuesday, October 26, 2021 8:01 PM
> To: users@cloudstack.apache.org 
> Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> interrupted
>
> Hi Pearl,
>
> I am checking the logs of the mgmt server
> About the possibility the template came from a volume, is there way to
> check this in database ?
>
> Regards, Benoit
>
> Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva  a
> écrit :
>
> > Hi Benoit,
> >
> > Can you please check the logs to see if the specific data objects were
> > skipped from being migrated because they couldn't be accomodated on the
> > destination store. Also, were these templates that were left behind
> created
> > from volumes / snapshots - in that case, in 4.15, it is a known issue to
> > skip those files, and has been addressed in 4.16.
> >
> > Thanks,
> > Pearl
> > 
> > From: benoit lair 
> > Sent: Tuesday, October 26, 2021 5:35 PM
> > To: users@cloudstack.apache.org ;
> > d...@cloudstack.apache.org 
> > Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> > interrupted
> >
> > Hello Guys,
> >
> > I have still the problem on ACS 4.15
> > I am trying to migrate my first nfs secondary storage server to another
> nfs
> > server
> > ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA :
> > Successfully
> > completed migrating Image store data. Migrating files/data objects from :
> > NFS Secondary storage 001 to: [NFS Secondary storage 002]
> >
> > However, there are still templates hosted on the primary nfs server
> >
> > any ideas why the migration does not work as expected ?
> >
> > Regards, Benoit
> > Le mer. 20 oct. 2021 à 15:24, benoit lair  a
> écrit
> > :
> >
> > > Hello,
> > >
> > > I am trying to migrate my first NFS secondary storage to a second NFS
> one
> > > I asked for a migration with a migration policy "complete"
> > > The job is working but finishes before migrating all the data
> > >
> > > I had to relaunch the migration which continues
> > >
> > > Any ideas ?
> > >
> > > Regards, Benoit
> > >
> >
> >
> >
> >
>
>
>
>


Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted

2021-10-26 Thread Pearl d'Silva
One way to identify it would be to check the vm_template table for templates 
that are marked as public but do not have a url (i.e., null) - such templates 
should be migrated, but maybe skipped, as in 4.15, public templates aren't 
migrated as they get downloaded on all stores in a zone. However, such 
templates i.e., templates created from volumes / snapshots that are marked as 
public do not get synced. This was addressed in 
https://github.com/apache/cloudstack/pull/5404


Thanks,

From: benoit lair 
Sent: Tuesday, October 26, 2021 8:01 PM
To: users@cloudstack.apache.org 
Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers 
interrupted

Hi Pearl,

I am checking the logs of the mgmt server
About the possibility the template came from a volume, is there way to
check this in database ?

Regards, Benoit

Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva  a
écrit :

> Hi Benoit,
>
> Can you please check the logs to see if the specific data objects were
> skipped from being migrated because they couldn't be accomodated on the
> destination store. Also, were these templates that were left behind created
> from volumes / snapshots - in that case, in 4.15, it is a known issue to
> skip those files, and has been addressed in 4.16.
>
> Thanks,
> Pearl
> 
> From: benoit lair 
> Sent: Tuesday, October 26, 2021 5:35 PM
> To: users@cloudstack.apache.org ;
> d...@cloudstack.apache.org 
> Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> interrupted
>
> Hello Guys,
>
> I have still the problem on ACS 4.15
> I am trying to migrate my first nfs secondary storage server to another nfs
> server
> ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA :
> Successfully
> completed migrating Image store data. Migrating files/data objects from :
> NFS Secondary storage 001 to: [NFS Secondary storage 002]
>
> However, there are still templates hosted on the primary nfs server
>
> any ideas why the migration does not work as expected ?
>
> Regards, Benoit
> Le mer. 20 oct. 2021 à 15:24, benoit lair  a écrit
> :
>
> > Hello,
> >
> > I am trying to migrate my first NFS secondary storage to a second NFS one
> > I asked for a migration with a migration policy "complete"
> > The job is working but finishes before migrating all the data
> >
> > I had to relaunch the migration which continues
> >
> > Any ideas ?
> >
> > Regards, Benoit
> >
>
>
>
>

 



Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted

2021-10-26 Thread benoit lair
Hi Pearl,

I am checking the logs of the mgmt server
About the possibility the template came from a volume, is there way to
check this in database ?

Regards, Benoit

Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva  a
écrit :

> Hi Benoit,
>
> Can you please check the logs to see if the specific data objects were
> skipped from being migrated because they couldn't be accomodated on the
> destination store. Also, were these templates that were left behind created
> from volumes / snapshots - in that case, in 4.15, it is a known issue to
> skip those files, and has been addressed in 4.16.
>
> Thanks,
> Pearl
> 
> From: benoit lair 
> Sent: Tuesday, October 26, 2021 5:35 PM
> To: users@cloudstack.apache.org ;
> d...@cloudstack.apache.org 
> Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> interrupted
>
> Hello Guys,
>
> I have still the problem on ACS 4.15
> I am trying to migrate my first nfs secondary storage server to another nfs
> server
> ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA :
> Successfully
> completed migrating Image store data. Migrating files/data objects from :
> NFS Secondary storage 001 to: [NFS Secondary storage 002]
>
> However, there are still templates hosted on the primary nfs server
>
> any ideas why the migration does not work as expected ?
>
> Regards, Benoit
> Le mer. 20 oct. 2021 à 15:24, benoit lair  a écrit
> :
>
> > Hello,
> >
> > I am trying to migrate my first NFS secondary storage to a second NFS one
> > I asked for a migration with a migration policy "complete"
> > The job is working but finishes before migrating all the data
> >
> > I had to relaunch the migration which continues
> >
> > Any ideas ?
> >
> > Regards, Benoit
> >
>
>
>
>


Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted

2021-10-26 Thread Pearl d'Silva
Hi Benoit,

Can you please check the logs to see if the specific data objects were skipped 
from being migrated because they couldn't be accomodated on the destination 
store. Also, were these templates that were left behind created from volumes / 
snapshots - in that case, in 4.15, it is a known issue to skip those files, and 
has been addressed in 4.16.

Thanks,
Pearl

From: benoit lair 
Sent: Tuesday, October 26, 2021 5:35 PM
To: users@cloudstack.apache.org ; 
d...@cloudstack.apache.org 
Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers 
interrupted

Hello Guys,

I have still the problem on ACS 4.15
I am trying to migrate my first nfs secondary storage server to another nfs
server
ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully
completed migrating Image store data. Migrating files/data objects from :
NFS Secondary storage 001 to: [NFS Secondary storage 002]

However, there are still templates hosted on the primary nfs server

any ideas why the migration does not work as expected ?

Regards, Benoit
Le mer. 20 oct. 2021 à 15:24, benoit lair  a écrit :

> Hello,
>
> I am trying to migrate my first NFS secondary storage to a second NFS one
> I asked for a migration with a migration policy "complete"
> The job is working but finishes before migrating all the data
>
> I had to relaunch the migration which continues
>
> Any ideas ?
>
> Regards, Benoit
>

 



Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted

2021-10-26 Thread benoit lair
Hello Guys,

I have still the problem on ACS 4.15
I am trying to migrate my first nfs secondary storage server to another nfs
server
ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully
completed migrating Image store data. Migrating files/data objects from :
NFS Secondary storage 001 to: [NFS Secondary storage 002]

However, there are still templates hosted on the primary nfs server

any ideas why the migration does not work as expected ?

Regards, Benoit
Le mer. 20 oct. 2021 à 15:24, benoit lair  a écrit :

> Hello,
>
> I am trying to migrate my first NFS secondary storage to a second NFS one
> I asked for a migration with a migration policy "complete"
> The job is working but finishes before migrating all the data
>
> I had to relaunch the migration which continues
>
> Any ideas ?
>
> Regards, Benoit
>


ACS 4.15.1 Migration between NFS Secondary storage servers interrupted

2021-10-20 Thread benoit lair
Hello,

I am trying to migrate my first NFS secondary storage to a second NFS one
I asked for a migration with a migration policy "complete"
The job is working but finishes before migrating all the data

I had to relaunch the migration which continues

Any ideas ?

Regards, Benoit