Re: [openstack-dev] [Fuel] Failed upgrade chain - 5.1 - 5.1.1 - 6.0

2014-11-18 Thread Igor Kalnitsky
Hi Daniele,

Sorry for long response, I have a bit busy.

As for your problem, the log is looks like that we're talking about
the same problem, but at different stages of its manifestation.

Anyway, the original ticket is closed, so please pull the latest
fuel-main fixes and try again. If you meet some problems - let us
know.

- Igor

On Fri, Nov 14, 2014 at 2:38 PM, Daniele Pizzolli
daniele.pizzo...@create-net.org wrote:
 Igor Kalnitsky ikalnit...@mirantis.com writes:

 Mat,

 I've filed a bug [1] and provide you a puppet output inside Nailgun
 container [2].

 If I remove /etc/yum.repos.d/5.1.1_nailgun - the puppet works fine.

 [1]:https://bugs.launchpad.net/fuel/+bug/1392698
 [2]: http://xsnippet.org/360279/raw/

 Hello,

 I guess I asked for a related problem during make iso on #fuel-dev few
 days ago.

 The logs seems similar to me:

 http://paste.openstack.org/show/131837/

 Maybe you want to add also this reference to the bug.

 Best,
 Daniele

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel] Failed upgrade chain - 5.1 - 5.1.1 - 6.0

2014-11-18 Thread Daniele Pizzolli
Igor Kalnitsky ikalnit...@mirantis.com writes:

 Hi Daniele,

 Sorry for long response, I have a bit busy.

 As for your problem, the log is looks like that we're talking about
 the same problem, but at different stages of its manifestation.

 Anyway, the original ticket is closed, so please pull the latest
 fuel-main fixes and try again. If you meet some problems - let us
 know.

Hello Igor,

thanks.  I tried with the latest stable/5.1 and still get the error.

I filed the bug here: https://bugs.launchpad.net/fuel/+bug/1393777

I also make made a try by cherry picking the commits mentioned in
https://bugs.launchpad.net/fuel/+bug/1392698 with no success.

The build from the master works.

Thanks,
Daniele

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Fuel] Failed upgrade chain - 5.1 - 5.1.1 - 6.0

2014-11-14 Thread Igor Kalnitsky
Hi folks,

Yesterday I performed the following upgrade chain:

5.1 - 5.1.1 - 6.0

and upgrading to 6.0 was failed. I did some research and figure out
that Nailgun's container doesn't have Nailgun at all. So here's what
happened.

1. When we're upgrading to 6.0 we already have three repos in the
system: 5.1, 5.1.1 and 6.0.

2. When we start a new Nailgun container, it runs start.sh which runs
puppet [1].

3. And puppet fails to install a Nailgun package. Why it's happened?
We have the same Nailgun version in both 5.1.1 and 6.0 repos, but
those packages have different dependencies. From yum's point of view,
the packages are same (since they have the same version), so yum tries
to install the Nailgun from 5.1.1 repo, but the container contains
already installed dependencies for the Nailgun from 6.0 (they were
installed during building container), and obviously it fails with
failed dependencies errors (we have higher versions in the system).

Well, the issue blocks complex upgrade chains and definitely we have
to do something ASAP.

In order to protect us from similar issues in future I propose next changes:

1. Increase versions of all Fuel packages at least once per release.

2. Remove a package installation code from manifests - the container
should not install packages, they should be installed during container
building process.

What do you think, folks?


[1]: 
https://github.com/stackforge/fuel-main/blob/master/docker/nailgun/start.sh#L11

Thanks,
Igor

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel] Failed upgrade chain - 5.1 - 5.1.1 - 6.0

2014-11-14 Thread Matthew Mosesohn
Igor,

I'm trying to figure out where the failure is. The 5.1.1 and 6.0
prebuilt containers contain the correct version of nailgun RPM
pre-installed. It shouldn't matter if the versions are identical
(which is a problem for sure).

Can you open a bug and post upgrade logs? I'm interested to see which
pieces cause the failure and this is some area I didn't plan for in
container upgrades.

Best Regards,
Matthew Mosesohn

On Fri, Nov 14, 2014 at 3:43 PM, Igor Kalnitsky ikalnit...@mirantis.com wrote:
 Hi folks,

 Yesterday I performed the following upgrade chain:

 5.1 - 5.1.1 - 6.0

 and upgrading to 6.0 was failed. I did some research and figure out
 that Nailgun's container doesn't have Nailgun at all. So here's what
 happened.

 1. When we're upgrading to 6.0 we already have three repos in the
 system: 5.1, 5.1.1 and 6.0.

 2. When we start a new Nailgun container, it runs start.sh which runs
 puppet [1].

 3. And puppet fails to install a Nailgun package. Why it's happened?
 We have the same Nailgun version in both 5.1.1 and 6.0 repos, but
 those packages have different dependencies. From yum's point of view,
 the packages are same (since they have the same version), so yum tries
 to install the Nailgun from 5.1.1 repo, but the container contains
 already installed dependencies for the Nailgun from 6.0 (they were
 installed during building container), and obviously it fails with
 failed dependencies errors (we have higher versions in the system).

 Well, the issue blocks complex upgrade chains and definitely we have
 to do something ASAP.

 In order to protect us from similar issues in future I propose next changes:

 1. Increase versions of all Fuel packages at least once per release.

 2. Remove a package installation code from manifests - the container
 should not install packages, they should be installed during container
 building process.

 What do you think, folks?


 [1]: 
 https://github.com/stackforge/fuel-main/blob/master/docker/nailgun/start.sh#L11

 Thanks,
 Igor

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel] Failed upgrade chain - 5.1 - 5.1.1 - 6.0

2014-11-14 Thread Igor Kalnitsky
Mat,

I've filed a bug [1] and provide you a puppet output inside Nailgun
container [2].

If I remove /etc/yum.repos.d/5.1.1_nailgun - the puppet works fine.

[1]:https://bugs.launchpad.net/fuel/+bug/1392698
[2]: http://xsnippet.org/360279/raw/

Thanks,
Igor

On Fri, Nov 14, 2014 at 1:51 PM, Matthew Mosesohn
mmoses...@mirantis.com wrote:
 Igor,

 I'm trying to figure out where the failure is. The 5.1.1 and 6.0
 prebuilt containers contain the correct version of nailgun RPM
 pre-installed. It shouldn't matter if the versions are identical
 (which is a problem for sure).

 Can you open a bug and post upgrade logs? I'm interested to see which
 pieces cause the failure and this is some area I didn't plan for in
 container upgrades.

 Best Regards,
 Matthew Mosesohn

 On Fri, Nov 14, 2014 at 3:43 PM, Igor Kalnitsky ikalnit...@mirantis.com 
 wrote:
 Hi folks,

 Yesterday I performed the following upgrade chain:

 5.1 - 5.1.1 - 6.0

 and upgrading to 6.0 was failed. I did some research and figure out
 that Nailgun's container doesn't have Nailgun at all. So here's what
 happened.

 1. When we're upgrading to 6.0 we already have three repos in the
 system: 5.1, 5.1.1 and 6.0.

 2. When we start a new Nailgun container, it runs start.sh which runs
 puppet [1].

 3. And puppet fails to install a Nailgun package. Why it's happened?
 We have the same Nailgun version in both 5.1.1 and 6.0 repos, but
 those packages have different dependencies. From yum's point of view,
 the packages are same (since they have the same version), so yum tries
 to install the Nailgun from 5.1.1 repo, but the container contains
 already installed dependencies for the Nailgun from 6.0 (they were
 installed during building container), and obviously it fails with
 failed dependencies errors (we have higher versions in the system).

 Well, the issue blocks complex upgrade chains and definitely we have
 to do something ASAP.

 In order to protect us from similar issues in future I propose next changes:

 1. Increase versions of all Fuel packages at least once per release.

 2. Remove a package installation code from manifests - the container
 should not install packages, they should be installed during container
 building process.

 What do you think, folks?


 [1]: 
 https://github.com/stackforge/fuel-main/blob/master/docker/nailgun/start.sh#L11

 Thanks,
 Igor

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel] Failed upgrade chain - 5.1 - 5.1.1 - 6.0

2014-11-14 Thread Daniele Pizzolli
Igor Kalnitsky ikalnit...@mirantis.com writes:

 Mat,

 I've filed a bug [1] and provide you a puppet output inside Nailgun
 container [2].

 If I remove /etc/yum.repos.d/5.1.1_nailgun - the puppet works fine.

 [1]:https://bugs.launchpad.net/fuel/+bug/1392698
 [2]: http://xsnippet.org/360279/raw/

Hello,

I guess I asked for a related problem during make iso on #fuel-dev few
days ago.

The logs seems similar to me:

http://paste.openstack.org/show/131837/

Maybe you want to add also this reference to the bug.

Best,
Daniele

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev