[Openstack-operators] Neutron L2-GW operators experience [l2-gateway]

2016-08-15 Thread Saverio Proto
Hello all, we want to bridge one of our tenants networks with a physical network where we have some hardware appliances. we can't easily use provider networks, because our compute-nodes are connected over a L3 network, so there is not a shared L2 segment where we can bridge the VMs regardless of

Re: [Openstack-operators] Change Dashboard Splash Logo and Top-left logo

2016-08-15 Thread Saverio Proto
On ubuntu we just replace these two files: /usr/share/openstack-dashboard/openstack_dashboard/static/dashboard/img/logo.png /usr/share/openstack-dashboard/openstack_dashboard/static/dashboard/img/logo-splash.png we make sure with puppet that our version of these two files is in place. I hope

[Openstack-operators] can we lock RPC version with upgrade_levels on neutron-openvswitch-agent ?

2016-08-05 Thread Saverio Proto
Hello, we are doing the upgrade Kilo to Liberty pet by pet. We already upgraded successfully Keystone and Glance. Now I started the Nova pet upgrade. For the controller node it was ok. As soon as I upgraded the compute nodes I had a problem with neutron. I can't lock the

[Openstack-operators] HowTo upgrade in production LBaaS V1 to LBaaS V2

2016-08-03 Thread Saverio Proto
Hello ! LBaaS V1 is deprecated in Liberty. I am aware of this documentation: http://docs.openstack.org/mitaka/networking-guide/adv-config-lbaas.html We are now running a public cloud, and some users deployed LBaaS V1 (with heat templates). How do we migrate to LBaaS V2 without delete users

Re: [Openstack-operators] [puppet] - controller with mysql and rabbitmq have problem with puppet dependencies

2016-07-07 Thread Saverio Proto
So it is puppetlabs-rabbitmq 5.4.0 that created this problem. I rolled back to 5.3.1 Here is the commit that introduces the problem: https://github.com/puppetlabs/puppetlabs-rabbitmq/commit/df71b47413fa2e941850a42e82ba83d7f680529d Saverio 2016-07-07 13:18 GMT+02:00 Saverio Proto <zi

[Openstack-operators] [puppet] - controller with mysql and rabbitmq have problem with puppet dependencies

2016-07-07 Thread Saverio Proto
Hello, I have a pet server hosting both mysql and rabbitmq for openstack. I guess this is common for many people running a Openstack Controller pet. I just figured out I have a strange problem with my puppet modules dependencies: puppetlabs-rabbitmq requires: puppet-staging puppetlab-mysql

[Openstack-operators] Next Ops Midcycle NYC August 25-26

2016-06-23 Thread Saverio Proto
Hello there :) is anyone from the openstack foundation or from bloomberg that can help out with this ? I share this for anyone that needs visa. for Austin we had something like this: https://www.openstack.org/summit/austin-2016/austin-and-travel/

Re: [Openstack-operators] Next Ops Midcycle NYC August 25-26

2016-06-22 Thread Saverio Proto
Did we create already a etherpad ? I hope I did this correctly: https://etherpad.openstack.org/p/NYC-ops-meetup Saverio 2016-06-22 15:58 GMT+02:00 Mark Voelker : > Hi Ops, > > FYI for those that may not be aware, that’s also the week of OpenStack East. > OpenStack East

Re: [Openstack-operators] Shared Storage for compute nodes

2016-06-21 Thread Saverio Proto
Hello Michael, have a look at Openstack Manila and CephFS Cheers Saverio 2016-06-21 11:42 GMT+02:00 Michael Stang : > I think I have asked my question not correctly, it is not for the cinder > backend, I meant the shared storage for the instances which is

Re: [Openstack-operators] Shared Storage for compute nodes

2016-06-21 Thread Saverio Proto
Hello Michael, a very widely adopted solution is to use Ceph with rbd volumes. http://docs.openstack.org/liberty/config-reference/content/ceph-rados.html http://docs.ceph.com/docs/master/rbd/rbd-openstack/ you find more options here under Volume drivers:

Re: [Openstack-operators] Upgrade OpenStack Juno to Mitaka

2016-06-15 Thread Saverio Proto
Hello, first of all I suggest you read this article: http://superuser.openstack.org/articles/openstack-upgrading-tutorial-11-pitfalls-and-solutions > What is the best way to performe an upgrade from Juno to Mitaka? I would go for the in place upgrade, but I always upgraded without jumping

Re: [Openstack-operators] Mid-Cycle Ops Meetup venue choice - please make your voice heard!

2016-06-15 Thread Saverio Proto
Hello all, I will need a visa to come to the US for the Mid-Cycle Ops Meetup. The process to obtain a Visa can take up to 8 weeks, and I cannot apply until dates and venue are decided. please set a date at least 8 weeks ahead, or few people that can't make it on time to apply for visa will not

[Openstack-operators] [sahara] - Hadoop on Openstack and swift storage only: how to set --os-storage-url in core-site.xml ?

2016-06-09 Thread Saverio Proto
Hello ! I made some tests running Hadoop on our Openstack Cloud. The idea is to do map reduce examples but using the swift storage instead of HDFS. We have Ceph backend for cinder volumes so HDFS on top of that does not really fit. I managed to configure hadoop to access swift with

[Openstack-operators] Neutron database upgrade kilo-liberty and parallel Alembic migration branches

2016-06-01 Thread Saverio Proto
Hello, reading this documentation page: http://docs.openstack.org/mitaka/networking-guide/migration-neutron-database.html I dont get what means having two parallel migration branches. Do you have to choose one of the branches ? If yes how ? Or it just means that some operations can be safely

Re: [Openstack-operators] [kolla] Moving from distro packages to containers (or virtualenvs...)

2016-05-18 Thread Saverio Proto
About docker: testing this docker setup is in my TODO list from a long time: https://github.com/dguerri/dockerstack Looks very well done but I think is not very well known. Saverio ___ OpenStack-operators mailing list

Re: [Openstack-operators] Swift ACL's together with Keystone (v3) integration

2016-05-12 Thread Saverio Proto
an account by doing swift > stat -v. > > > > In this case, the user in step 2 is not able to do anything else in account > X besides do object listing in the container and get its objects, which is > what I was aiming for. What does not work for me is if I set the read-acl to

Re: [Openstack-operators] Swift ACL's together with Keystone (v3) integration

2016-05-03 Thread Saverio Proto
Hello Pieter, I did run into the same problem today. Did you find pointers to more updated documentation ? Were you able to configure the cross tenant read ACL ? thank you Saverio 2016-04-20 13:48 GMT+02:00 Wijngaarden, Pieter van : > Hi all, > > I’m

[Openstack-operators] neutron operators please check this bug: Check if namespace exists before exec commands

2016-04-29 Thread Saverio Proto
Hello operators, I am running Kilo and I found this bug: https://bugs.launchpad.net/neutron/+bug/1573073 because neutron is trying to do operations over and over again on namespaces that do not exist anymore, this kills the CPU of our network node. I wrote a patch for kilo that fixes the

Re: [Openstack-operators] nova snapshots should dump all RAM to hypervisor disk ?

2016-04-24 Thread Saverio Proto
> We are in an even worst situation: we have flavors with 256GB of ram > but only 100GB on the local hard disk, which means that we cannot > snapshot VMs with this flavor. > > If there is any way to avoid saving the content of the ram to disk (or > maybe there is a way to snapshot the ram to,

[Openstack-operators] nova snapshots should dump all RAM to hypervisor disk ?

2016-04-22 Thread Saverio Proto
Hello Operators, one of the users of our cluster opened a ticket about a snapshot corner case. It is not possible to snapshot a instance that is booted from volume when the instance is paused. So I wrote this patch, and from the discussion you can see that I learnt a lot about snapshots.

[Openstack-operators] how I re-compile UCA packages to carry my local patches

2016-04-04 Thread Saverio Proto
Hello there, with the help of James I was finally able to properly compile ubuntu packages to carry local patches in my Kilo installation. I documented the all process here: https://github.com/zioproto/ubuntu-cloud-archive-vagrant-vm I hope this is useful for everyone. The notes I wrote can be

Re: [Openstack-operators] [nova] how to recover instances with different hypervisor-id on the same compute node

2016-03-24 Thread Saverio Proto
When this kind of very corner case happen I usually hack manually the database. Go with mysql in the nova database and put the new ID for those two instances. my 2 cents Saverio 2016-03-23 5:17 GMT+01:00 Rahul Sharma : > Hi All, > > Due to a hostname change, we ended

Re: [Openstack-operators] [puppet] [cinder] - some snapshots are there, but they are hidden in the snapshot-list

2016-03-24 Thread Saverio Proto
Hello there, because I need to tune osapi_max_limit I wrote this puppet patch https://review.openstack.org/#/c/296931/ but I am very bad at coding :) please review :) Saverio 2016-03-23 11:17 GMT+01:00 Saverio Proto <ziopr...@gmail.com>: > It looks like not all snapshots are liste

Re: [Openstack-operators] [cinder] - some snapshots are there, but they are hidden in the snapshot-list

2016-03-23 Thread Saverio Proto
Hello, I upgraded to Kilo and I see the very same bug. What is the right way to fill a bug to Cinder, is it here ? https://bugs.launchpad.net/cinder Will it be considered if the Bug is in Kilo ? thank you Saverio 2016-03-16 13:42 GMT+01:00 Saverio Proto <ziopr...@gmail.com>: &

Re: [Openstack-operators] [nova] create image from paused VM refused with http 409

2016-03-22 Thread Saverio Proto
I am not a developer but I tried my best ! https://review.openstack.org/#/c/295865/ I applied the patch in my staging system and it fixes the problem :) Saverio 2016-03-22 13:46 GMT+01:00 Saverio Proto <ziopr...@gmail.com>: > I found the problem. It happens only then the instance h

[Openstack-operators] [nova] create image from paused VM refused with http 409

2016-03-22 Thread Saverio Proto
Hello there, I used to do this in Juno, and now I upgraded to Kilo and it is not working anymore. macsp:~ proto$ openstack server image create --name test 81da19c6-efbe-4002-b4e8-5ce352ffdd14 Cannot 'createImage' instance 81da19c6-efbe-4002-b4e8-5ce352ffdd14 while it is in vm_state paused (HTTP

Re: [Openstack-operators] RAID / stripe block storage volumes

2016-03-06 Thread Saverio Proto
> In our environments, we offer two types of storage. Tenants can either use > Ceph/RBD and trade speed/latency for reliability and protection against > physical disk failures, or they can launch instances that are realized as > LVs on an LVM VG that we create on top of a RAID 0 spanning all but

Re: [Openstack-operators] Horizon bug fixed in Liberty, how should we ask a backport to Kilo ?

2016-03-04 Thread Saverio Proto
Thanks for merging the patch so quickly ! I will try today to build new ubuntu packages and and for feedback at UCA. > But yes, thank you for pointing this out. Bug fixes are mostly > backported to Liberty release, in some rare cases Kilo might get a fix > as well. This is an endless discussion

Re: [Openstack-operators] Horizon bug fixed in Liberty, how should we ask a backport to Kilo ?

2016-03-03 Thread Saverio Proto
t just works. Like so: > > https://review.openstack.org/#/c/287928/ > > It still needs to go through the review process so you will need to ping > some horizon developers in IRC. > > Getting that packaged may take longer. > > On Mar 3, 2016 8:43 AM, "Saverio Pr

[Openstack-operators] Horizon bug fixed in Liberty, how should we ask a backport to Kilo ?

2016-03-03 Thread Saverio Proto
Hello there, in Manchester we had this interesting discussion about asking to backport bugfixes in order to avoid to build own packages. https://etherpad.openstack.org/p/MAN-ops-Upgrade-patches-packaging We run Openstack with Ubuntu and we use the Ubuntu Cloud Archive. We are upgrading our

Re: [Openstack-operators] Snapshots taking long time

2016-03-02 Thread Saverio Proto
Hello Andreas, what kind of snapshot are you doing ? 1) Snapshot of a instance running on a ephimeral volume ? 2) Snapshot of a instance booted from Volume ? 3) Snapshot of a volume ? in case 1 the ephemeral volume is in the volume pool with the name _disk when you snapshot, this must be read

Re: [Openstack-operators] best practice to manage multiple Data center using openstack

2016-01-29 Thread Saverio Proto
Hello Jeff, your question is very general. as a general answer I can suggest to use a configuration management system such as Puppet or Ansible to take care of the servers. It is easier to keep stuff in different datacenter running the same version of packages in this way. I hope this helps.

Re: [Openstack-operators] how to get glance images for a specific tenant with the openstack client ?

2016-01-27 Thread Saverio Proto
> We have an image promotion process that does this for us. The command I use > to get images from a specific tenant is: > > glance --os-image-api-version 1 image-list --owner= > > I'm sure using the v1 API will make some cringe, but I haven't found > anything similar in the v2 API. > I used

[Openstack-operators] how to get glance images for a specific tenant with the openstack client ?

2016-01-25 Thread Saverio Proto
Hello there, I need to delete some users and tenants from my public cloud. Before deleting the users and tenants from keystone, I need to delete all the resources in the tenants. I am stucked listing the glance images uploaded in a specific tenant. I cannot find the way, I always get either all

[Openstack-operators] how to use the new openstack client to nova snapshot ??

2016-01-19 Thread Saverio Proto
Hello there, I am trying to stick to the new openstack client CLI, but sometimes I get completely lost. So I used to do with python-novaclient instance snapshots like this: nova image-create snapshotname I just cannot understand how to do the same with the new client. Could someone explain

Re: [Openstack-operators] [log] LOG.exception should contain an exception message or not?

2016-01-15 Thread Saverio Proto
I think the stacktrace is usefull when debugging, even as an operator. Instead of changing the logs to satisfy the tools, it is the tools that should be enable to parse the logs correctly. Saverio 2016-01-05 14:08 GMT+01:00 Akihiro Motoki : > Hi, > > # cross-posting to -dev

Re: [Openstack-operators] cinder-api with rbd driver ignores ceph.conf

2015-12-08 Thread Saverio Proto
backend with the object-map. If anyone is running juno and wants to enable this feature we have packages published here: http://ubuntu.mirror.cloud.switch.ch/engines/packages/ Saverio 2015-11-26 11:36 GMT+01:00 Saverio Proto <ziopr...@gmail.com>: > Hello, > > I think it is

[Openstack-operators] Juno neutron - Tenant Network with multiple routers, how to nat/filter ?

2015-11-27 Thread Saverio Proto
Hello, I have a cloud user that is trying to implement the following topology ext_net <|R1|> internal_net <|R2|> dbservers_network where - internal_net: 10.0.2.0/24 - dbservers_net: 10.0.3.0/24 Now according to the documentation:

Re: [Openstack-operators] How do I install specific versions of openstack/puppet-keystone

2015-11-26 Thread Saverio Proto
> Can you get R10k to NOT install dependencies listed in metadata etc.? In my experience r10k will not try to install any dependencies. Saverio ___ OpenStack-operators mailing list OpenStack-operators@lists.openstack.org

Re: [Openstack-operators] cinder-api with rbd driver ignores ceph.conf

2015-11-26 Thread Saverio Proto
the rbd backend. This means that if glance images do not have the rbd object map features, the cinder volumes will have flags "object map invalid". So, we are now trying to backport this feature of the rbd driver in glance as well. Saverio 2015-11-24 13:12 GMT+01:00 Saverio Pr

Re: [Openstack-operators] How do I install specific versions of openstack/puppet-keystone

2015-11-25 Thread Saverio Proto
Hello, you can use r10k go in a empty folder, create a file called Puppetfile with this content: mod 'openstack-ceilometer' mod 'openstack-cinder' mod 'openstack-glance' mod 'openstack-heat' mod 'openstack-horizon' mod 'openstack-keystone' mod 'openstack-neutron' mod 'openstack-nova' mod

Re: [Openstack-operators] Neutron getting stuck creating namespaces

2015-11-24 Thread Saverio Proto
Hello Xav, what version of Openstack are you running ? thank you Saverio 2015-11-23 20:04 GMT+01:00 Xav Paice : > Hi, > > Over the last few months we've had a few incidents where the process to > create network namespaces (Neutron, OVS) on the network nodes gets 'stuck' >

Re: [Openstack-operators] Neutron getting stuck creating namespaces

2015-11-24 Thread Saverio Proto
-up true Saverio 2015-11-24 9:51 GMT+01:00 Xav Paice <xavpa...@gmail.com>: > Neutron is Juno, on Trusty boxes with the 3.19 LTS kernel. We're in the > process of updating to Kilo, and onwards to Liberty. > > On 24 November 2015 at 21:24, Saverio Proto <ziopr...@gmail.co

Re: [Openstack-operators] cinder-api with rbd driver ignores ceph.conf

2015-11-24 Thread Saverio Proto
to test this on his Juno setup I can also share .deb packages for Ubuntu Saverio 2015-11-16 16:21 GMT+01:00 Saverio Proto <ziopr...@gmail.com>: > Thanks, > > I tried to backport this patch to Juno but it is not that trivial for > me. I have 2 tests failing, about volume cloning a

Re: [Openstack-operators] Running mixed stuff Juno & Kilo , Was: cinder-api with rbd driver ignores ceph.conf

2015-11-18 Thread Saverio Proto
upgrade one component at a time. > Cinder was one of the first components that we upgraded to kilo, > meaning that other components (glance, nova, ...) were running Juno. > > We didn't have any problem with this setup. > > Belmiro > CERN > > On Tue, Nov 17, 2015 at 6:01 PM, S

[Openstack-operators] Running mixed stuff Juno & Kilo , Was: cinder-api with rbd driver ignores ceph.conf

2015-11-17 Thread Saverio Proto
Hello there, I need to quickly find a workaround to be able to use ceph object map features for cinder volumes with rbd backend. However, upgrading everything from Juno to Kilo will require a lot of time for testing and updating all my puppet modules. Do you think it is feasible to start

Re: [Openstack-operators] cinder-api with rbd driver ignores ceph.conf

2015-11-16 Thread Saverio Proto
-11-12 17:55 GMT+01:00 Josh Durgin <jdur...@redhat.com>: > On 11/12/2015 07:41 AM, Saverio Proto wrote: >> >> So here is my best guess. >> Could be that I am missing this patch ? >> >> >> https://github.com/openstack/cinder/commit/6211d8fa2033c2a607c

[Openstack-operators] cinder-api with rbd driver ignores ceph.conf

2015-11-12 Thread Saverio Proto
Hello there, I am investigating why my cinder is slow deleting volumes. you might remember my email from few days ago with subject: "cinder volume_clear=zero makes sense with rbd ?" so it comes out that volume_clear has nothing to do with the rbd driver. cinder was not guilty, it was really

Re: [Openstack-operators] cinder-api with rbd driver ignores ceph.conf

2015-11-12 Thread Saverio Proto
~cloud0 Thanks Saverio 2015-11-12 16:25 GMT+01:00 Saverio Proto <ziopr...@gmail.com>: > Hello there, > > I am investigating why my cinder is slow deleting volumes. > > you might remember my email from few days ago with subject: > "cinder volume_clear=zero makes sens

[Openstack-operators] cinder volume_clear=zero makes sense with rbd ?

2015-11-04 Thread Saverio Proto
Hello there, I am using cinder with rbd, and most volumes are created from glance images on rbd as well. Because of ceph features, these volumes are CoW and only blocks different from the original parent image are really written. Today I am debugging why in my production system deleting cinder

<    1   2