Re: [openstack-dev] [tripleo] Workflows Squad changes

2018-11-28 Thread Emilien Macchi
On Wed, Nov 28, 2018 at 5:13 AM Jiri Tomasek  wrote:
[...]

> As a possible solution, I would like to propose Adriano as a core reviewer
> to tripleo-common and adding tripleo-ui cores right to +2 tripleo-common
> patches.
>
[...]

Not a member of the squad but +2 to the idea

Thanks for proposing,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [tripleo] Feedback about our project at Summit

2018-11-20 Thread Emilien Macchi
Hi folks,

I wasn't at the Summit but I was interested by the feedback people gave
about TripleO so I've discussed with a few people who made the trip. I
would like to see what actions we can take on short and long term to
address it.
I collected some thoughts here:
https://etherpad.openstack.org/p/BER-tripleo-feedback
Which is based on
https://etherpad.openstack.org/p/BER-deployment-tools-feedback initially.

Feel fee to add more feedback if missing, and also comment what was
written. If you're aware of some WIP that address the feedback, adjust some
wording if needed or just put some links if something exists and is
documented already.
I believe it is critical to us to listen this feedback and include some of
it into our short term roadmap, so we can reduce some frustration that we
can hear sometimes.

Thanks for your help,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] [stable] Deprecation of newton branches

2018-11-19 Thread Emilien Macchi
+1 for me, I haven't seen much interest in keeping these branches for
puppet modules.
I also would like to hear from our users though.

On Mon, Nov 19, 2018 at 3:18 AM Tobias Urdin  wrote:

> Hello,
>
> We've been talking for a while about the deprecation and removal of the
> stable/newton branches.
> I think it's time now that we get rid of them, we have no open patches
> and Newton is considered EOL.
>
> Could cores get back with a quick feedback and then the stable team can
> get rid of those whenever they have time.
>
> Best regards
> Tobias
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Proposing Enrique Llorente Pastora as a core reviewer for TripleO

2018-11-15 Thread Emilien Macchi
+1 to have him part of TripleO CI core team, thanks for your dedication and
hard work. I'm glad to see you're learning fast. Keep your motivation and
thanks again!

On Thu, Nov 15, 2018 at 11:33 AM Alex Schultz  wrote:

> +1
> On Thu, Nov 15, 2018 at 8:51 AM Sagi Shnaidman 
> wrote:
> >
> > Hi,
> > I'd like to propose Quique (@quiquell) as a core reviewer for TripleO.
> Quique is actively involved in improvements and development of TripleO and
> TripleO CI. He also helps in other projects including but not limited to
> Infrastructure.
> > He shows a very good understanding how TripleO and CI works and I'd like
> suggest him as core reviewer of TripleO in CI related code.
> >
> > Please vote!
> > My +1 is here :)
> >
> > Thanks
> > --
> > Best regards
> > Sagi Shnaidman
> >
> __
> > OpenStack Development Mailing List (not for usage questions)
> > Unsubscribe:
> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] no recheck / no workflow until gate is stable

2018-11-13 Thread Emilien Macchi
We have serious issues with the gate at this time, we believe it is a mix
of mirrors errors (infra) and tempest timeouts (see
https://review.openstack.org/617845).

Until the situation is resolved, do not recheck or approve any patch for
now.
Thanks for your understanding,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] CI is broken

2018-11-07 Thread Emilien Macchi
No alert anymore, gate is green.
recheck if needed.

On Wed, Nov 7, 2018 at 2:22 PM Emilien Macchi  wrote:

> I updated the bugs, and so far we have one alert left:
> https://bugs.launchpad.net/tripleo/+bug/1801969
>
> The patch is in gate, be patient and then we'll be able to +A/recheck
> stuff again.
>
> On Wed, Nov 7, 2018 at 7:30 AM Juan Antonio Osorio Robles <
> jaosor...@redhat.com> wrote:
>
>> Hello folks,
>>
>>
>> Please do not attempt to merge or recheck patches until we get this
>> sorted out.
>>
>> We are dealing with several issues that have broken all jobs.
>>
>> https://bugs.launchpad.net/tripleo/+bug/1801769
>> https://bugs.launchpad.net/tripleo/+bug/1801969
>> https://bugs.launchpad.net/tripleo/+bug/1802083
>> https://bugs.launchpad.net/tripleo/+bug/1802085
>>
>> Best Regards!
>>
>>
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe:
>> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
> --
> Emilien Macchi
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] CI is broken

2018-11-07 Thread Emilien Macchi
I updated the bugs, and so far we have one alert left:
https://bugs.launchpad.net/tripleo/+bug/1801969

The patch is in gate, be patient and then we'll be able to +A/recheck stuff
again.

On Wed, Nov 7, 2018 at 7:30 AM Juan Antonio Osorio Robles <
jaosor...@redhat.com> wrote:

> Hello folks,
>
>
> Please do not attempt to merge or recheck patches until we get this
> sorted out.
>
> We are dealing with several issues that have broken all jobs.
>
> https://bugs.launchpad.net/tripleo/+bug/1801769
> https://bugs.launchpad.net/tripleo/+bug/1801969
> https://bugs.launchpad.net/tripleo/+bug/1802083
> https://bugs.launchpad.net/tripleo/+bug/1802085
>
> Best Regards!
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Proposing Bob Fournier as core reviewer

2018-11-01 Thread Emilien Macchi
done, you're now core in TripleO; Thanks Bob for your hard work!

On Mon, Oct 22, 2018 at 4:55 PM Jason E. Rist  wrote:

> On 10/19/2018 06:23 AM, Juan Antonio Osorio Robles wrote:
> > Hello!
> >
> >
> > I would like to propose Bob Fournier (bfournie) as a core reviewer in
> > TripleO. His patches and reviews have spanned quite a wide range in our
> > project, his reviews show great insight and quality and I think he would
> > be a addition to the core team.
> >
> > What do you folks think?
> >
> >
> > Best Regards
> >
> >
> >
> >
> __
> > OpenStack Development Mailing List (not for usage questions)
> > Unsubscribe:
> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> >
> yup.
>
> --
> Jason E. Rist
> Senior Software Engineer
> OpenStack User Interfaces
> Red Hat, Inc.
> Freenode: jrist
> github/twitter: knowncitizen
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] request for feedback/review on docker2podman upgrade

2018-10-30 Thread Emilien Macchi
A bit of an update here:

- We merged the patch in openstack/paunch that stop the Docker container if
we try to start a Podman container.
- We switched the undercloud upgrade job to test upgrades from Docker to
Podman (for now containers are stopped in Docker and then started in
Podman).
- We are now looking how and where to remove the Docker containers once the
upgrade finished. For that work, I started with the Undercloud and patched
tripleoclient to run the post_upgrade_tasks which to me is a good candidate
to run docker rm.

Please look:
- tripleoclient / run post_upgrade_tasks when upgrading
standalone/undercloud: https://review.openstack.org/614349
- THT: prototype on how we would remove the Docker containers:
https://review.openstack.org/611092

Note: for now we assume that Docker is still available on the host after
the upgrade as we are testing things under centos7. I'm aware that this
assumption can change in the future but we'll probably re-iterate.

What I need from the upgrade team is feedback on this workflow, and see if
we can re-use these bits originally tested on Undercloud / Standalone, for
the Overcloud as well.

Thanks for the feedback,


On Fri, Oct 19, 2018 at 8:00 AM Emilien Macchi  wrote:

> On Fri, Oct 19, 2018 at 4:24 AM Giulio Fidente 
> wrote:
>
>> 1) create the podman systemd unit
>> 2) delete the docker container
>>
>
> We finally went with "stop the docker container"
>
> 3) start the podman container
>>
>
> and 4) delete the docker container later in THT upgrade_tasks.
>
> And yes +1 to do the same in ceph-ansible if possible.
> --
> Emilien Macchi
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo][openstack-ansible][nova][placement] Owners needed for placement extraction upgrade deployment tooling

2018-10-30 Thread Emilien Macchi
On the TripleO side, it sounds like Lee Yarwood is taking the lead with a
first commit in puppet-placement:
https://review.openstack.org/#/c/604182/

Lee, can you confirm that you and your team are working on it for Stein
cycle?

On Thu, Oct 25, 2018 at 1:34 PM Matt Riedemann  wrote:

> Hello OSA/TripleO people,
>
> A plan/checklist was put in place at the Stein PTG for extracting
> placement from nova [1]. The first item in that list is done in grenade
> [2], which is the devstack-based upgrade project in the integrated gate.
> That should serve as a template for the necessary upgrade steps in
> deployment projects. The related devstack change for extracted placement
> on the master branch (Stein) is [3]. Note that change has some
> dependencies.
>
> The second point in the plan from the PTG was getting extracted
> placement upgrade tooling support in a deployment project, notably
> TripleO (and/or OpenStackAnsible).
>
> Given the grenade change is done and passing tests, TripleO/OSA should
> be able to start coding up and testing an upgrade step when going from
> Rocky to Stein. My question is who can we name as an owner in either
> project to start this work? Because we really need to be starting this
> as soon as possible to flush out any issues before they are too late to
> correct in Stein.
>
> So if we have volunteers or better yet potential patches that I'm just
> not aware of, please speak up here so we know who to contact about
> status updates and if there are any questions with the upgrade.
>
> [1]
>
> http://lists.openstack.org/pipermail/openstack-dev/2018-September/134541.html
> [2] https://review.openstack.org/#/c/604454/
> [3] https://review.openstack.org/#/c/600162/
>
> --
>
> Thanks,
>
> Matt
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Proposing Bob Fournier as core reviewer

2018-10-19 Thread Emilien Macchi
On Fri, Oct 19, 2018 at 8:24 AM Juan Antonio Osorio Robles <
jaosor...@redhat.com> wrote:

> I would like to propose Bob Fournier (bfournie) as a core reviewer in
> TripleO. His patches and reviews have spanned quite a wide range in our
> project, his reviews show great insight and quality and I think he would
> be a addition to the core team.
>
> What do you folks think?
>

Big +1, Bob is a solid contributor/reviewer. His area of knowledge has been
critical in all aspects of Hardware Provisioning integration but also in
other TripleO bits.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] request for feedback/review on docker2podman upgrade

2018-10-19 Thread Emilien Macchi
On Fri, Oct 19, 2018 at 4:24 AM Giulio Fidente  wrote:

> 1) create the podman systemd unit
> 2) delete the docker container
>

We finally went with "stop the docker container"

3) start the podman container
>

and 4) delete the docker container later in THT upgrade_tasks.

And yes +1 to do the same in ceph-ansible if possible.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] request for feedback/review on docker2podman upgrade

2018-10-14 Thread Emilien Macchi
I recently wrote a blog post about how we could upgrade an host from Docker
containers to Podman containers.

http://my1.fr/blog/openstack-containerization-with-podman-part-3-upgrades/

I managed to get this prototype actually tested in CI:
https://review.openstack.org/#/c/608463/
http://logs.openstack.org/63/608463/10/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/c958861/logs/undercloud/var/log/extra/docker/docker_allinfo.log.txt.gz
http://logs.openstack.org/63/608463/10/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/c958861/logs/undercloud/var/log/extra/podman/podman_allinfo.log.txt.gz

Therefore, I am requesting feedback and reviews on:
- openstack/paunch: rm the docker container during upgrade -
https://review.openstack.org/#/c/608319/
- openstack/tripleo-upgrade: set container_cli for undercloud -
https://review.openstack.org/#/c/608462/
- openstack/tripleo-quickstart: fs050: upgrade the undercloud to Podman
containers - https://review.openstack.org/#/c/608463/

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tc][all] meetings outside IRC

2018-10-13 Thread Emilien Macchi
On Sat, Oct 13, 2018 at 5:30 PM Mohammed Naser  wrote:

> Hi everyone:
>
> I was going over our governance documents, more specifically this section:
>
> "All project meetings are held in public IRC channels and recorded."
>
> Does this mean that all official projects are *required* to hold their
> project meetings over IRC?  Is this a hard requirement or is this
> something that we're a bit more 'lax about?  Do members of the
> community feel like it would be easier to hold their meetings if we
> allowed other avenues (assuming this isn't allowed?)
>
> Looking forward to hearing everyone's comments.
>

In my opinion, IRC is the best place to run meetings in OpenStack
community, however we need to acknowledge that not everyone agrees and some
functional teams or sub-teams prefer some other tools, including
video-conference.

What remains critical to me is:
- wherever you run the meeting, make it publicly reachable, accessible,
visible.
- if you run the meeting outside of IRC, take and share notes on public
channels.

In general: decisions shouldn't not be taken during meetings, but rather on
Gerrit or Mailing-lists. Otherwise you're fragmenting the community between
those who can attend the meeting and those who can't.

My 2 cents,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo][ci] Having more that one queue for gate pipeline at tripleo

2018-10-11 Thread Emilien Macchi
On Thu, Oct 11, 2018 at 10:01 AM Felix Enrique Llorente Pastora <
ellor...@redhat.com> wrote:

> Hello there,
>
>After suffering a lot from zuul's tripleo gate piepeline queue reseting
> after failures on patches I have ask myself what would happend if we have
> more than one queue for gating tripleo.
>
>After a quick read here https://zuul-ci.org/docs/zuul/user/gating.html,
> I have found the following:
>
> "If changes with cross-project dependencies do not share a change queue
> then Zuul is unable to enqueue them together, and the first will be
> required to merge before the second is enqueued."
>
>So it make sense to share zuul queue, but maybe only one queue for all
> tripleo projects is too  much, for example sharing queue between tripleo-ui
> and tripleo-quickstart, maybe we need for example to queues for product
> stuff and one for CI, so product does not get resetted if CI fails in a
> patch.
>
>What do you think ?
>

Probably a wrong example, as TripleO UI gate is using CI jobs running
tripleo-quickstart scenarios.
We could create more queues for projects which are really independent from
each other but we need to be very careful about it.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-sigs] [all][tc] We're combining the lists! (was: Bringing the community together...)

2018-09-20 Thread Emilien Macchi
On Thu, Sep 20, 2018 at 5:47 PM Doug Hellmann  wrote:

> Excerpts from Jeremy Stanley's message of 2018-09-20 16:32:49 +:
> > tl;dr: The openstack, openstack-dev, openstack-sigs and
> > openstack-operators mailing lists (to which this is being sent) will
> > be replaced by a new openstack-disc...@lists.openstack.org mailing
> > list.
>
> Since last week there was some discussion of including the openstack-tc
> mailing list among these lists to eliminate confusion caused by the fact
> that the list is not configured to accept messages from all subscribers
> (it's meant to be used for us to make sure TC members see meeting
> announcements).
>
> I'm inclined to include it and either use a direct mailing or the
> [tc] tag on the new discuss list to reach TC members, but I would
> like to hear feedback from TC members and other interested parties
> before calling that decision made. Please let me know what you think.
>

+2 , easier to manage, easier to reach out.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] [placement]

2018-09-17 Thread Emilien Macchi
On Mon, Sep 17, 2018 at 5:29 AM Lee Yarwood  wrote:

> FWIW I've also started work on the RDO packaging front [1] and would be
> happy to help with this puppet extraction.
>

Good to know, thanks.
Once we have the repo in place, here is a plan proposal:

* Populate the repo with cookiecutter & adjust to Placement service
* cp code from nova::placement (and nova::wsgi::apache_placement)
* package placement and puppet-placement in RDO
* start testing puppet-placement in puppet-openstack-integration
* switch tripleo-common / THT to deploy placement in nova_placement
container
* switch tripleo to use puppet-placement (in THT)
* probably rename nova_placement container/service into placement or
something generic

Feedback is welcome,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [puppet] [placement]

2018-09-15 Thread Emilien Macchi
I'm currently taking care of creating puppet-placement:
https://review.openstack.org/#/c/602870/
https://review.openstack.org/#/c/602871/
https://review.openstack.org/#/c/602869/

Once these merge, we'll use cookiecutter, and move things from puppet-nova.
We'll also find a way to call puppet-placement from nova::placement class,
eventually.
Hopefully we can make the switch to new placement during Stein!

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [TripleO] podman: varlink interface for nice API calls

2018-09-13 Thread Emilien Macchi
h is
> already
> >>>>> there.
> >>>>>
> >>>>> CRI-O is a socket interface and podman is a CLI interface that both
> sit
> >>>>> on
> >>>>> top of the exact same Go libraries. At this point, switching to
> podman
> >>>>> needs
> >>>>> a much lower development effort because we're replacing docker CLI
> >>>>> calls.
> >>>>>
> >>>> I see good value in evaluating kubelet standalone and leveraging it's
> >>>> inbuilt grpc interfaces with cri-o (rather than using podman) as a
> long
> >>>> term
> >>>> strategy, unless we just want to provide an alternative to docker
> >>>> container
> >>>> runtime with cri-o.
> >>>
> >>> I see no value using kubelet without kubernetes IMHO.
> >>>
> >>>
> >>>>
> >>>>>>
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Kevin
> >>>>>> 
> >>>>>> From: Jay Pipes [jaypi...@gmail.com]
> >>>>>> Sent: Thursday, August 23, 2018 8:36 AM
> >>>>>> To: openstack-dev@lists.openstack.org
> >>>>>> Subject: Re: [openstack-dev] [TripleO] podman: varlink interface for
> >>>>>> nice
> >>>>>> API calls
> >>>>>>
> >>>>>> Dan, thanks for the details and answers. Appreciated.
> >>>>>>
> >>>>>> Best,
> >>>>>> -jay
> >>>>>>
> >>>>>> On 08/23/2018 10:50 AM, Dan Prince wrote:
> >>>>>>>
> >>>>>>> On Wed, Aug 15, 2018 at 5:49 PM Jay Pipes 
> wrote:
> >>>>>>>>
> >>>>>>>> On 08/15/2018 04:01 PM, Emilien Macchi wrote:
> >>>>>>>>>
> >>>>>>>>> On Wed, Aug 15, 2018 at 5:31 PM Emilien Macchi <
> emil...@redhat.com
> >>>>>>>>> <mailto:emil...@redhat.com>> wrote:
> >>>>>>>>>
> >>>>>>>>>More seriously here: there is an ongoing effort to
> converge
> >>>>>>>>> the
> >>>>>>>>>tools around containerization within Red Hat, and we,
> TripleO
> >>>>>>>>> are
> >>>>>>>>>interested to continue the containerization of our
> services
> >>>>>>>>> (which
> >>>>>>>>>was initially done with Docker & Docker-Distribution).
> >>>>>>>>>We're looking at how these containers could be managed by
> k8s
> >>>>>>>>> one
> >>>>>>>>>day but way before that we plan to swap out Docker and
> join
> >>>>>>>>> CRI-O
> >>>>>>>>>efforts, which seem to be using Podman + Buildah (among
> other
> >>>>>>>>> things).
> >>>>>>>>>
> >>>>>>>>> I guess my wording wasn't the best but Alex explained way better
> >>>>>>>>> here:
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> http://eavesdrop.openstack.org/irclogs/%23openstack-tc/%23openstack-tc.2018-08-15.log.html#t2018-08-15T17:56:52
> >>>>>>>>>
> >>>>>>>>> If I may have a chance to rephrase, I guess our current intention
> >>>>>>>>> is
> >>>>>>>>> to
> >>>>>>>>> continue our containerization and investigate how we can improve
> >>>>>>>>> our
> >>>>>>>>> tooling to better orchestrate the containers.
> >>>>>>>>> We have a nice interface (openstack/paunch) that allows us to run
> >>>>>>>>> multiple container backends, and we're currently looking outside
> of
> >>>>>>>>> Docker to see how we could solve our current challenges with the
> >>>>>>>>> new
> >>>>>>>>> tools.
> >>>>>>>>> We're looking at CRI-O because it happens to be a project with a
> &g

[openstack-dev] [election] [tc] thank you

2018-09-04 Thread Emilien Macchi
After 2 years at the TC, I feel lucky enough to have been part of this
group where I hope that my modest contributions helped to make OpenStack a
bit better.
I've learnt so many things and worked with a talented group where it's not
easy every day, but we have made and will continue to progress in the
future.
I personally feel like some rotation needs to happen, therefore I won't run
the current election.

I don't plan to leave or anything, I just wanted to say "merci" to the
community who gave me a chance to be part of this team.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-operators] [ironic][tripleo][edge] Discussing ironic federation and distributed deployments

2018-08-31 Thread Emilien Macchi
On Fri, Aug 31, 2018 at 4:42 AM Dmitry Tantsur  wrote:

> This is about a call a week before the PTG, not the PTG itself. You're
> still
> very welcome to join!
>

It's good too! Our TripleO IRC meeting is at 14 UTC.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-operators] [ironic][tripleo][edge] Discussing ironic federation and distributed deployments

2018-08-30 Thread Emilien Macchi
On Thu, Aug 30, 2018 at 1:21 PM Julia Kreger 
wrote:

> Greetings everyone,
>
> It looks like the most agreeable time on the doodle[1] seems to be
> Tuesday September 4th at 13:00 UTC. Are there any objections to using
> this time?
>
> If not, I'll go ahead and create an etherpad, and setup a bluejeans
> call for that time to enable high bandwidth discussion.
>

TripleO sessions start on Wednesday, so +1 from us (unless I missed
something).
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 29th Edition

2018-08-24 Thread Emilien Macchi
Welcome to the twenty-ninthest edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learnwhat's
new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-August/133094.html

General announcements
=
+--> This week we released Rocky RC1, branched stable/rocky and unless
there are critical bugs we'll call it our final stable release.
+--> The team is preparing for the next PTG:
https://etherpad.openstack.org/p/tripleo-ptg-stein

CI status
=
+--> Sprint theme: Zuul v3 migration (
https://trello.com/b/U1ITy0cu/tripleo-and-rdo-ci?menu=filter=label:Sprint%2018%20CI
)
+--> The Ruck and Rover for this sprint  are Marios and Wes. Please tell
them any CI issue.
+--> Promotion on master is 11 days, 1 day on Rocky, 3 days on Queens, 3
days on Pike and 1 days on Ocata.

Upgrades
=
+--> Adding support for upgrades when OpenShift is deployed.

Containers
=
+--> Efforts to support Podman tracked here:
https://trello.com/b/S8TmOU0u/tripleo-podman

config-download
=
+--> This squad is down and we move forward with the Edge squad.

Edge
=
+--> New squad created by James:
https://etherpad.openstack.org/p/tripleo-edge-squad-status (more to come)

Integration
=
+--> No updates this week.

UI/CLI
=
+--> No updates this week.

Validations
=
+--> No updates this week, reviews are needed:
https://etherpad.openstack.org/p/tripleo-validations-squad-status

Networking
=
+--> Good progress on Ansible ML2 driver

Workflows
=
+--> Planning Stein: better Ansible integration, UI convergence, etc.

Security
=
+--> Working on SElinux for containers (related to podman integration
mainly)

Owl fact
=
"One single Owl can go fast. Multiple owls, together, can go far."
Source: a mix of an African proverb and my Friday-afternoon imagination.


Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Rocky RC1 released!

2018-08-24 Thread Emilien Macchi
We just released Rocky RC1 and branched stable/rocky for most of tripleo
repos, please let us know if we missed something.
Please don't forget to backport the patches that land in master and that
you want in Rocky.

We're currently investigating if we whether or not we'll need an RC2 so
don't be surprised if Launchpad bugs are moved around during the next days.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all] [nova] [placement] placement below or beside compute after extraction?

2018-08-21 Thread Emilien Macchi
If I would be a standalone consummer of OpenStack Placement (e.g. I only
run cinder or ironic to manage volume / baremetal), and I had to run
something like:
$ pip install -U placement

I would prefer "placement" to be a project driven by diverse people
interested by Infrastructure resources placement and not just nova.

In other words, I would be afraid of seeing this project owned by the nova
team since the scope of placement seems to go beyond compute. Instead I
would be at ease to see a separated PTL and core team, who closely work
with OpenStack projects consuming placement service.
People writting placement's code would *own* this project, and decide of
their future. They would serve projects like nova, cinder, maybe ironic one
day, etc.
By making this team more independent, I believe they could build trust in
our community, which is something we desperately need nowadays and have
been encouraging over the last years. I have an high level of confidence
that this new team would be smart enough to collaborate when it comes to
code design decisions, no matter what happened in the past.

Let's reset a little bit and give these people a chance here.
Let's create this independent team.
I believe we could even write down a (short) vision for placement, and a
(short) mission statement, then we can set expectations for the near future.

On Tue, Aug 21, 2018 at 8:55 AM Thierry Carrez 
wrote:

> Matt Riedemann wrote:
> > [...]
> > Regarding microversions I was mostly thinking of the various times I've
> > been asked in the placement channel if something warrants a microversion
> > or if we can just bug fix it in, like microversion 1.26. I then
> > generally feel like I need to be defensive when I say, "yes it's a
> > behavior change in the API so it should." That makes me question how
> > stringent others would be about upholding interoperability concerns if I
> > weren't around. [...]
>
> The issue with that kind of distrust by default is that it's not
> sustainable... In a large project you can't have every individual review
> everything because they trust noone else.
>
> That is why in OpenStack we instituted a culture of "trust by default,
> then escalate to PTL or TC if shit ever hits the fan". And the fact is,
> the PTL (at team level) or the TC (between teams) rarely had to
> arbitrate conflicts, because there aren't so many conflicts that are
> escalated rather than solved by consensus at the lower level.
>
> Restoring "trust by default" between placement and the rest of Nova
> seems to be the root of the problem here. In a community, it's generally
> done by documenting general expectations and shared understandings, so
> that you create a common culture and trust by default people to apply it.
>
> What would you suggest we do to improve that in this specific case?
>
> --
> Thierry Carrez (ttx)
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [TripleO] podman: varlink interface for nice API calls

2018-08-15 Thread Emilien Macchi
On Wed, Aug 15, 2018 at 5:31 PM Emilien Macchi  wrote:

> More seriously here: there is an ongoing effort to converge the tools
> around containerization within Red Hat, and we, TripleO are interested to
> continue the containerization of our services (which was initially done
> with Docker & Docker-Distribution).
> We're looking at how these containers could be managed by k8s one day but
> way before that we plan to swap out Docker and join CRI-O efforts, which
> seem to be using Podman + Buildah (among other things).
>

I guess my wording wasn't the best but Alex explained way better here:
http://eavesdrop.openstack.org/irclogs/%23openstack-tc/%23openstack-tc.2018-08-15.log.html#t2018-08-15T17:56:52

If I may have a chance to rephrase, I guess our current intention is to
continue our containerization and investigate how we can improve our
tooling to better orchestrate the containers.
We have a nice interface (openstack/paunch) that allows us to run multiple
container backends, and we're currently looking outside of Docker to see
how we could solve our current challenges with the new tools.
We're looking at CRI-O because it happens to be a project with a great
community, focusing on some problems that we, TripleO have been facing
since we containerized our services.

We're doing all of this in the open, so feel free to ask any question.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [TripleO] podman: varlink interface for nice API calls

2018-08-15 Thread Emilien Macchi
Hi Jay,

On Wed, Aug 15, 2018 at 3:59 PM Jay Pipes  wrote:

> This was news to me. Is this just a triple-o thing?
>

It's in the newspapers!
https://www.serverwatch.com/server-news/red-hat-looks-beyond-docker-for-container-technology.html

More seriously here: there is an ongoing effort to converge the tools
around containerization within Red Hat, and we, TripleO are interested to
continue the containerization of our services (which was initially done
with Docker & Docker-Distribution).
We're looking at how these containers could be managed by k8s one day but
way before that we plan to swap out Docker and join CRI-O efforts, which
seem to be using Podman + Buildah (among other things).

The work done at this time (so far) is pure investigation, but feedback is
always welcome.
We're tracking our efforts here:
https://etherpad.openstack.org/p/tripleo-podman

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] migrating to storyboard

2018-08-15 Thread Emilien Macchi
On Tue, Aug 14, 2018 at 6:33 PM Tobias Urdin  wrote:

> Please let me know what you think about moving to Storyboard?
>
Go for it. AFIK we don't have specific blockers to make that migration
happening.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 28th Edition

2018-08-09 Thread Emilien Macchi
Welcome to the twenty-eightiest edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-July/132672.html

+-+
| General announcements |
+-+

+--> We're still preparing the first release candidate of TripleO Rocky,
please focus on Critical / High bugs.
+--> Reminder about PTG etherpad, feel free to propose topics:
https://etherpad.openstack.org/p/tripleo-ptg-stein
+--> Juan will be the next PTL for Stein cycle, congratulations!

+--+
| Continuous Integration |
+--+

+--> Sprint theme: migration to zuul v3, including migrating from legacy
bash to ansible tasks/playbooks (More on
https://trello.com/c/JikmHXSS/881-sprint-17-goals)
+--> The Ruck and Rover for this sprint  are Gabriele Cerami (panda) and
Rafael Folco (rfolco). Please tell them any CI issue.
+--> Promotion on master is 2 days, 9 day on Queens, 0 days on Pike and 7
days on Ocata.
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> No updates this week.
<https://review.openstack.org/#/q/status:open+branch:master+topic:external-update-upgrade>

+---+
| Containers |
+---+

+--> The team is looking at podman/buildah support for Stein cycle. More
discussions at the PTG, but doing some ground work now.

+--+
| config-download |
+--+

+--> No updates this week..

+--+
| Integration |
+--+

+--> No updates this week.

+-+
| UI/CLI |
+-+

+--> No updates this week.

+---+
| Validations |
+---+

+--> No updates this week.

+---+
| Networking |
+---+

+--> No updates this week.

+--+
| Workflows |
+--+

+--> Progress on the Mistral tempest plugin and testing on the
containerized undercloud job.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Discussion around secret management.
+--> Last meeting notes:
http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-08-08-12.03.log.html
<http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-07-18-12.07.html>
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++
Owl Wings Are Helping Silence Airplanes, Fans, and Wind Turbines
Nice reading:
https://gizmodo.com/owl-wings-are-helping-silence-airplanes-fans-and-wind-1713023055
Thanks Cédric for this contribution!

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Stepping down as coordinator for the Outreachy internships

2018-08-08 Thread Emilien Macchi
Thanks Victoria for all your efforts, highly recognized!

---
Emilien Macchi

On Tue, Aug 7, 2018, 7:48 PM Victoria Martínez de la Cruz, <
victo...@vmartinezdelacruz.com> wrote:

> Hi all,
>
> I'm reaching you out to let you know that I'll be stepping down as
> coordinator for OpenStack next round. I had been contributing to this
> effort for several rounds now and I believe is a good moment for somebody
> else to take the lead. You all know how important is Outreachy to me and
> I'm grateful for all the amazing things I've done as part of the Outreachy
> program and all the great people I've met in the way. I plan to keep
> involved with the internships but leave the coordination tasks to somebody
> else.
>
> If you are interested in becoming an Outreachy coordinator, let me know
> and I can share my experience and provide some guidance.
>
> Thanks,
>
> Victoria
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Stepping down as coordinator for the Outreachy internships

2018-08-08 Thread Emilien Macchi
---
Emilien Macchi

On Wed, Aug 8, 2018, 5:14 AM Thierry Carrez,  wrote:

> Victoria Martínez de la Cruz wrote:
> > I'm reaching you out to let you know that I'll be stepping down as
> > coordinator for OpenStack next round. I had been contributing to this
> > effort for several rounds now and I believe is a good moment for
> > somebody else to take the lead. You all know how important is Outreachy
> > to me and I'm grateful for all the amazing things I've done as part of
> > the Outreachy program and all the great people I've met in the way. I
> > plan to keep involved with the internships but leave the coordination
> > tasks to somebody else.
>
> Thanks for helping with this effort for all this time !
>
> --
> Thierry Carrez (ttx)
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Proposing Lukas Bezdicka core on TripleO

2018-08-01 Thread Emilien Macchi
On Wed, Aug 1, 2018 at 7:33 AM Giulio Fidente  wrote:

> I would like to propose Lukas Bezdicka core on TripleO.
>

Thanks Giulio for proposing him.
I agree Lukas's technical level has been quite impactful in the
Fast-Forward-Upgrades effort, and upgrades in general.
Also his strong experience with TripleO testing over the last years will
make him a great core reviewer, careful to not break upgrades and maintain
code consistency across the project.

Thanks Lukas for your efforts, keep going!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 27th Edition

2018-07-31 Thread Emilien Macchi
Welcome to the twenty-seventh edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-July/132448.html

+-+
| General announcements |
+-+

+--> We're preparing the first release candidate of TripleO Rocky, please
focus on Critical / High bugs.
+--> Reminder about PTG etherpad, feel free to propose topics:
https://etherpad.openstack.org/p/tripleo-ptg-stein

+--+
| Continuous Integration |
+--+

+--> Sprint theme: migration to zuul v3, including migrating from legacy
bash to ansible tasks/playbooks (More on
https://trello.com/c/JikmHXSS/881-sprint-17-goals)
+--> The Ruck and Rover for this sprint  are Gabriele Cerami (panda) and
Rafael Folco (rfolco). Please tell them any CI issue.
+--> Promotion on master is 11 days, 0 day on Queens, 3 days on Pike and 4
days on Ocata.
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> Need review on work for updates/upgrades with external installers:
https://review.openstack.org/#/q/status:open+branch:master+topic:external-update-upgrade
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> No major update this week, in bug fixing mode.
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> No updates this week..
+--> More:
https://etherpad.openstack.org/p/tripleo-config-download-squad-status

+--+
| Integration |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> config-download support work is landed!
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> Need review on custom validations support.
+--> Efforts around Mistral workflow lookup plugin
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> Policy based routing for os-net-config
+--> Patches for Neutron routed networks support using segments for TripleO
+--> Ansible ML2 driver: good progress on patches and testing.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> No updates this week.
+--> Last meeting notes:
http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-07-18-12.07.html
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++
Owls have far-sighted, tubular eyes: instead of spherical eyeballs, owls
have "eye tubes" that go far back into their skulls - which means their
eyes are fixed in place, so they have to turn their heads to see. The size
of their eyes helps them see in the dark, and they're far-sighted, which
allows them to spot prey from yards away. Up close, everything is blurry,
and they depend on small, hair-like feathers on their beaks and feet to
feel their food.

Source: http://mentalfloss.com/article/68473/15-mysterious-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Rocky Ceph update/upgrade regression risk (semi-FFE)

2018-07-27 Thread Emilien Macchi
On Fri, Jul 27, 2018 at 3:58 AM Jiří Stránský  wrote:

> I'd call this a semi-FFE, as a few of the patches have characteristics of
> feature work,
> but at the same time i don't believe we can afford having Ceph
> unupgradable in Rocky, so it has characteristics of a regression bug
> too. I reported a bug [2] and tagged the patches in case we end up
> having to do backports.
>

Right, let's consider it as a bug and not a feature. Also, it's upgrade
related so it's top-priority as we did in prior cycles. Therefore I think
it's fine.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Rocky milestone 3 was released!

2018-07-26 Thread Emilien Macchi
Kudos to the team, we just release our third Rocky milestone!

As usual, I prepared some numbers so you can see our project health:
https://docs.google.com/presentation/d/1RV30OVxmXv1y_z33LuXMVB56TA54Urp7oHIoTNwrtzA/edit#slide=id.p

Some comments:
1) More bugs were fixed in rocky milestone 3 than before.
2) Milestone 2 and Milestone 2 delivered the same amount of blueprints.
3) Our list of core reviewers keep growing!
4) Commits and LOC are much higher than Queens.

Now the focus should be on stabilization and bug fixing, we are in release
candidate mode which means no more features unless you have FFE granted.

Thanks everyone for this hard work!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] [tripleo-validations] using using top-level fact vars will deprecated in future Ansible versions

2018-07-26 Thread Emilien Macchi
On Thu, Jul 26, 2018 at 12:30 PM John Fulton  wrote:

> Do we have a plan for which Ansible version might be the default in
> upcoming TripleO versions?
>
> If this is the thread to discuss it then, I want to point out that
> TripleO's been using ceph-ansible for Ceph integration on the client
> and server side since Pike and that ceph-ansible 3.1 (which TripleO
> master currently uses) fails on Ansible 2.6 and that this won't be
> addressed until ceph-ansible 3.2.
>

I think the last thing we want is to break TripleO + Ceph integration so we
will maintain Ansible 2.5.x in TripleO Rocky and upgrade to 2.6.x in Stein
when ceph-ansible 3.2 is used and working well.

Hope it's fine for everyone,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 26th Edition

2018-07-24 Thread Emilien Macchi
Welcome to the twenty-sixth edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-July/132301.html

+-+
| General announcements |
+-+

+--> Rocky Milestone 3 is this week. The team should focus on
stabilization, bug fixing, testing, so we can make our rocky release more
awesome.
+--> Reminder about PTG etherpad, feel free to propose topics:
https://etherpad.openstack.org/p/tripleo-ptg-stein
+--> PTL elections are open! If you want to be the next TripleO PTL, it's
the right time to send your candidacy *now* !

+--+
| Continuous Integration |
+--+

+--> Sprint theme: migration to Zuul v3 (More on
https://trello.com/c/vyWXcKOB/841-sprint-16-goals)
+--> Sagi is the rover and Chandan is the ruck. Please tell them any CI
issue.
+--> Promotion on master is 4 days, 0 days on Queens, 2 days on Pike and 0
day on Ocata.
+--> RDO Third Party jobs are currently down:
https://tree.taiga.io/project/morucci-software-factory/issue/1560
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> Progress on work for updates/upgrades with external installers:
https://review.openstack.org/#/q/status:open+branch:master+topic:external-update-upgrade
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Lot of testing around containerized undercloud, please let us know any
problem.
+--> Image prepare via workflow is still work in progress.
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> UI integration needs review.
+--> Bug with failure listing is in progress:
https://bugs.launchpad.net/tripleo/+bug/1779093
+--> More:
https://etherpad.openstack.org/p/tripleo-config-download-squad-status

+--+
| Integration |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Major Network Configuration patches landed! Congrats team!
+--> Config-download patches are being reviewed and a lot of testing is
going on.
+--> The team is working on a Tempest Plugin for TripleO UI:
https://review.openstack.org/#/c/575730/
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Working on Secrets management.
+--> Last meeting notes:
http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-07-18-12.07.html
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++
Owls feed the strongest babies first.
As harsh as it sounds, the parents always feed the oldest and strongest
owlet before its sibling. This means that if food is scarce, the youngest
chicks will starve. After an owlet leaves the nest, it often lives nearby
in the same tree, and its parents still bring it food. If it can survive
the first winter on its own, its chances of survival are good.

Source: http://mentalfloss.com/article/68473/15-mysterious-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] [tripleo-validations] using using top-level fact vars will deprecated in future Ansible versions

2018-07-23 Thread Emilien Macchi
Thanks Monty for pointing that out to me today on #ansible-devel.

Context: https://github.com/ansible/ansible/pull/41811
The top-level fact vars are currently being deprecated in Ansible, maybe
2.7.
It looks like it only affects tripleo-validations (in a quick look), but it
could be more.
See: http://codesearch.openstack.org/?q=ansible_facts=nope==

An example playbook was written to explain what is deprecated:
https://github.com/ansible/ansible/pull/41811#issuecomment-399220997

But it seems like, starting with Ansible 2.5 (what we already have in Rocky
and beyond), we should encourage the usage of ansible_facts dictionary.
Example:
var=hostvars[inventory_hostname].ansible_facts.hostname
instead of:
var=ansible_hostname

Can we have someone from TripleO Validations to help, and make sure we make
it working for future versions of Ansible.
Also there is a way to test this behavior by disabling the
'inject_facts_as_vars' option in ansible.cfg.

Hope this helps,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] prototype with standalone mode and remote edge compute nodes

2018-07-20 Thread Emilien Macchi
On Fri, Jul 20, 2018 at 2:55 PM Ben Nemec  wrote:

> Okay, based on a private conversation this is coming off as way more
> troll-ish than I intended.  I don't understand where this work is going,
> but I don't really need to so I'll step back from the discussion.
> Apologies for any offense.
>

No offense here, Ben. In fact I hope we can still continue to have a
productive discussion here.

I'm speaking on my own view now, and I'm happy to be wrong and learn but I
wanted to explore how far we can bring the work around standalone
architecture. If it was worth exploring making it "multi-node" somehow,
what would be our technical challenges and more than anything else: what
use-case we would enable.

I'm actually quite happy to see that people already looked at some of these
challenges before (see what Giulio / James / Steve H. already worked on),
so I guess it makes sense to continue the investigation.
We are not making any decision right now in what API we plan to use. The
current production architecture is still undercloud + overcloud, and our
day 2 operations are done by Mistral/Heat for now but as we transition more
to Ansible I think we wanted to explore more options.

I hope this little background helped.
Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] prototype with standalone mode and remote edge compute nodes

2018-07-20 Thread Emilien Macchi
On Fri, Jul 20, 2018 at 7:43 AM Emilien Macchi  wrote:

> On Fri, Jul 20, 2018 at 7:09 AM Emilien Macchi  wrote:
>
>> Yeah I thought about this one too but I didn't have this challenge since
>> I just wanted nova-compute & neutron-ovs-agent running on the edge.
>>
>
> Actually I just faced it:
> Error: Failed to perform requested operation on instance "my-vm", the
> instance has an error status: Please try again later [Error: Host
> 'standalone-cpu-edge.localdomain' is not mapped to any cell].
>
> I had to manually add the edge compute on the central node, so yeah we
> need to figure that out for the compute as well (unless I missed something
> in the nova config).
>

Nevermind, I had to set NovaSchedulerDiscoverHostsInCellsInterval to 300,
so nova-schedule checks for new compute nodes every 300s and include them
in the cell.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] prototype with standalone mode and remote edge compute nodes

2018-07-20 Thread Emilien Macchi
On Fri, Jul 20, 2018 at 7:09 AM Emilien Macchi  wrote:

> Yeah I thought about this one too but I didn't have this challenge since I
> just wanted nova-compute & neutron-ovs-agent running on the edge.
>

Actually I just faced it:
Error: Failed to perform requested operation on instance "my-vm", the
instance has an error status: Please try again later [Error: Host
'standalone-cpu-edge.localdomain' is not mapped to any cell].

I had to manually add the edge compute on the central node, so yeah we need
to figure that out for the compute as well (unless I missed something in
the nova config).
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] prototype with standalone mode and remote edge compute nodes

2018-07-20 Thread Emilien Macchi
On Fri, Jul 20, 2018 at 4:20 AM Giulio Fidente  wrote:
[...]

> I have started experimenting with edge deployments to help out on the
> split-controplane spec [1], which Steven started addressing
>
> I was able to deploy multiple stacks and isolated Ceph clusters, there
> are some bits missing to provision a working configuration for
> nova-compute to the edge services, but we could probably collect/export
> the necessary outputs from the parent stack (eg. rabbit connection
> infos) and feed the edge stacks with those.
>

Indeed, I faced the exact same problems. I could hardcode the rabbit
password and memcache IP via hieradata extraconfig, James showed
me AllNodesExtraMapData done via https://review.openstack.org/#/c/581080/
which I'll probably give a try.
However I couldn't set keystone url for nova / neutron (they are taken from
ServiceNetMap).
James pointed out to me this patch: https://review.openstack.org/#/c/521929/
- Do you think we should re-use the service net map from the central node,
on the edge compute node?

A much bigger challenge seems to me that for some services (eg. glance
> or cinder) we need to "refresh" the configuration of the controlplane
> nodes to push the details of the newly deployed ceph clusters (backends)
> of the edge nodes as backends for the controlplane services.
>

Yeah I thought about this one too but I didn't have this challenge since I
just wanted nova-compute & neutron-ovs-agent running on the edge.

Alternatively, we could opt for the deployment of cinder-volume
> instances on the edge nodes, but we would still have the same problem
> for glance and possibly other services.
>

For now the only thing I see is to manually update the config on the
central node and run the deployment again, which should reconfigure the
containers.

I'd like to discuss further this topic at the PTG to gether more
> feedback so I added a bullet to the pad with the Stein PTG topics [2].


It would be awesome to spend time on this topic! Thanks for bringing this
blueprint up! Indeed I hope we'll make progress on this one at the PTG,
which is why I sent this email really early to groom some ideas.


> 1. https://blueprints.launchpad.net/tripleo/+spec/split-controlplane
> 2. https://etherpad.openstack.org/p/tripleo-ptg-stein


Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Proposing Jose Luis Franco for TripleO core reviewer on Upgrade bits

2018-07-20 Thread Emilien Macchi
On Fri, Jul 20, 2018 at 4:09 AM Carlos Camacho Gonzalez 
wrote:

> Hi!!!
>
> I'll like to propose Jose Luis Franco [1][2] for core reviewer in all the
> TripleO upgrades bits. He shows a constant and active involvement in
> improving and fixing our updates/upgrades workflows, he helps also trying
> to develop/improve/fix our upstream support for testing the
> updates/upgrades.
>
> Please vote -1/+1, and consider this my +1 vote :)
>

Nice work indeed, +1. Keep doing a good job and thanks for all your help!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] prototype with standalone mode and remote edge compute nodes

2018-07-19 Thread Emilien Macchi
Today I played a little bit with Standalone deployment [1] to deploy a
single OpenStack cloud without the need of an undercloud and overcloud.
The use-case I am testing is the following:
"As an operator, I want to deploy a single node OpenStack, that I can
extend with remote compute nodes on the edge when needed."

We still have a bunch of things to figure out so it works out of the box,
but so far I was able to build something that worked, and I found useful to
share it early to gather some feedback:
  https://gitlab.com/emacchi/tripleo-standalone-edge

Keep in mind this is a proof of concept, based on upstream documentation
and re-using 100% what is in TripleO today. The only thing I'm doing is to
change the environment and the roles for the remote compute node.
I plan to work on cleaning the manual steps that I had to do to make it
working, like hardcoding some hiera parameters and figure out how to
override ServiceNetmap.

Anyway, feel free to test / ask questions / provide feedback.

Thanks,
[1]
https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/standalone.html
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Stein blueprint - Plan to remove Keepalived support (replaced by Pacemaker)

2018-07-19 Thread Emilien Macchi
On Thu, Jul 19, 2018 at 6:02 AM Raoul Scarazzini  wrote:
[...]

> Small question aside related to all-in-one: we're talking about use
> cases in which we might want to go from 1 to 3 controllers, but how this
> can become a thing? I always thought to all-in-one as a developer/ci
> "tool", so why we should care about giving the possibility to expand?
>

We have a few other use-cases but 2 of them are:

- PoC deployed on the field, start with one controller, scale up to 3
controllers (with compute services deployed as well).
- Edge Computing, where we could think of a controller being scaled-out as
well, or a remote compute note being added, with VMs in HA with pacemaker.

But I agree that the first target for now is to fulfil the developer use
case, and PoC use case (on one node).

This question is related also to the main topic of this thread: it was
> proposed to replace Keepalived with anything (instead of Pacemaker), and
> one of the outcomes was that this approach would not guarantee some of
> the goals, like undercloud HA and keeping 1:1 structure between
> undercloud and overcloud. But what else are we supposed to control with
> Pacemaker on the undercloud apart from the IPs?
>

Nothing, AFIK. The VIPs were the only things we wanted to managed on a
single-node undercloud.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] EOL process for newton branches

2018-07-18 Thread Emilien Macchi
Option 2, EOL everything.
Thanks a lot for your help on this one, Tony.
---
Emilien Macchi

On Wed, Jul 18, 2018, 7:47 PM Tony Breeds,  wrote:

>
> Hi All,
> As of I3671f10d5a2fef0e91510a40835de962637f16e5 we have meta-data in
> openstack/releases that tells us that the following repos are at
> newton-eol:
>  - openstack/instack-undercloud
>  - openstack/os-net-config
>  - openstack/puppet-tripleo
>  - openstack/tripleo-common
>  - openstack/tripleo-heat-templates
>
> I was setting up the request to create the tags and delete those
> branches but I noticed that the following repos have newton branches and
> are not in the list above:
>
>  - openstack/instack
>  - openstack/os-apply-config
>  - openstack/os-collect-config
>  - openstack/os-refresh-config
>  - openstack/python-tripleoclient
>  - openstack/tripleo-image-elements
>  - openstack/tripleo-puppet-elements
>  - openstack/tripleo-ui
>  - openstack/tripleo-validations
>
> So I guess there are a couple of options here:
>
> 1) Just EOL the 5 repos that opensatck/releases knows are at EOL
> 2) EOL the repos from both lists ad update openstack/releases to flag
>them as such
>
> I feel like option 2 is the correct option but perhaps there is a reason
> those repos where not tagged and released
>
>
> Yours Tony.
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Stein blueprint - Plan to remove Keepalived support (replaced by Pacemaker)

2018-07-18 Thread Emilien Macchi
ire to use the same architecture as the
> Overcloud (Pacemaker). And there is some competition between them.
>
> For simplification: If we can eliminate keepalived and still use
> HAProxy (thus keeping the SSL termination features working) then I
> think that would be worth trying. Specifically can we eliminate
> Keepalived without swapping in Pacemaker? Michele: if you have ideas
> here lets try them!
>
> With regards to Pacemaker I think we need to make an exception. It
> seems way too heavy for single node setups and increases the complexity
> there for very little benefit. To me the shared architecture for
> TripleO is the tools we use to setup services. By using t-h-t to drive
> our setup of the Undercloud and All-In-One installers we are already
> gaining a lot of benefit here. Pacemaker is weird as it is kind of
> augments the architecture a bit (HA architecture). But Pacemaker is
> also a service that gets configured by TripleO. So it kind of falls
> into both categories. Pacemaker gives us features we need in the
> Overcloud at the cost of some extra complexity. And in addition to all
> this we are still running the Pacemaker processes themselves on
> baremetal. All this just to say we are running the same "architecture"
> on both the Undercloud and Overcloud? I'm not a fan.
>
> Dan
>
>
>
> >
> > > D) Undercloud HA is a nice have which I think we want to get to one
> > > day, but it is not in as big demand as for example edge
> > > deployments,
> > > BM provisioning with pure OS, or multiple envs managed by single
> > > undercloud. So even though undercloud HA is important, it won’t
> > > bring
> > > operators as many benefits as the previously mentioned
> > > improvements.
> > > Let’s keep it in mind when we are considering the amount of work
> > > needed for it.
> >
> > +100
> >
> > > E) One of the use-cases we want to take into account is expanind a
> > > single-node deployment (all-in-one) to 3 node HA controller. I
> > > think
> > > it is important when evaluating PCMK/keepalived
> >
> > Right, so to be able to implement this, there is no way around having
> > pacemaker (at least today until we have galera and rabbit).
> > It still does not mean we have to default to it, but if you want to
> > scale beyond one node, then there is no other option atm.
> >
> > > HTH
> >
> > It did, thanks!
> >
> > Michele
> > > — Jarda
> > >
> > > > On Jul 17, 2018, at 05:04, Emilien Macchi 
> > > > wrote:
> > > >
> > > > Thanks everyone for the feedback, I've made a quick PoC:
> > > > https://review.openstack.org/#/q/topic:bp/undercloud-pacemaker-de
> > > > fault
> > > >
> > > > And I'm currently doing local testing. I'll publish results when
> > > > progress is made, but I've made it so we have the choice to
> > > > enable pacemaker (disabled by default), where keepalived would
> > > > remain the default for now.
> > > >
> > > > On Mon, Jul 16, 2018 at 2:07 PM Michele Baldessari  > > > n.org> wrote:
> > > > On Mon, Jul 16, 2018 at 11:48:51AM -0400, Emilien Macchi wrote:
> > > > > On Mon, Jul 16, 2018 at 11:42 AM Dan Prince  > > > > > wrote:
> > > > > [...]
> > > > >
> > > > > > The biggest downside IMO is the fact that our Pacemaker
> > > > > > integration is
> > > > > > not containerized. Nor are there any plans to finish the
> > > > > > containerization of it. Pacemaker has to currently run on
> > > > > > baremetal
> > > > > > and this makes the installation of it for small dev/test
> > > > > > setups a lot
> > > > > > less desirable. It can launch containers just fine but the
> > > > > > pacemaker
> > > > > > installation itself is what concerns me for the long term.
> > > > > >
> > > > > > Until we have plans for containizing it I suppose I would
> > > > > > rather see
> > > > > > us keep keepalived as an option for these smaller setups. We
> > > > > > can
> > > > > > certainly change our default Undercloud to use Pacemaker (if
> > > > > > we choose
> > > > > > to do so). But having keepalived around for "lightweight"
> > > > > > (zero or low
> > > > > > footprint) installs that wo

[openstack-dev] [tripleo] The Weekly Owl - 25th Edition

2018-07-17 Thread Emilien Macchi
Your fellow reporter took a break from writing, but is now back on his pen.

Welcome to the twenty-fifth edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-June/131426.html

+-+
| General announcements |
+-+

+--> Rocky Milestone 3 is next week. After, any feature code will require
Feature Freeze Exception (FFE), asked on the mailing-list. We'll enter a
bug-fix only and stabilization period, until we can push the first stable
version of Rocky.
+--> Next PTG will be in Denver, please propose topics:
https://etherpad.openstack.org/p/tripleoci-ptg-stein
+--> Multiple squads are currently brainstorming a framework to provide
validations pre/post upgrades - stay in touch!

+--+
| Continuous Integration |
+--+

+--> Sprint theme: migration to Zuul v3 (More on
https://trello.com/c/vyWXcKOB/841-sprint-16-goals)
+--> Sagi is the rover and Chandan is the ruck. Please tell them any CI
issue.
+--> Promotion on master is 4 days, 0 days on Queens and Pike and 1 day on
Ocata.
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> Good progress on major upgrades workflow, need reviews!
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> We switched python-tripleoclient to deploy containerized undercloud by
default!
+--> Image prepare via workflow is still work in progress.
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> UI integration is almost done (need review)
+--> Bug with failure listing is being fixed:
https://bugs.launchpad.net/tripleo/+bug/1779093
+--> More:
https://etherpad.openstack.org/p/tripleo-config-download-squad-status

+--+
| Integration |
+--+

+--> We're enabling decoupled deployment plans e.g for OpenShift, DPDK etc:
https://review.openstack.org/#/q/topic:alternate_plans+(status:open+OR+status:merged)
(need reviews).
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Good progress on network configuration via UI
+--> Config-download patches are being reviewed and a lot of testing is
going on.
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> Working on OpenShift validations, need reviews.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Working on Secrets management and Limit TripleO users efforts
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++
Elf owls live in a cacti. They are the smallest owls, and live in the
southwestern United States and Mexico. It will sometimes make its home in
the giant saguaro cactus, nesting in holes made by other animals. However,
the elf owl isn’t picky and will also live in trees or on telephone poles.

Source: http://mentalfloss.com/article/68473/15-mysterious-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Stein blueprint - Plan to remove Keepalived support (replaced by Pacemaker)

2018-07-16 Thread Emilien Macchi
Thanks everyone for the feedback, I've made a quick PoC:
https://review.openstack.org/#/q/topic:bp/undercloud-pacemaker-default

And I'm currently doing local testing. I'll publish results when progress
is made, but I've made it so we have the choice to enable pacemaker
(disabled by default), where keepalived would remain the default for now.

On Mon, Jul 16, 2018 at 2:07 PM Michele Baldessari 
wrote:

> On Mon, Jul 16, 2018 at 11:48:51AM -0400, Emilien Macchi wrote:
> > On Mon, Jul 16, 2018 at 11:42 AM Dan Prince  wrote:
> > [...]
> >
> > > The biggest downside IMO is the fact that our Pacemaker integration is
> > > not containerized. Nor are there any plans to finish the
> > > containerization of it. Pacemaker has to currently run on baremetal
> > > and this makes the installation of it for small dev/test setups a lot
> > > less desirable. It can launch containers just fine but the pacemaker
> > > installation itself is what concerns me for the long term.
> > >
> > > Until we have plans for containizing it I suppose I would rather see
> > > us keep keepalived as an option for these smaller setups. We can
> > > certainly change our default Undercloud to use Pacemaker (if we choose
> > > to do so). But having keepalived around for "lightweight" (zero or low
> > > footprint) installs that work is really quite desirable.
> > >
> >
> > That's a good point, and I agree with your proposal.
> > Michele, what's the long term plan regarding containerized pacemaker?
>
> Well, we kind of started evaluating it (there was definitely not enough
> time around pike/queens as we were busy landing the bundles code), then
> due to discussions around k8s it kind of got off our radar. We can
> at least resume the discussions around it and see how much effort it
> would be. I'll bring it up with my team and get back to you.
>
> cheers,
> Michele
> --
> Michele Baldessari
> C2A5 9DA3 9961 4FFB E01B  D0BC DDD4 DCCB 7515 5C6D
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Stein blueprint - Plan to remove Keepalived support (replaced by Pacemaker)

2018-07-16 Thread Emilien Macchi
On Mon, Jul 16, 2018 at 11:42 AM Dan Prince  wrote:
[...]

> The biggest downside IMO is the fact that our Pacemaker integration is
> not containerized. Nor are there any plans to finish the
> containerization of it. Pacemaker has to currently run on baremetal
> and this makes the installation of it for small dev/test setups a lot
> less desirable. It can launch containers just fine but the pacemaker
> installation itself is what concerns me for the long term.
>
> Until we have plans for containizing it I suppose I would rather see
> us keep keepalived as an option for these smaller setups. We can
> certainly change our default Undercloud to use Pacemaker (if we choose
> to do so). But having keepalived around for "lightweight" (zero or low
> footprint) installs that work is really quite desirable.
>

That's a good point, and I agree with your proposal.
Michele, what's the long term plan regarding containerized pacemaker?
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Plan to switch the undercloud to be containerized by default

2018-07-15 Thread Emilien Macchi
On Tue, Jul 10, 2018, 7:57 PM Emilien Macchi,  wrote:

> with [tripleo] tag...
>
> On Tue, Jul 10, 2018 at 7:56 PM Emilien Macchi  wrote:
>
>> This is an update on where things are regarding $topic, based on feedback
>> I've got from the work done recently:
>>
>> 1) Switch --use-heat to take a boolean and deprecate it
>>
>> We still want to allow users to deploy non containerized underclouds, so
>> we made this patch so they can use --use-heat=False:
>> https://review.openstack.org/#/c/581467/
>> Also https://review.openstack.org/#/c/581468 and
>> https://review.openstack.org/581180 as dependencies
>>
>> 2) Configure CI jobs for containerized undercloud, except scenario001,
>> 002 for timeout reasons (and figure out this problem in a parallel effort)
>>
>> https://review.openstack.org/#/c/575330
>> https://review.openstack.org/#/c/579755
>>
>> 3) Switch tripleoclient to deploy by default a containerized undercloud
>>
>> https://review.openstack.org/576218
>>
>
It merged today, hopefully all CI jobs (including promotion) will continue
to run smoothly. Thanks everyone involved in this big effort!


>> 4) Improve performances in general so scenario001/002 doesn't timeout
>> when containerized undercloud is enabled
>>
>> https://review.openstack.org/#/c/581183 is the patch that'll enable the
>> containerized undercloud
>> https://review.openstack.org/#/c/577889/ is a patch that enables
>> pipelining in ansible/quickstart, but more is about to come, I'll update
>> the patches tonight.
>>
>
These scenarios are still on the edge of a timeout, we'll keep working on
those.


>> 5) Cleanup quickstart to stop using use-heat except for fs003 (needed to
>> disable containers, and keep coverage for non containerized undercloud)
>>
>> https://review.openstack.org/#/c/581534/
>>
>>
>> Reviews are welcome, we aim to merge this work by milestone 3, in less
>> than 2 weeks from now.
>>
>
Since we merged the majority of the work, I think we can close the
blueprint and not require FFE.
Any feedback on that statement is welcome.

Thanks,
Emilien

>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Stein blueprint - Plan to remove Keepalived support (replaced by Pacemaker)

2018-07-13 Thread Emilien Macchi
Greetings,

We have been supporting both Keepalived and Pacemaker to handle VIP
management.
Keepalived is actually the tool used by the undercloud when SSL is enabled
(for SSL termination).
While Pacemaker is used on the overcloud to handle VIPs but also services
HA.

I see some benefits at removing support for keepalived and deploying
Pacemaker by default:
- pacemaker can be deployed on one node (we actually do it in CI), so can
be deployed on the undercloud to handle VIPs and manage HA as well.
- it'll allow to extend undercloud & standalone use cases to support
multinode one day, with HA and SSL, like we already have on the overcloud.
- it removes the complexity of managing two tools so we'll potentially
removing code in TripleO.
- of course since pacemaker features from overcloud would be usable in
standalone environment, but also on the undercloud.

There is probably some downside, the first one is I think Keepalived is
much more lightweight than Pacemaker, we probably need to run some
benchmark here and make sure we don't make the undercloud heavier than it
is now.

I went ahead and created this blueprint for Stein:
https://blueprints.launchpad.net/tripleo/+spec/undercloud-pacemaker-default
I also plan to prototype some basic code soon and provide an upgrade path
if we accept this blueprint.

This is something I would like to discuss here and at the PTG, feel free to
bring questions/concerns,
Thanks!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Rocky blueprints

2018-07-13 Thread Emilien Macchi
On Thu, Jul 12, 2018 at 11:07 AM Bogdan Dobrelya 
wrote:
[...]

> > -
> https://blueprints.launchpad.net/tripleo/+spec/containerized-undercloud
>
> This needs FFE please.  [...]


No i don't think we need FFE for containerized undercloud. Most of the code
has merged and we're switching the default in tripleoclient as of today if
the patches merge (in gate today probably).
So we're good on this one.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Updates/upgrades equivalent for external_deploy_tasks

2018-07-12 Thread Emilien Macchi
On Tue, Jul 10, 2018 at 10:22 AM Jiří Stránský  wrote:

> Hi,
>
> with the move to config-download deployments, we'll be moving from
> executing external installers (like ceph-ansible) via Heat resources
> encapsulating Mistral workflows towards executing them via Ansible
> directly (nested Ansible process via external_deploy_tasks).
>
> Updates and upgrades still need to be addressed here. I think we should
> introduce external_update_tasks and external_upgrade_tasks for this
> purpose, but i see two options how to construct the workflow with them.
>
> During update (mentioning just updates, but upgrades would be done
> analogously) we could either:
>
> A) Run external_update_tasks, then external_deploy_tasks.
>
> This works with the assumption that updates are done very similarly to
> deployment. The external_update_tasks could do some prep work and/or
> export Ansible variables which then could affect what
> external_deploy_tasks do (e.g. in case of ceph-ansible we'd probably
> override the playbook path). This way we could also disable specific
> parts of external_deploy_tasks on update, in case reuse is undesirable
> in some places.
>
> B) Run only external_update_tasks.
>
> This would mean code for updates/upgrades of externally deployed
> services would be completely separated from how their deployment is
> done. If we wanted to reuse some of the deployment tasks, we'd have to
> use the YAML anchor referencing mechanisms. (, *anchor)
>
> I think the options are comparable in terms of what is possible to
> implement with them, the main difference is what use cases we want to
> optimize for.
>
> Looking at what we currently have in external_deploy_tasks (e.g.
> [1][2]), i think we'd have to do a lot of explicit reuse if we went with
> B (inventory and variables generation, ...). So i'm leaning towards
> option A (WIP patch at [3]) which should give us this reuse more
> naturally. This approach would also be more in line with how we already
> do normal updates and upgrades (also reusing deployment tasks). Please
> let me know in case you have any concerns about such approach (looking
> especially at Ceph and OpenShift integrators :) ).
>

+1 for Option A as well, I feel like it's the one which would give us the
more of flexibility and also I'm not a big fan of the usage of Anchors for
this use case.
Some folks are currently working on extracting these tasks out of THT and I
can already see something like:

external_deploy_tasks
  - include_role:
  name: my-service
  tasks_from: deploy

external_update_tasks
  - include_role:
  name: my-service
  tasks_from: update

Or we could re-use the same playbooks, but use tags maybe.
Anyway, I like your proposal and I vote for option A.



> Thanks
>
> Jirka
>
> [1]
>
> https://github.com/openstack/tripleo-heat-templates/blob/8d7525fdf79f915e3f880ea0f3fd299234ecc635/docker/services/ceph-ansible/ceph-base.yaml#L340-L467
> [2]
>
> https://github.com/openstack/tripleo-heat-templates/blob/8d7525fdf79f915e3f880ea0f3fd299234ecc635/extraconfig/services/openshift-master.yaml#L70-L231
> [3] https://review.openstack.org/#/c/579170/
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Plan to switch the undercloud to be containerized by default

2018-07-10 Thread Emilien Macchi
with [tripleo] tag...

On Tue, Jul 10, 2018 at 7:56 PM Emilien Macchi  wrote:

> This is an update on where things are regarding $topic, based on feedback
> I've got from the work done recently:
>
> 1) Switch --use-heat to take a boolean and deprecate it
>
> We still want to allow users to deploy non containerized underclouds, so
> we made this patch so they can use --use-heat=False:
> https://review.openstack.org/#/c/581467/
> Also https://review.openstack.org/#/c/581468 and
> https://review.openstack.org/581180 as dependencies
>
> 2) Configure CI jobs for containerized undercloud, except scenario001, 002
> for timeout reasons (and figure out this problem in a parallel effort)
>
> https://review.openstack.org/#/c/575330
> https://review.openstack.org/#/c/579755
>
> 3) Switch tripleoclient to deploy by default a containerized undercloud
>
> https://review.openstack.org/576218
>
> 4) Improve performances in general so scenario001/002 doesn't timeout when
> containerized undercloud is enabled
>
> https://review.openstack.org/#/c/581183 is the patch that'll enable the
> containerized undercloud
> https://review.openstack.org/#/c/577889/ is a patch that enables
> pipelining in ansible/quickstart, but more is about to come, I'll update
> the patches tonight.
>
> 5) Cleanup quickstart to stop using use-heat except for fs003 (needed to
> disable containers, and keep coverage for non containerized undercloud)
>
> https://review.openstack.org/#/c/581534/
>
>
> Reviews are welcome, we aim to merge this work by milestone 3, in less
> than 2 weeks from now.
> Thanks!
> --
> Emilien Macchi
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Plan to switch the undercloud to be containerized by default

2018-07-10 Thread Emilien Macchi
This is an update on where things are regarding $topic, based on feedback
I've got from the work done recently:

1) Switch --use-heat to take a boolean and deprecate it

We still want to allow users to deploy non containerized underclouds, so we
made this patch so they can use --use-heat=False:
https://review.openstack.org/#/c/581467/
Also https://review.openstack.org/#/c/581468 and
https://review.openstack.org/581180 as dependencies

2) Configure CI jobs for containerized undercloud, except scenario001, 002
for timeout reasons (and figure out this problem in a parallel effort)

https://review.openstack.org/#/c/575330
https://review.openstack.org/#/c/579755

3) Switch tripleoclient to deploy by default a containerized undercloud

https://review.openstack.org/576218

4) Improve performances in general so scenario001/002 doesn't timeout when
containerized undercloud is enabled

https://review.openstack.org/#/c/581183 is the patch that'll enable the
containerized undercloud
https://review.openstack.org/#/c/577889/ is a patch that enables pipelining
in ansible/quickstart, but more is about to come, I'll update the patches
tonight.

5) Cleanup quickstart to stop using use-heat except for fs003 (needed to
disable containers, and keep coverage for non containerized undercloud)

https://review.openstack.org/#/c/581534/


Reviews are welcome, we aim to merge this work by milestone 3, in less than
2 weeks from now.
Thanks!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] puppet-senlin development

2018-07-09 Thread Emilien Macchi
Also please take a look at this guide to create new modules:
https://docs.openstack.org/puppet-openstack-guide/latest/contributor/new-module.html

Thanks and welcome!

On Mon, Jul 9, 2018 at 1:46 PM Tobias Urdin 
wrote:

> Hello Alex,
>
> I personally don’t know about any entity specifically working on the
> Puppet Senlin module.
>
> We strongly welcome anybody to contribute to the development of the Puppet
> OpenStack modules.
>
> We are happy to help :)
>
> Best regards
> Tobias
>
> Sent from my iPhone
>
> On 9 Jul 2018, at 16:00, Alexandru Sorodoc  wrote:
>
> Hello,
>
> Is anyone working or planning to work on the puppet-senlin module? We want
> to use Senlin in our Pike deployment and we are considering contributing to
> its puppet module to bring it to a working state.
>
> Best regards,
> Alex
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet][tripleo] Why is this acceptance test failing?

2018-07-09 Thread Emilien Macchi
On Wed, Jul 4, 2018 at 9:53 PM Lars Kellogg-Stedman  wrote:

> On Wed, Jul 04, 2018 at 07:51:20PM -0600, Emilien Macchi wrote:
> > The actual problem is that the manifest isn't idempotent anymore:
> >
> http://logs.openstack.org/47/575147/16/check/puppet-openstack-beaker-centos-7/3f70cc9/job-output.txt.gz#_2018-07-04_00_42_19_705516
>
> Hey Emilien, thanks for taking a look. I'm not following -- or maybe
> I'm just misreading the failure message.  It really looks to me as if
> the failure is caused by a regular expression; it says:
>
>   Failure/Error:
> apply_manifest(pp, :catch_changes => true) do |result|
>   expect(result.stderr)
> .to
> include_regexp([/Puppet::Type::Keystone_tenant::ProviderOpenstack: Support
> for a resource without the domain.*using 'Default'.*default domain id is
> '/])
> end
>
> And yet, the regular expression in that check clearly matches the
> output shown in the failure message. What do you see that points at an
> actual idempotency issue?
>
> (I wouldn't be at all surprised to find an actual problem in this
> change; I've fixed several already.  I'm just not sure how to turn
> this failure into actionable information.)
>

Sorry for late answers, not doing a good job at catching up emails since I
was 2 weeks on PTO.

So in order to test if that comes from your code or not, please try the
manifest yourself and run puppet 2 times. If the second time is still
triggering changes in the catalog, it means the idempotency of the resource
is broken, which can also mean the resource itself isn't created properly
the first time and a second puppet run tries to create it again.

Basically, you shouldn't see that on a second puppet run:
/Stage[main]/Keystone/Keystone_domain[my_default_domain]/is_default:
is_default changed 'false' to 'true'

If you can't reproduce it, let me know on IRC and I'll help you but you
could use
https://github.com/openstack/puppet-openstack-integration/blob/master/all-in-one.sh
if you need a quick way to deploy.

Hope this helps,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet][tripleo] Why is this acceptance test failing?

2018-07-04 Thread Emilien Macchi
The actual problem is that the manifest isn't idempotent anymore:
http://logs.openstack.org/47/575147/16/check/puppet-openstack-beaker-centos-7/3f70cc9/job-output.txt.gz#_2018-07-04_00_42_19_705516
So something in your patch is breaking the Keystone_domain provider and
makes it non idempotent.

On Tue, Jul 3, 2018 at 7:30 PM Lars Kellogg-Stedman  wrote:

> I need another set of eyes.
>
> I have a review that keeps failing here:
>
>
> http://logs.openstack.org/47/575147/16/check/puppet-openstack-beaker-centos-7/3f70cc9/job-output.txt.gz#_2018-07-04_00_42_19_696966
>
> It's looking for the regular expression:
>
>   /Puppet::Type::Keystone_tenant::ProviderOpenstack: Support for a
> resource without the domain.*using 'Default'.*default domain id is '/
>
> The output shown in the failure message contains:
>
>   [1;33mWarning: Puppet::Type::Keystone_tenant::ProviderOpenstack:
>   Support for a resource without the domain set is deprecated in
>   Liberty cycle. It will be dropped in the M-cycle. Currently using
>   'Default' as default domain name while the default domain id is
>   '7ddf1dfa7fac46679ba7ae2245bece2f'.[0m
>
> The regular expression matches the text! The failing test is here:
>
>
> https://github.com/openstack/puppet-keystone/blob/master/spec/acceptance/default_domain_spec.rb#L59
>
> I've been staring at this for a while and I'm not sure what's going
> on.
>
> --
> Lars Kellogg-Stedman  | larsks @ {irc,twitter,github}
> http://blog.oddbit.com/|
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Newton branch is End-Of-Life

2018-06-18 Thread Emilien Macchi
After many postpones, we finally went ahead and closed Newton branch for
TripleO repositories
A last tag was created and from now we won't accept backports in this
branch. RPMs in RDO will be updated with this last tag.

If there is any question or concern, please let us know.

PS: Thanks to the stable-maint/release-managers who helped in that process.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] tripleo gate is blocked - please read

2018-06-16 Thread Emilien Macchi
Sending an update before the weekend:

Gate was in very bad shape today (long queue, lot of failures) again today,
and it turns out we had a few more issues that we tracked here:
https://etherpad.openstack.org/p/tripleo-gate-issues-june-2018

## scenario007 broke because of a patch in networking-ovn
https://bugs.launchpad.net/tripleo/+bug/1777168
We made the job non voting and meanwhile tried and managed to fix it:
https://review.rdoproject.org/r/#/c/14155/
Breaking commit was:
https://github.com/openstack/networking-ovn/commit/2365df1cc3e24deb2f3745c925d78d6d8e5bb5df
Kudos to Daniel Alvarez for having the patch ready!
Also thanks to Wes for making the job non voting in the meantime.
I've reverted the non-voting things are situation is fixed now, so we can
vote again on this one.

## Dockerhub proxy issue
Infra using wrong image layer object storage proxy for Dockerhub:
https://review.openstack.org/#/c/575787/
Huge thanks to infra team, specially Clark for fixing this super quickly,
it clearly helped to stabilize our container jobs, I actually haven't seen
timeouts since we merged your patch. Thanks a ton!

## RDO master wasn't consistent anymore, python-cloudkittyclient broke
The client was refactored:
https://git.openstack.org/cgit/openstack/python-cloudkittyclient/commit/?id=d070f6a68cddf51c57e77107f1b823a8f75770ba
And it broke the RPM, we had to completely rewrite the dependencies so we
can build the package:
https://review.rdoproject.org/r/#/c/14265/
Mille merci Heikel for your responsive help at 3am, so we could come back
consistent and have our latest rpms that contained a bunch of fixes.

## Where we are now

Gate looks stable now. You can recheck and approve things. I went ahead and
rechecked everything and made sure nothing was left abandoned. Steve's work
has merged so I think we could re-consider
https://review.openstack.org/#/c/575330/ again.
Special thanks to everyone involved in these issues and Alex & John who
also stepped up to help.
Enjoy your weekend!

On Thu, Jun 14, 2018 at 6:40 AM, Emilien Macchi  wrote:

> It sounds like we merged a bunch last night thanks to the revert, so I
> went ahead and restored/rechecked everything that was out of the gate. I've
> checked and nothing was left over, but let me know in case I missed
> something.
> I'll keep updating this thread with the progress made to improve the
> situation etc.
> So from now, situation is back to "normal", recheck/+W is ok.
>
> Thanks again for your patience,
>
> On Wed, Jun 13, 2018 at 10:39 PM, Emilien Macchi 
> wrote:
>
>> https://review.openstack.org/575264 just landed (and didn't timeout in
>> check nor gate without recheck, so good sigh it helped to mitigate).
>>
>> I've restore and rechecked some patches that I evacuated from the gate,
>> please do not restore others or recheck or approve anything for now, and
>> see how it goes with a few patches.
>> We're still working with Steve on his patches to optimize the way we
>> deploy containers on the registry and are investigating how we could make
>> it faster with a proxy.
>>
>> Stay tuned and thanks for your patience.
>>
>> On Wed, Jun 13, 2018 at 5:50 PM, Emilien Macchi 
>> wrote:
>>
>>> TL;DR: gate queue was 25h+, we put all patches from gate on standby, do
>>> not restore/recheck until further announcement.
>>>
>>> We recently enabled the containerized undercloud for multinode jobs and
>>> we believe this was a bit premature as the container download process
>>> wasn't optimized so it's not pulling the mirrors for the same containers
>>> multiple times yet.
>>> It caused the job runtime to increase and probably the load on docker.io
>>> mirrors hosted by OpenStack Infra to be a bit slower to provide the same
>>> containers multiple times. The time taken to prepare containers on the
>>> undercloud and then for the overcloud caused the jobs to randomly timeout
>>> therefore the gate to fail in a high amount of times, so we decided to
>>> remove all jobs from the gate by abandoning the patches temporarily (I have
>>> them in my browser and will restore when things are stable again, please do
>>> not touch anything).
>>>
>>> Steve Baker has been working on a series of patches that optimize the
>>> way we prepare the containers but basically the workflow will be:
>>> - pull containers needed for the undercloud into a local registry, using
>>> infra mirror if available
>>> - deploy the containerized undercloud
>>> - pull containers needed for the overcloud minus the ones already pulled
>>> for the undercloud, using infra mirror if available
>>> - update containers on the overcloud
>>> - deploy the contain

Re: [openstack-dev] [tripleo] tripleo gate is blocked - please read

2018-06-14 Thread Emilien Macchi
It sounds like we merged a bunch last night thanks to the revert, so I went
ahead and restored/rechecked everything that was out of the gate. I've
checked and nothing was left over, but let me know in case I missed
something.
I'll keep updating this thread with the progress made to improve the
situation etc.
So from now, situation is back to "normal", recheck/+W is ok.

Thanks again for your patience,

On Wed, Jun 13, 2018 at 10:39 PM, Emilien Macchi  wrote:

> https://review.openstack.org/575264 just landed (and didn't timeout in
> check nor gate without recheck, so good sigh it helped to mitigate).
>
> I've restore and rechecked some patches that I evacuated from the gate,
> please do not restore others or recheck or approve anything for now, and
> see how it goes with a few patches.
> We're still working with Steve on his patches to optimize the way we
> deploy containers on the registry and are investigating how we could make
> it faster with a proxy.
>
> Stay tuned and thanks for your patience.
>
> On Wed, Jun 13, 2018 at 5:50 PM, Emilien Macchi 
> wrote:
>
>> TL;DR: gate queue was 25h+, we put all patches from gate on standby, do
>> not restore/recheck until further announcement.
>>
>> We recently enabled the containerized undercloud for multinode jobs and
>> we believe this was a bit premature as the container download process
>> wasn't optimized so it's not pulling the mirrors for the same containers
>> multiple times yet.
>> It caused the job runtime to increase and probably the load on docker.io
>> mirrors hosted by OpenStack Infra to be a bit slower to provide the same
>> containers multiple times. The time taken to prepare containers on the
>> undercloud and then for the overcloud caused the jobs to randomly timeout
>> therefore the gate to fail in a high amount of times, so we decided to
>> remove all jobs from the gate by abandoning the patches temporarily (I have
>> them in my browser and will restore when things are stable again, please do
>> not touch anything).
>>
>> Steve Baker has been working on a series of patches that optimize the way
>> we prepare the containers but basically the workflow will be:
>> - pull containers needed for the undercloud into a local registry, using
>> infra mirror if available
>> - deploy the containerized undercloud
>> - pull containers needed for the overcloud minus the ones already pulled
>> for the undercloud, using infra mirror if available
>> - update containers on the overcloud
>> - deploy the containerized undercloud
>>
>> With that process, we hope to reduce the runtime of the deployment and
>> therefore reduce the timeouts in the gate.
>> To enable it, we need to land in that order: https://review.openstac
>> k.org/#/c/571613/, https://review.openstack.org/#/c/574485/,
>> https://review.openstack.org/#/c/571631/ and https://review.openstack.o
>> rg/#/c/568403.
>>
>> In the meantime, we are disabling the containerized undercloud recently
>> enabled on all scenarios: https://review.openstack.org/#/c/575264/ for
>> mitigation with the hope to stabilize things until Steve's patches land.
>> Hopefully, we can merge Steve's work tonight/tomorrow and re-enable the
>> containerized undercloud on scenarios after checking that we don't have
>> timeouts and reasonable deployment runtimes.
>>
>> That's the plan we came with, if you have any question / feedback please
>> share it.
>> --
>> Emilien, Steve and Wes
>>
>
>
>
> --
> Emilien Macchi
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] tripleo gate is blocked - please read

2018-06-13 Thread Emilien Macchi
https://review.openstack.org/575264 just landed (and didn't timeout in
check nor gate without recheck, so good sigh it helped to mitigate).

I've restore and rechecked some patches that I evacuated from the gate,
please do not restore others or recheck or approve anything for now, and
see how it goes with a few patches.
We're still working with Steve on his patches to optimize the way we deploy
containers on the registry and are investigating how we could make it
faster with a proxy.

Stay tuned and thanks for your patience.

On Wed, Jun 13, 2018 at 5:50 PM, Emilien Macchi  wrote:

> TL;DR: gate queue was 25h+, we put all patches from gate on standby, do
> not restore/recheck until further announcement.
>
> We recently enabled the containerized undercloud for multinode jobs and we
> believe this was a bit premature as the container download process wasn't
> optimized so it's not pulling the mirrors for the same containers multiple
> times yet.
> It caused the job runtime to increase and probably the load on docker.io
> mirrors hosted by OpenStack Infra to be a bit slower to provide the same
> containers multiple times. The time taken to prepare containers on the
> undercloud and then for the overcloud caused the jobs to randomly timeout
> therefore the gate to fail in a high amount of times, so we decided to
> remove all jobs from the gate by abandoning the patches temporarily (I have
> them in my browser and will restore when things are stable again, please do
> not touch anything).
>
> Steve Baker has been working on a series of patches that optimize the way
> we prepare the containers but basically the workflow will be:
> - pull containers needed for the undercloud into a local registry, using
> infra mirror if available
> - deploy the containerized undercloud
> - pull containers needed for the overcloud minus the ones already pulled
> for the undercloud, using infra mirror if available
> - update containers on the overcloud
> - deploy the containerized undercloud
>
> With that process, we hope to reduce the runtime of the deployment and
> therefore reduce the timeouts in the gate.
> To enable it, we need to land in that order: https://review.
> openstack.org/#/c/571613/, https://review.openstack.org/#/c/574485/,
> https://review.openstack.org/#/c/571631/ and https://review.openstack.
> org/#/c/568403.
>
> In the meantime, we are disabling the containerized undercloud recently
> enabled on all scenarios: https://review.openstack.org/#/c/575264/ for
> mitigation with the hope to stabilize things until Steve's patches land.
> Hopefully, we can merge Steve's work tonight/tomorrow and re-enable the
> containerized undercloud on scenarios after checking that we don't have
> timeouts and reasonable deployment runtimes.
>
> That's the plan we came with, if you have any question / feedback please
> share it.
> --
> Emilien, Steve and Wes
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] tripleo gate is blocked - please read

2018-06-13 Thread Emilien Macchi
TL;DR: gate queue was 25h+, we put all patches from gate on standby, do not
restore/recheck until further announcement.

We recently enabled the containerized undercloud for multinode jobs and we
believe this was a bit premature as the container download process wasn't
optimized so it's not pulling the mirrors for the same containers multiple
times yet.
It caused the job runtime to increase and probably the load on docker.io
mirrors hosted by OpenStack Infra to be a bit slower to provide the same
containers multiple times. The time taken to prepare containers on the
undercloud and then for the overcloud caused the jobs to randomly timeout
therefore the gate to fail in a high amount of times, so we decided to
remove all jobs from the gate by abandoning the patches temporarily (I have
them in my browser and will restore when things are stable again, please do
not touch anything).

Steve Baker has been working on a series of patches that optimize the way
we prepare the containers but basically the workflow will be:
- pull containers needed for the undercloud into a local registry, using
infra mirror if available
- deploy the containerized undercloud
- pull containers needed for the overcloud minus the ones already pulled
for the undercloud, using infra mirror if available
- update containers on the overcloud
- deploy the containerized undercloud

With that process, we hope to reduce the runtime of the deployment and
therefore reduce the timeouts in the gate.
To enable it, we need to land in that order:
https://review.openstack.org/#/c/571613/,
https://review.openstack.org/#/c/574485/,
https://review.openstack.org/#/c/571631/ and
https://review.openstack.org/#/c/568403.

In the meantime, we are disabling the containerized undercloud recently
enabled on all scenarios: https://review.openstack.org/#/c/575264/ for
mitigation with the hope to stabilize things until Steve's patches land.
Hopefully, we can merge Steve's work tonight/tomorrow and re-enable the
containerized undercloud on scenarios after checking that we don't have
timeouts and reasonable deployment runtimes.

That's the plan we came with, if you have any question / feedback please
share it.
-- 
Emilien, Steve and Wes
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Proposing Alan Bishop tripleo core on storage bits

2018-06-13 Thread Emilien Macchi
Alan Bishop has been highly involved in the Storage backends integration in
TripleO and Puppet modules, always here to update with new features, fix
(nasty and untestable third-party backends) bugs and manage all the
backports for stable releases:
https://review.openstack.org/#/q/owner:%22Alan+Bishop+%253Cabishop%2540redhat.com%253E%22

He's also well knowledgeable of how TripleO works and how containers are
integrated, I would like to propose him as core on TripleO projects for
patches related to storage things (Cinder, Glance, Swift, Manila, and
backends).

Please vote -1/+1,
Thanks!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 24th Edition

2018-06-12 Thread Emilien Macchi
Welcome to the twenty-fourth edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-June/131184.html

+-+
| General announcements |
+-+

+--> Rocky milestone 3 cycle just started, for a bit less than 1.5 month.

+--+
| Continuous Integration |
+--+

+--> rlandy is our rover and arxcruz is our ruck. Let them know any CI
issues!
+--> Promotion status: Master: 8d, Queens: 7d, Pike: 5d and Ocata: 3d.
+--> Gate is backed-up today, such is RDO CI. Status can be checked on
http://zuul.openstack.org and https://review.rdoproject.org/zuul/.
+--> Sprint 14 is in flight and focus is on Upgrades testing
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Standalone documented (first iteration):
https://docs.openstack.org/tripleo-docs/latest/install/
+--> containers_deployment/standalone.html
+--> Still working on enabling the containerized undercloud everywhere in
CI jobs
+--> Containerized undercloud upgrade problems were fixed, working on
post-upgrade cleanup feature now
+--> Good progress on working on updating containers in CI when deploying a
containerized undercloud so we can test changes in all repos (need review)
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> Skydive and Octavia integration are now ready for review.
+--> UI integration blocked by under-review patches in tripleo-common.
+--> the squad is looking at the next steps, which might lead to a new
squad.
+--> More:
https://etherpad.openstack.org/p/tripleo-config-download-squad-status

+--+
| Integration |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> More validations, need review.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Owls can eat owls.
Not only do owls eat surprisingly large prey (some species, like the eagle
owl, can even grab small deer), they also eat other species of owls. Great
horned owls, for example, will attack the barred owl. The barred owl, in
turn, sometimes eats the Western screech-owl. In fact, owl-on-owl predation
may be a reason why Western screech-owl numbers have declined.
Source: http://mentalfloss.com/article/68473/15-mysterious-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tc] StarlingX project status update

2018-06-12 Thread Emilien Macchi
On Tue, Jun 12, 2018 at 7:46 AM, Doug Hellmann 
wrote:

> Excerpts from Dean Troyer's message of 2018-06-12 09:28:48 -0500:
> > On Mon, Jun 11, 2018 at 5:02 PM, Emilien Macchi 
> wrote:
> > > While I agree with Doug that we assume good faith and hope for the
> best, I
> > > personally think we should help them (what we're doing now) but also
> make
> > > sure we DO NOT set a precedent. We could probably learn from this
> situation
> > > and document in our governance what the TC expects when companies have
> a
> > > fork and need to contribute back at some point. We all know StarlingX
> isn't
> > > alone and I'm pretty sure there are a lot of deployments out there who
> are
> > > in the same situation.
> >
> > /me pus on ex-TC hat for a minute
> >
> > Emilien, I totally agree with you here but would word it differently:
> > we should absolutely set a precedent, but one that exhibits how we
> > want to handle what ttx calls 'convergent' forks.  These already
> > exist, like it or not.  What I hope can be established is some
> > guidelines and boundaries on how to deal with these rather than just
> > reject them out-of-hand.
>
> Yes, well said.


Indeed, thanks Dean.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tc] StarlingX project status update

2018-06-11 Thread Emilien Macchi
On Tue, Jun 5, 2018 at 9:08 AM, Doug Hellmann  wrote:
[snip]

> When all of this is done, a viable project with real users will be
> open source instead of closed source. Those contributors, and users,
> will be a part of our community instead of looking in from the
> outside. The path is ugly, long, and clearly not ideal. But, I
> consider the result a win, overall.


While I agree with Doug that we assume good faith and hope for the best, I
personally think we should help them (what we're doing now) but also make
sure we DO NOT set a precedent. We could probably learn from this situation
and document in our governance what the TC expects when companies have a
fork and need to contribute back at some point. We all know StarlingX isn't
alone and I'm pretty sure there are a lot of deployments out there who are
in the same situation.

I guess my point is, yes for helping StarlingX now but no for incubating
future forks if that happens. Like Graham, I think these methods shouldn't
be what we encourage in our position.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 23th Edition

2018-06-05 Thread Emilien Macchi
Welcome to the twenty third edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-May/130926.html

+-+
| General announcements |
+-+

+--> This week is Rocky Milestone 2.

+--+
| Continuous Integration |
+--+

+--> Ruck is arxcruz and Rover is rlandy. Please let them know any new CI
issue.
+--> Master promotion is 1 day, Queens is 0 day, Pike is 0 day and Ocata is
0 day. Really nice work CI folks!
+--> Sprint 14 is ongoing: Checkout
https://trello.com/c/1W62zvhh/770-sprint-14-goals but focus is to finish
upgrade CI work.
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> Reviews are requested on different topics: CI, Newton, FFU
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Good progress done on All-In-One blueprint, update sent on the ML:
http://lists.openstack.org/pipermail/openstack-dev/2018-June/131135.html
+--> Still working on Containerized undercloud upgrades (bug with rabbitmq
upgrade: https://review.openstack.org/#/c/572449/)
+--> Enabling the containerized undercloud everywhere in CI
+--> Working on updating containers in CI when deploying a containerized
undercloud so we can test changes in all repos
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> checkout the new command: "openstack overcloud failures" for
better deployment
failures output
+--> Documentation was improved with recent changes
+--> UI integration is still in progress
+--> More: https://etherpad.openstack.org/p/tripleo-config-downlo
ad-squad-status

+--+
| Integration |
+--+

+--> Working on : "Persist ceph-ansible fetch_directory", check it out:
https://review.openstack.org/#/c/567782/
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Beginning trial of using storyboard not just for bugs but also for
stories/epics
+--> Review of existing config-download patches that still need to merge.
Hoping to finalize this week.
+--> Network config initial patches are up - very cool so far!
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> Custom validations work
+--> Nova event callback validation
+--> OpenShift on OpenStack validation work
+--> Mistral workflow plugin
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Public TLS is being refactored
+--> Working on limiting sudoers rights
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Owls were once a sign of victory in battle.
In ancient Greece, the Little Owl was the companion of Athena, the Greek
goddess of wisdom, which is one reason why owls symbolize learning and
knowledge.
But Athena was also a warrior goddess and the owl was considered the
protector of armies going into war.
If Greek soldiers saw an owl fly by during battle, they took it as a sign
of coming victory.
Source: http://mentalfloss.com/article/68473/15-mysterious-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Status of Standalone installer (aka All-In-One)

2018-06-04 Thread Emilien Macchi
TL;DR: we made nice progress and you can checkout this demo:
https://asciinema.org/a/185533

We started the discussion back in Dublin during the last PTG. The idea of
Standalone (aka All-In-One, but can be mistaken with all-in-one overcloud)
is to deploy a single node OpenStack where the provisioning happens on the
same node (there is no notion of {under/over}cloud).

A kind of a "packstack" or "devstack" but using TripleO which has can offer:
- composable containerized services
- composable upgrades
- composable roles
- Ansible driven deployment

One of the key features we have been focusing so far are:
- low bar to be able to dev/test TripleO (single machine: VM), with simpler
tooling
- make it fast (being able to deploy OpenStack in minutes)
- being able to make a change in OpenStack (e.g. Keystone) and test the
change immediately

The workflow that we're currently targeting is:
- deploy the system by yourself (centos7 or rhel7)
- deploy the repos, install python-tripleoclient
- run 'openstack tripleo deploy (+ few args)
- (optional) modify your container with a Dockerfile + Ansible
- Test your change

Status:
- tripleoclient was refactored in a way that the undercloud is actually a
special configuration of the standalone deployment (still work in
progress). We basically refactored the containerized undercloud to be more
generic and configurable for standalone.
- we can now deploy a standalone OpenStack with just Keystone +
dependencies - which takes 12 minutes total (demo here:
https://asciinema.org/a/185533 and doc in progress:
http://logs.openstack.org/27/571827/6/check/build-openstack-sphinx-docs/1885304/html/install/containers_deployment/standalone.html
)
- we have an Ansible role to push modifications to containers via a Docker
file: https://github.com/openstack/ansible-role-tripleo-modify-image/

What's next:
- Documentation: as you can see the documentation is still in progress (
https://review.openstack.org/#/c/571827/)
- Continuous Integration: we're working on a new CI
job: tripleo-ci-centos-7-standalone
https://trello.com/c/HInL8pNm/7-upstream-ci-testing
- Working on the standalone configuration interface, still WIP:
https://review.openstack.org/#/c/569535/
- Investigate the use case where a developer wants to prepare the
containers before the deployment

I hope this update was useful, feel free to give feedback or ask any
questions,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Containerized Undercloud by default

2018-06-04 Thread Emilien Macchi
On Thu, May 31, 2018 at 9:13 PM, Emilien Macchi  wrote:
>
> - all multinode scenarios - current blocked by 1774297 as well but also
>> https://review.openstack.org/#/c/571566/
>>
>
This part is done and ready for review (CI team + others):
https://review.openstack.org/#/c/571529/

Thanks!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Containerized Undercloud by default

2018-05-31 Thread Emilien Macchi
I forgot to mention Steve's effort to update the containers when deploying
the undercloud, this is a critical piece if we want to continue to test
changes in projects like tripleo-common that are embedded in Mistral
containers for example.
The patch that will enable it is https://review.openstack.org/#/c/571631/ and
thanks to this work we'll make unify the container registry for both the
undercloud and overcloud, using the same [updated] containers.
It is important to have this feature enabled in our CI to maintain the
parity with how we tested TripleO when undercloud wasn't containeirized, so
this is something we want to achieve before switching all the TripleO CI
jobs.

On Thu, May 31, 2018 at 8:58 PM, Emilien Macchi  wrote:

> Hi,
>
> During Rocky cycle we would like to switch tripleoclient to deploy
> containeirzed undercloud by default but before to get there, we want to
> switch all CI jobs to it, like it was done when enabling config-download by
> default.
> Right now we have 3 jobs which test the containerized undercloud:
>
> - tripleo-ci-centos-7-undercloud-containers: deploy a containerized
> undercloud and run Tempest
> - tripleo-ci-centos-7-containerized-undercloud-upgrades: deploy a
> non-containerized undercloud on Queens and upgrade to a containerized
> undercloud on Rocky
> - gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master: deploy a
> containerized undercloud and an overcloud with HA architecture and IPv4
> network (with introspection, SSL, etc).
>
> What's next (target is Rocky M3):
> - tripleo-ci-centos-7-containers-multinode - currently blocked by
> https://bugs.launchpad.net/tripleo/+bug/1774297
> - all multinode scenarios - current blocked by 1774297 as well but also
> https://review.openstack.org/#/c/571566/
> - gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master -
> currently blocked by https://bugs.launchpad.net/tripleo/+bug/1774557
> (with a potential fix: https://review.openstack.org/571620)
> - all other jobs that run on master, except 
> tripleo-ci-centos-7-undercloud-oooq
> that we'll probably keep during Rocky and remove in Stein if we
> successfully switch the default.
>
> Once we've reached that point, we'll change tripleoclient's default, and
> hopefully all of this before m3 :-)
>
> Any question or feedback is highly welcome,
> --
> Emilien Macchi
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Containerized Undercloud by default

2018-05-31 Thread Emilien Macchi
Hi,

During Rocky cycle we would like to switch tripleoclient to deploy
containeirzed undercloud by default but before to get there, we want to
switch all CI jobs to it, like it was done when enabling config-download by
default.
Right now we have 3 jobs which test the containerized undercloud:

- tripleo-ci-centos-7-undercloud-containers: deploy a containerized
undercloud and run Tempest
- tripleo-ci-centos-7-containerized-undercloud-upgrades: deploy a
non-containerized undercloud on Queens and upgrade to a containerized
undercloud on Rocky
- gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master: deploy a
containerized undercloud and an overcloud with HA architecture and IPv4
network (with introspection, SSL, etc).

What's next (target is Rocky M3):
- tripleo-ci-centos-7-containers-multinode - currently blocked by
https://bugs.launchpad.net/tripleo/+bug/1774297
- all multinode scenarios - current blocked by 1774297 as well but also
https://review.openstack.org/#/c/571566/
- gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master - currently
blocked by https://bugs.launchpad.net/tripleo/+bug/1774557 (with a
potential fix: https://review.openstack.org/571620)
- all other jobs that run on master,
except tripleo-ci-centos-7-undercloud-oooq that we'll probably keep during
Rocky and remove in Stein if we successfully switch the default.

Once we've reached that point, we'll change tripleoclient's default, and
hopefully all of this before m3 :-)

Any question or feedback is highly welcome,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 22th Edition

2018-05-30 Thread Emilien Macchi
Welcome to the twenty second edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-May/130528.html

+-+
| General announcements |
+-+

+--> OpenStack community met last week for the Summit in Vancouver, we had
great presentations and also great feedback!
+--> Milestone 2 deadline is next week!

+-+
| Owls at Summit |
+-+

+--> TripleO project updates: from Queens to Rocky and beyond
Recording: https://www.youtube.com/watch?v=4q_zkvOP8Dk
Slides: https://t.co/DYOAjt1jDk

+--> TripleO onboarding session:
https://etherpad.openstack.org/p/YVR-forum-tripleo-onboarding
People used that time to ask any questions about TripleO and the team was
happy to answer and provide support.

+--> TripleO Ops and User Feedback:
https://etherpad.openstack.org/p/tripleo-rocky-ops-and-user-feedback
Feedback about logging, documentation were the main topics we covered but
other things were discussed, see etherpad.

+--> TripleO and Ansible integration:
https://etherpad.openstack.org/p/tripleo-rocky-ansible-integration
James did a great job at presenting the config-download feature and how we
now use Ansible for some deployment tasks.

+--+
| Continuous Integration |
+--+

+--> Ruck is arxcruz and Rover is rlandy. Please let them know any new CI
issue.
+--> Master promotion is 0 day, Queens is 0 days, Pike is 3 days and Ocata
is 4 days.
+--> Sprint 13 themes were Upgrade CI (new jobs, forward looking release
state machine, voting jobs).
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> FFU at Summit: https://www.youtube.com/watch?v=YJXem5d6fkI
+--> Need reviews converge patches and docs updates
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Efforts arounds all-in-one installer, image prepare and image
workflows, good progress overall.
+--> Focus is on stabilization and make the containerized undercloud the
default in TripleO.
+--> Tomorrow is containerized undercloud deep dive: https://etherpad.
openstack.org/p/tripleo-deep-dive-containerized-undercloud
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> config download status commands and workflows
+--> UI work still ongoing
+--> Major doc update (merged): https://review.openstack.org/#/c/566606
+--> More: https://etherpad.openstack.org/p/tripleo-config-downlo
ad-squad-status

+--+
| Integration |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> Mistral project update https://www.youtube.com/watch?v=y9qieruccO4
+--> Validate workflow input:
https://bugs.launchpad.net/tripleo/+bug/1774166
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Public TLS is being refactored
+--> Kerberos auth for keystone update
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Owl flight is silent, unlike most birds, owls make virtually no noise when
they fly. They have special feathers that break turbulence into smaller
currents, which reduces sound. Soft velvety down further muffles noise.
Source: http://mentalfloss.com/article/68473/15-mysterious-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Migration to Storyboard

2018-05-21 Thread Emilien Macchi
During the Storyboard session today:
https://etherpad.openstack.org/p/continuing-the-migration-lp-sb

We mentioned that TripleO would continue to migrate during Rocky cycle.
Like Alex mentioned in this thread, we need to migrate the scripts used by
the CI squad so they work with SB.
Once this is done, we'll proceed to the full migration of all blueprints
and bugs into tripleo-common project in SB.
Projects like tripleo-validations, tripleo-ui (more?) who have 1:1 mapping
between their "name" and project repository could use a dedicated project
in SB, although we need to keep things simple for our users so they know
where to file a bug without confusion.
We hope to proceed during Rocky but it'll probably take some time to update
our scripts and documentation, also educate our community to use the tool,
so we expect the Stein cycle the first cycle where we actually consume SB.

I really wanted to thank the SB team for their patience and help, TripleO
is big and this migration hasn't been easy but we'll make it :-)

Thanks,

On Tue, May 15, 2018 at 7:53 AM, Alex Schultz <aschu...@redhat.com> wrote:

> Bumping this up so folks can review this.  It was mentioned in this
> week's meeting that it would be a good idea for folks to take a look
> at Storyboard to get familiar with it.  The upstream docs have been
> updated[0] to point to the differences when dealing with proposed
> patches.  Please take some time to review this and raise any
> concerns/issues now.
>
> Thanks,
> -Alex
>
> [0] https://docs.openstack.org/infra/manual/developers.html#
> development-workflow
>
> On Wed, May 9, 2018 at 1:24 PM, Alex Schultz <aschu...@redhat.com> wrote:
> > Hello tripleo folks,
> >
> > So we've been experimenting with migrating some squads over to
> > storyboard[0] but this seems to be causing more issues than perhaps
> > it's worth.  Since the upstream community would like to standardize on
> > Storyboard at some point, I would propose that we do a cut over of all
> > the tripleo bugs/blueprints from Launchpad to Storyboard.
> >
> > In the irc meeting this week[1], I asked that the tripleo-ci team make
> > sure the existing scripts that we use to monitor bugs for CI support
> > Storyboard.  I would consider this a prerequisite for the migration.
> > I am thinking it would be beneficial to get this done before or as
> > close to M2.
> >
> > Thoughts, concerns, etc?
> >
> > Thanks,
> > -Alex
> >
> > [0] https://storyboard.openstack.org/#!/project_group/76
> > [1] http://eavesdrop.openstack.org/meetings/tripleo/2018/
> tripleo.2018-05-08-14.00.log.html#l-42
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Cancel IRC meeting for May 22, 2018

2018-05-16 Thread Emilien Macchi
On Wed, May 16, 2018 at 1:07 PM, Alex Schultz <aschu...@redhat.com> wrote:

> Since the summit is coming up, there will likely be very low
> attendance. We'll carry any open items until the following week.
>

No Weekly Owl as well, but be patient for the next Edition special Summit.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 21th Edition

2018-05-15 Thread Emilien Macchi
Welcome to the twenty first edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-May/130273.html

+-+
| General announcements |
+-+

+--> Migration to Storyboard is scheduled for rocky-m2, please be aware of
its usage:
https://docs.openstack.org/infra/manual/developers.html#development-workflow
+--> We have 3 more weeks until milestone 2 ! Check-out the schedule:
https://releases.openstack.org/rocky/schedule.html

+--+
| Continuous Integration |
+--+

+--> Ruck is Matt and Rover is Sagi. Please let them know any new CI issue.
+--> centos 7.5 blockers were solved, now looking at how we can improve
centos testing and avoid gate downtime in the future
+--> Master promotion is 0 day, Queens is 6 days, Pike is 6 days and Ocata
is 6 days.
+--> Sprint themes are Upgrade CI (new jobs, forward looking release state
machine, voting jobs) and refactor python-tempestconf for service discovery.
+--> Discussion in progress around zuul v3 multi-staged check pipelines in
TripleO CI
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> Collaboration with CI team for upgrade jobs.
+--> Need reviews on FFU work, check the etherpad.
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Support of image customization during upload in (good) progress.
+--> Efforts arounds all-in-one installer, also good progress.
+--> Preparing next deep dive:
https://etherpad.openstack.org/p/tripleo-deep-dive-containerized-undercloud
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> config download status commands and workflows (need reviews)
+--> UI work still ongoing
+--> Major doc update: https://review.openstack.org/#/c/566606
+--> More: https://etherpad.openstack.org/p/tripleo-config-
download-squad-status

+--+
| Integration |
+--+

+--> Need to add support for NodeDataLookup parameter into
"config-download" deployment mechanism (not started yet).
+--> Need review on https://review.openstack.org/#/c/563112/
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Still working on Network Wizard.
+--> Finishing config-download integration
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> Custom validations spec ready for reviews:
https://review.openstack.org/#/c/393775/
+--> Mistral workflow plugin
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> Lot of reviews are needed, please check them out
+--> Workflows should now all use the tripleo.messaging.v1.send workflow to
send messages
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Swift object encryption by default in the undercloud
+--> TLS by default for the overcloud
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Barn Owls swallow their prey whole—skin, bones, and all—and they eat up to
1,000 mice each year.
Source: https://www.audubon.org/news/11-fun-facts-about-owls

Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Containerized Undercloud deep-dive

2018-05-15 Thread Emilien Macchi
Dan and I are organizing a deep-dive session focused on the containerized
undercloud.

https://etherpad.openstack.org/p/tripleo-deep-dive-containerized-undercloud

We proposed a date + list of topics but feel free to comment and ask for
topics/questions.
Thanks,
-- 
Emilien & Dan
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] tripleo upstream gate outtage, was: -> gate jobs impacted RAX yum mirror

2018-05-12 Thread Emilien Macchi
On Sat, May 12, 2018 at 9:10 AM, Wesley Hayutin <whayu...@redhat.com> wrote:
>
> 2. Shortly after #1 was resolved CentOS released 7.5 which comes directly
> into the upstream repos untested and ungated.  Additionally the associated
> qcow2 image and container-base images were not updated at the same time as
> the yum repos.  https://bugs.launchpad.net/tripleo/+bug/1770355
>

Why do we have this situation everytime the OS is upgraded to a major
version? Can't we test the image before actually using it? We could have
experimental jobs testing latest image and pin gate images to a specific
one?
Like we could configure infra to deploy centos 7.4 in our gate and 7.5 in
experimental, so we can take our time to fix eventual problems and make the
switch when we're ready, instead of dealing with fires (that usually come
all together).

It would be great to make a retrospective on this thing between tripleo ci
& infra folks, and see how we can improve things.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-operators] The Forum Schedule is now live

2018-05-02 Thread Emilien Macchi
On Wed, May 2, 2018 at 5:19 AM, Jimmy McArthur <ji...@openstack.org> wrote:
>
> No problem, we have both on the schedule.  I moved the Project Update to
> 11-11:20 so you can have a few minutes before the Onboarding starts at
> 11:50.
>
> https://www.openstack.org/summit/vancouver-2018/summit-sched
> ule/global-search?t=TripleO
>
> Let me know if I can assist further.
>

Everything looks excellent to me now. Thanks for your help!
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-operators] The Forum Schedule is now live

2018-05-01 Thread Emilien Macchi
On Tue, May 1, 2018 at 7:18 AM, Jimmy McArthur <ji...@openstack.org> wrote:

> Apologies for the delay, Emilien!  I should be adding it today, but it's
> definitely yours.
>

Could we change the title of the slot and actually be a TripleO Project
Update session?
It would have been great to have the onboarding session but I guess we also
have 2 other sessions where we'll have occasions to meet:
TripleO Ops and User feedback and TripleO and Ansible integration

If it's possible to still have an onboarding session, awesome otherwise
it's ok I think we'll deal with it.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 19th Edition

2018-05-01 Thread Emilien Macchi
Welcome to the nineteenth edition of a weekly update in TripleO world!
The goal is to provide a short reading (less than 5 minutes) to learn
what's new this week.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-April/129800.html

+-+
| General announcements |
+-+

+--> Some efforts will be done during Rocky for splitting out controlplane,
see spec: https://review.openstack.org/#/c/523459
+--> We have 5 more weeks until milestone 2 ! Check-out the schedule:
https://releases.openstack.org/rocky/schedule.html

+--+
| Continuous Integration |
+--+

+--> Ruck is Wes and Rover is Gabriele. Please let them know any new CI
issue.
+--> Master promotion is 0 day, Queens is 0 day, Pike is 3 days and Ocata
is 1 days. Kudos folks!
+--> Still working on libvirt based multinode reproducer, see
https://goo.gl/DYCnkx
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Containerized Undercloud upgrades has made good progress, non-voting
CI job almost ready
+--> Major efforts in tripleoclient for all-in-one (sorry for all the Merge
Conflict) but it was needed
+--> ansible-role-container-registry was imported in RDO, now moving
forward to consume it in THT.
+--> No progress on container updates before undercloud deployment.
+--> Still working on parity items between instack-undercloud and
containerized undercloud
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> config-download now the default with tripleo-heat-templates!
+--> Rewriting enable-ssh-admin.sh in python
+--> WIP around importing ansible role for keystone tasks.
+--> Progress on OpenStark operations Ansible role:
https://github.com/samdoran/ansible-role-openstack-operations
+--> Working on Skydive transition
+--> Working on improving performances when deploying Ceph with Ansible.
+--> More: https://etherpad.openstack.org/p/tripleo-config-download-
squad-status

+--+
| Integration |
+--+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Working on Network Wizard.
+--> Finishing config-download integration
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> Working on splitting workflows repository.
+--> Efforts around Workflow linting and unit testing.
+--> Discussions around usage of Zaqar.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> No updates, still focusing on Public TLS by default and Secret
Management.
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Keith Schincke suggested this weekly fact: you can observe owl's eyeball
through their ear:
https://www.livescience.com/61673-owl-eye-seen-through-ear.html


Thank you all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Overriding project-templates in Zuul

2018-05-01 Thread Emilien Macchi
On Tue, May 1, 2018 at 10:02 AM, James E. Blair <cor...@inaugust.com> wrote:
[...]

> Okay, let's summarize:
>
> Proposal 1: All project-template and project-local job variants matching
> the item's branch must also match the item.
>
> * Files and irrelevant-files on project-template and project stanzas are
>   essentially combined in a set intersection.
> * It's possible to further reduce the scope of jobs, but not expand.
> * Files and irrelevant-files are still independent matchers, and if both
>   are present, both must match.
> * It's not possible to alter a job attribute by adding a project-local
>   variant with only a files matcher (it would cause the whole job to run
>   or not run).  But it's still possible to do that in the main job
>   definition itself.
>
> Proposal 2: Files and irrelevant-files are treated as overwriteable
> attributes and evaluated after branch-matching variants are combined.
>
> * Files and irrelevant-files are overwritten, so the last value
>   encountered when combining all the matching variants (looking only at
>   branches) wins.
> * Files and irrelevant-files will be treated as a pair, so that if
>   "irrelevant-files" appears, it will erase a previous "files"
>   attribute.
> * It's possible to both reduce and expand the scope of jobs, but the
>   user may need to manually copy values from a parent or other variant
>   in order to do so.
> * It will no longer be possible to alter a job attribute by adding a
>   variant with only a files matcher -- in all cases files and
>   irrelevant-files are used solely to determine whether the job is run,
>   not to determine whether to apply a variant.
>
> I think both would be good solutions to the problem.  The key points for
> me are whether we want to keep the "alter a job attribute with variant
> with a files matcher" functionality (the "rebuild_index" example from
> above), and whether the additional control of overwriting the matchers
> (at the cost of redundancy in configuration) is preferable to combining
> the matchers.
>

In the case of TripleO, I think proposal 2 is what we want.
We have stanzas defined in the templates definitions in
openstack-infra/tripleo-ci repo, but really want to override the file rules
per repo (openstack/tripleo-quickstart for example) and I don't think we
want to have them both matching but so the last value encountered would win.
I'll let TripleO CI squad to give more thoughts though.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-operators] The Forum Schedule is now live

2018-05-01 Thread Emilien Macchi
On Mon, Apr 30, 2018 at 10:25 AM, Emilien Macchi <emil...@redhat.com> wrote:

> On Mon, Apr 30, 2018 at 10:05 AM, Jimmy McArthur <ji...@openstack.org>
> wrote:
>>
>> It looks like we have a spot held for you, but did not receive
>> confirmation that TripleO would be moving forward with Project Update.  If
>> you all will be recording this, we have you down for Wednesday from 11:25 -
>> 11:45am.  Just let me know and I'll get it up on the schedule.
>>
>
> This slot is perfect, and I'll run it with one of my tripleo co-workers
> (Alex won't be here).
>

Jimmy, could you please confirm we have the TripleO Project Updates slot? I
don't see it in the schedule.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Overriding project-templates in Zuul

2018-04-30 Thread Emilien Macchi
On Mon, Apr 30, 2018 at 8:58 AM, James E. Blair <cor...@inaugust.com> wrote:
[...]

>     ===  ===
> Matcher   Template  Project  Result
>     ===  ===
> files ABBC   ABC
> irrelevant-files  ABBC   B
>     ===  ===
>
> I believe this will address the shortcoming identified above, but before
> we get too far in implementing it, I'd like to ask folks to take a
> moment and evaluate whether it will address the issues you've seen, or
> if you foresee any problems which I haven't anticipated.
>

It'll address a need we have in TripleO where we have complex file rules
and heavily rely on templates.
The matrix proposal looks good to me and will allow us to simplify a bit
our templates.

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack-operators] The Forum Schedule is now live

2018-04-30 Thread Emilien Macchi
On Mon, Apr 30, 2018 at 10:05 AM, Jimmy McArthur <ji...@openstack.org>
wrote:
>
> It looks like we have a spot held for you, but did not receive
> confirmation that TripleO would be moving forward with Project Update.  If
> you all will be recording this, we have you down for Wednesday from 11:25 -
> 11:45am.  Just let me know and I'll get it up on the schedule.
>

This slot is perfect, and I'll run it with one of my tripleo co-workers
(Alex won't be here).

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] The Forum Schedule is now live

2018-04-30 Thread Emilien Macchi
On Fri, Apr 27, 2018 at 9:04 AM, Jimmy McArthur <ji...@openstack.org> wrote:

> Hello all -
>
> Please take a look here for the posted Forum schedule:
> https://www.openstack.org/summit/vancouver-2018/summit-schedule#track=224
> You should also see it update on your Summit App.
>

Why TripleO doesn't have project update?
Maybe we could combine it with TripleO - Project Onboarding if needed but
it would be great to have it advertised as a project update!

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] Proposing Tobias Urdin to join Puppet OpenStack core

2018-04-27 Thread Emilien Macchi
+1, thanks Tobias for your contributions!

On Fri, Apr 27, 2018 at 8:21 AM, Iury Gregory <iurygreg...@gmail.com> wrote:

> +1
>
> On Fri, Apr 27, 2018, 12:15 Mohammed Naser <mna...@vexxhost.com> wrote:
>
>> Hi everyone,
>>
>> I'm proposing that we add Tobias Urdin to the core Puppet OpenStack
>> team as they've been putting great reviews over the past few months
>> and they have directly contributed in resolving all the Ubuntu
>> deployment issues and helped us bring Ubuntu support back and make the
>> jobs voting again.
>>
>> Thank you,
>> Mohammed
>>
>> 
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:
>> unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>


-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] ironic automated cleaning by default?

2018-04-27 Thread Emilien Macchi
On Fri, Apr 27, 2018 at 6:43 AM, Dmitry Tantsur <dtant...@redhat.com> wrote:
[...]

I would like to run at least one TripleO CI job with cleaning enabled. Any
> objections to that? If not, what would be the best job (it has to run
> ironic, obviously)?
>
> [0] https://review.openstack.org/#/q/topic:cleaning+status:open


We "only" have 2 jobs in the (third party) gate: fs001 and fs035. Both are
testing the same thing the last time I checked except fs035 is ipv6. I
would pick one of them and just do it.
I'll let CI team comment on that.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Fwd: [tripleo] PTG session about All-In-One installer: recap & roadmap

2018-04-26 Thread Emilien Macchi
We created a new board where we'll track the efforts for the all-in-one
installer:
https://trello.com/b/iAHhAgjV/tripleo-all-in-one-installer

Note: please do not use the containerized undercloud dashboard for these
tasks, it is a separated effort.
Feel free to join the board and feed the backlog!

Thanks,

On Thu, Apr 5, 2018 at 10:02 AM, Dan Prince <dpri...@redhat.com> wrote:

> On Thu, Apr 5, 2018 at 12:24 PM, Emilien Macchi <emil...@redhat.com>
> wrote:
> > On Thu, Apr 5, 2018 at 4:37 AM, Dan Prince <dpri...@redhat.com> wrote:
> >
> >> Much of the work on this is already there. We've been using this stuff
> >> for over a year to dev/test the containerization efforts for a long
> >> time now (and thanks for your help with this effort). The problem I
> >> think is how it is all packaged. While you can use it today it
> >> involves some tricks (docker in docker), or requires you to use an
> >> extra VM to minimize the installation footprint on your laptop.
> >>
> >> Much of the remaining work here is really just about packaging and
> >> technical debt. If we put tripleoclient and heat-monolith into a
> >> container that solves much of the requirements problems and
> >> essentially gives you a container which can transform Heat templates
> >> to Ansible. From the ansible side we need to do a bit more work to
> >> mimimize our dependencies (i.e. heat hooks). Using a virtual-env would
> >> be one option for developers if we could make that work. I lighter set
> >> of RPM packages would be another way to do it. Perhaps both...
> >> Then a smaller wrapper around these things (which I personally would
> >> like to name) to make it all really tight.
> >
> >
> > So if I summarize the discussion:
> >
> > - A lot of positive feedback about the idea and many use cases, which is
> > great.
> >
> > - Support for non-containerized services is not required, as long as we
> > provide a way to update containers with under-review patches for
> developers.
>
> I think we still desire some (basic no upgrades) support for
> non-containerized baremetal at this time.
>
> >
> > - We'll probably want to breakdown the "openstack undercloud deploy"
> process
> > into pieces
> > * start an ephemeral Heat container
>
> It already supports this if use don't use the --heat-native option,
> also you can customize the container used for heat via
> --heat-container-image. So we already have this! But rather than do
> this I personally prefer the container to have python-tripleoclient
> and heat-monolith in it. That way everything everything is in there to
> generate Ansible templates. If you just use Heat you are missing some
> of the pieces that you'd still have to install elsewhere on your host.
> Having them all be in one scoped container which generates Ansible
> playbooks from Heat templates is better IMO.
>
> > * create the Heat stack passing all requested -e's
> > * run config-download and save the output
> >
> > And then remove undercloud specific logic, so we can provide a generic
> way
> > to create the config-download playbooks.
>
> Yes. Lets remove some of the undercloud logic. But do note that most
> of the undercloud specific login is now in undercloud_config.py anyway
> so this is mostly already on its way.
>
> > This generic way would be consumed by the undercloud deploy commands but
> > also by the new all-in-one wrapper.
> >
> > - Speaking of the wrapper, we will probably have a new one. Several names
> > were proposed:
> > * openstack tripleo deploy
> > * openstack talon deploy
> > * openstack elf deploy
>
> The wrapper could be just another set of playbooks. That we give a
> name too... and perhaps put a CLI in front of as well.
>
> >
> > - The wrapper would work with deployed-server, so we would noop Neutron
> > networks and use fixed IPs.
>
> This would be configurable I think depending on which templates were
> used. Noop as a default for developer deployments but do note that
> some services like Neutron aren't going to work unless you have some
> basic network setup. Noop is useful if you prefer to do this manually,
> but our os-net-config templates are quite useful to automate things.
>
> >
> > - Investigate the packaging work: containerize tripleoclient and
> > dependencies, see how we can containerized Ansible + dependencies (and
> > eventually reduce them at strict minimum).
> >
> > Let me know if I missed something important, hopefully we can move things
> > forward during this cycle.
> > --
> > Emilien Macchi
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 18th Edition

2018-04-24 Thread Emilien Macchi
Note: this is the eighteenth edition of a weekly update of what happens in
TripleO.
The goal is to provide a short reading (less than 5 minutes) to learn where
we are and what we're doing.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-April/129450.html

+-+
| General announcements |
+-+

+--> Rocky milestone 1 was released last week! We're currently in milestone
2 cycle: https://releases.openstack.org/rocky/schedule.html

+--+
| Continuous Integration |
+--+

+--> Ruck is panda and Rover is quiquell. Please let them know any new CI
issue.
+--> Master promotion is 4 day, Queens is 0 day, Pike is 7 days and Ocata
is 4 days.
+--> Still working on libvirt based multinode reproducer, see
https://goo.gl/DYCnkx
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting

+-+
| Upgrades |
+-+

+--> No updates this week, some reviews are still needed.
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Still working on UX and parity topics.
+--> Upgrade job is waiting for a promotion on master to work.
+--> Still prototyping container updates before undercloud deployment.
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> config-download now the default with tripleoclient!
+--> ceph jobs migrated to external_deploy_tasks
+--> CI jobs almost all converted (experimental in progress)
+--> octavia and skydive still in progress
+--> finalizing tripleo-ui integration, tripleo-common patches are now
stable
+--> need workflows to cancel deployment and undeploy
+--> More:
https://etherpad.openstack.org/p/tripleo-config-download-squad-status

+--+
| Integration |
+--+

+--> No updates.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Finishing config-download integration
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> Custom validations/swift storage work.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> Working on neutron sidecar container.
+--> NFV deployments testing config-download.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> No updates.
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> No updates.
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Owls May Have Coexisted With Dinosaurs!
"We do know that owl-like birds like Berruornis and Ogygoptynx lived 60
million years ago, during the Paleocene epoch, which means it's entirely
possible that the ultimate ancestors of owls coexisted with dinosaurs
toward the end of the Cretaceous period.
Technically speaking, owls are one of the most ancient groups of
terrestrial birds, rivaled only by the gamebirds (i.e., chickens, turkeys
and pheasants) of the order Galliformes."
Source: https://www.thoughtco.com/fascinating-facts-about-owls-4107228


Thanks all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Proposing Marius Cornea core on upgrade bits

2018-04-23 Thread Emilien Macchi
Thanks everyone for your positive feedback.
I've updated Gerrit!

Welcome Marius and thanks again for your hard work!

On Mon, Apr 23, 2018 at 4:55 AM, James Slagle <james.sla...@gmail.com>
wrote:

> On Thu, Apr 19, 2018 at 1:01 PM, Emilien Macchi <emil...@redhat.com>
> wrote:
> > Greetings,
> >
> > As you probably know mcornea on IRC, Marius Cornea has been contributing
> on
> > TripleO for a while, specially on the upgrade bits.
> > Part of the quality team, he's always testing real customer scenarios and
> > brings a lot of good feedback in his reviews, and quite often takes care
> of
> > fixing complex bugs when it comes to advanced upgrades scenarios.
> > He's very involved in tripleo-upgrade repository where he's already core,
> > but I think it's time to let him +2 on other tripleo repos for the
> patches
> > related to upgrades (we trust people's judgement for reviews).
> >
> > As usual, we'll vote!
> >
> > Thanks everyone for your feedback and thanks Marius for your hard work
> and
> > involvement in the project.
>
> +1
>
>
> --
> -- James Slagle
> --
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Reminder about openstack/instack-undercloud contributions

2018-04-20 Thread Emilien Macchi
In case you missed it, the TripleO team is working on making the
containerized undercloud by default during Rocky.

It means that any patch in instack-undercloud won't probably be useful for
Rocky, unless you need to backport something in stable branches then fine.
Anything that is new, has to be ported in tripleoclient and
tripleo-heat-templates.

Feel free to reach out on #tripleo if you have any question!

Thanks,
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] roadmap on containers workflow

2018-04-20 Thread Emilien Macchi
So the role has proven to be useful and we're now sure that we need it to
deploy a container registry before any container in the deployment, which
means we can't use the puppet code anymore for this service.

I propose that we move the role to OpenStack:
https://review.openstack.org/#/c/563197/
https://review.openstack.org/#/c/563198/
https://review.openstack.org/#/c/563200/

So we can properly peer review and gate the new role.

In the meantime, we continue to work on the new workflow.
Thanks,

On Sun, Apr 15, 2018 at 7:24 PM, Emilien Macchi <emil...@redhat.com> wrote:

> On Fri, Apr 13, 2018 at 5:58 PM, Emilien Macchi <emil...@redhat.com>
> wrote:
>
>>
>> A bit of progress today, I prototyped an Ansible role for that purpose:
>> https://github.com/EmilienM/ansible-role-container-registry
>>
>> The next step is, I'm going to investigate if we can deploy Docker and
>> Docker Distribution (to deploy the registry v2) via the existing composable
>> services in THT by using external_deploy_tasks maybe (or another interface).
>> The idea is really to have the registry ready before actually deploying
>> the undercloud containers, so we can modify them in the middle (run
>> container-check in our case).
>>
>
> This patch: https://review.openstack.org/#/c/561377 is deploying Docker
> and Docker Registry v2 *before* containers deployment in the docker_steps.
> It's using the external_deploy_tasks interface that runs right after the
> host_prep_tasks, so still before starting containers.
>
> It's using the Ansible role that was prototyped on Friday, please take a
> look and raise any concern.
> Now I would like to investigate how we can run container workflows between
> the deployment and docker and containers deployments.
> --
> Emilien Macchi
>



-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Proposing Marius Cornea core on upgrade bits

2018-04-19 Thread Emilien Macchi
Greetings,

As you probably know mcornea on IRC, Marius Cornea has been contributing on
TripleO for a while, specially on the upgrade bits.
Part of the quality team, he's always testing real customer scenarios and
brings a lot of good feedback in his reviews, and quite often takes care of
fixing complex bugs when it comes to advanced upgrades scenarios.
He's very involved in tripleo-upgrade repository where he's already core,
but I think it's time to let him +2 on other tripleo repos for the patches
related to upgrades (we trust people's judgement for reviews).

As usual, we'll vote!

Thanks everyone for your feedback and thanks Marius for your hard work and
involvement in the project.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] The Weekly Owl - 17th Edition

2018-04-17 Thread Emilien Macchi
Note: this is the seventeeth edition of a weekly update of what happens in
TripleO.
The goal is to provide a short reading (less than 5 minutes) to learn where
we are and what we're doing.
Any contributions and feedback are welcome.
Link to the previous version:
http://lists.openstack.org/pipermail/openstack-dev/2018-April/129255.html

+-+
| General announcements |
+-+

+--> Rocky milestone 1 will be released this week (probably tomorrow)!
+--> (reminder) if you're looking at reproducing a CI job, checkout:
https://docs.openstack.org/tripleo-docs/latest/contributor/reproduce-ci.html

+--+
| Continuous Integration |
+--+

+--> Ruck is quiquell and Rover is panda. Please let them know any new CI
issue.
+--> Master promotion is 1 day, Queens is 2 days, Pike is 4 days and Ocata
is 5 days.
+--> Efforts around libvirt based multinode reproducer, see
https://trello.com/c/JEGLSVh6/323-reproduce-ci-jobs-with-libvirt
+--> More: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting and
https://goo.gl/D4WuBP

+-+
| Upgrades |
+-+

+--> Progress on FFU CLI in tripleoclient, need reviews.
+--> Work for containerized undercloud upgrades has been merged. Testing
will make progress after rocky-m1 (with new tags).
+--> More: https://etherpad.openstack.org/p/tripleo-upgrade-squad-status

+---+
| Containers |
+---+

+--> Still working on UX problems
+--> Still working on container workflow, good progress last week where
container prepare isn't needed. Now working on container updates.
+--> Investigating how to bootstrap Docker + Registry before deploying
containers
+--> Progress on routed networks support
+--> More: https://etherpad.openstack.org/p/tripleo-containers-squad-status

+--+
| config-download |
+--+

+--> Moving to config-download by default is coming very soon (once Ceph
patches land).
+--> Ceph was migrated and all patches are going to merge this week.
+--> octavia/skydive migration is wip.
+--> Improving deploy-steps-tasks.j2 to improve playbook readability and
memory consumption
+--> UI work is work in progress.
+--> More: https://etherpad.openstack.org/p/tripleo-config-downlo
ad-squad-status

+--+
| Integration |
+--+

+--> No updates.
+--> More: https://etherpad.openstack.org/p/tripleo-integration-squad-status

+-+
| UI/CLI |
+-+

+--> Efforts on config-download integration
+--> Added type to ansible-playbook messages (feedback needed)
+--> More: https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status

+---+
| Validations |
+---+

+--> No updates.
+--> More: https://etherpad.openstack.org/p/tripleo-validations-squad-status

+---+
| Networking |
+---+

+--> No updates this week.
+--> More: https://etherpad.openstack.org/p/tripleo-networking-squad-status

+--+
| Workflows |
+--+

+--> Need reviews, see etherpad.
+--> Working on workflows v2
+--> More: https://etherpad.openstack.org/p/tripleo-workflows-squad-status

+---+
| Security |
+---+

+--> Tomorrow's meeting is about Storyboard migration and Secret management.
+--> More: https://etherpad.openstack.org/p/tripleo-security-squad

++
| Owl fact  |
++

Did you know owls were watching you while working on TripleO?
Check this out:
https://www.reddit.com/r/pics/comments/8cz8v0/owls_born_outside_of_office_window_wont_stop/
(Thanks Wes for the link)


Thanks all for reading and stay tuned!
--
Your fellow reporter, Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] roadmap on containers workflow

2018-04-15 Thread Emilien Macchi
On Fri, Apr 13, 2018 at 5:58 PM, Emilien Macchi <emil...@redhat.com> wrote:

>
> A bit of progress today, I prototyped an Ansible role for that purpose:
> https://github.com/EmilienM/ansible-role-container-registry
>
> The next step is, I'm going to investigate if we can deploy Docker and
> Docker Distribution (to deploy the registry v2) via the existing composable
> services in THT by using external_deploy_tasks maybe (or another interface).
> The idea is really to have the registry ready before actually deploying
> the undercloud containers, so we can modify them in the middle (run
> container-check in our case).
>

This patch: https://review.openstack.org/#/c/561377 is deploying Docker and
Docker Registry v2 *before* containers deployment in the docker_steps.
It's using the external_deploy_tasks interface that runs right after the
host_prep_tasks, so still before starting containers.

It's using the Ansible role that was prototyped on Friday, please take a
look and raise any concern.
Now I would like to investigate how we can run container workflows between
the deployment and docker and containers deployments.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] roadmap on containers workflow

2018-04-13 Thread Emilien Macchi
On Wed, Apr 11, 2018 at 3:38 PM, Steve Baker <sba...@redhat.com> wrote:
>
> - If agreed, we'll create a new Ansible role called 
> ansible-role-container-registry
> that for now will deploy exactly what we have in TripleO, without extra
> feature.
>
> +1
>

A bit of progress today, I prototyped an Ansible role for that purpose:
https://github.com/EmilienM/ansible-role-container-registry

The next step is, I'm going to investigate if we can deploy Docker and
Docker Distribution (to deploy the registry v2) via the existing composable
services in THT by using external_deploy_tasks maybe (or another interface).
The idea is really to have the registry ready before actually deploying the
undercloud containers, so we can modify them in the middle (run
container-check in our case).
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Recap of Python 3 testing session at PTG

2018-04-12 Thread Emilien Macchi
On Tue, Mar 20, 2018 at 10:28 AM, Javier Pena <jp...@redhat.com> wrote:
> One point we should add here: to test Python 3 we need some base
operating system to work on. For now, our plan is to create a set of
stabilized Fedora 28 repositories and use them only for CI jobs. See [1]
for details on this plan.

Javier, Alfredo, where are we regarding this topic? Have we made some
progress on f28 repos? I'm interested to know about the next steps, I
really want us to make some progress on python3 testing here.

Thanks,
--
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] roadmap on containers workflow

2018-04-12 Thread Emilien Macchi
On Thu, Apr 12, 2018 at 1:16 AM, Bogdan Dobrelya <bdobr...@redhat.com>
wrote:
[...]

> Deploy own registry as part of UC deployment or use external. For
>> instance, for production use I would like to have a cluster of 3-5
>> registries with HAProxy in front to speed up 1k nodes deployments.
>>
>
> Note that this implies HA undercloud as well. Although, given that HA
> undercloud is goodness indeed, I would *not* invest time into reliable
> container registry deployment architecture for undercloud as we'll have it
> for free, once kubernetes/openshift control plane for openstack becomes
> adopted. There is a very strong notion of build pipelines, reliable
> containers registries et al.


Right. HA undercloud is out of context now.
-- 
Emilien Macchi
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


  1   2   3   4   5   6   7   8   9   10   >