Re: [Pulp-dev] bulk_create for Artifact, Content, ContentArtifact, and RemoteArtifact?

2018-07-11 Thread Brian Bouterse
Thanks to @dalley and @daviddavis for their help investigating the different performance issues related to the epic #3770. Here's an update on changes made and upcoming. https://pulp.plan.io/issues/3812 - 50x speedup on saving Content units when not using multi-table inheritance. I believe this

Re: [Pulp-dev] Integer IDs in Pulp 3

2018-07-11 Thread Daniel Alley
So, since I've already been working on some Pulp 3 benchmarking I decided to go ahead and benchmark this to get some actual data. Disclaimer: The following data is using bulk_create() with a modified, flat, non-inheriting content model, not the current multi-table inherited content model we're

Re: [Pulp-dev] 2.17.0 Release request

2018-07-11 Thread Brian Bouterse
This is another view of that milestone data for 2.17.0: https://tinyurl.com/y96j92hl On Mon, Jul 9, 2018 at 11:29 AM, Robin Chan wrote: > Austin has agreed to be 2.17.0 build prime and handle responsibilities to > ensure a smooth build process. > > Given the desire to ensure we deliver all

Re: [Pulp-dev] CI not working on RHEL7 (for pulp_rpm)

2018-07-11 Thread Patrick Creech
On Wed, 2018-07-11 at 18:33 +0200, Milan Kovacik wrote: > Folks, > > We've merged a package dependency requirement update[1] to make it possible > for the rich-dependencies work to be mergeable[2]. > > This has broken the EL7 builds So, often times we have needs to carry new/updated

Re: [Pulp-dev] CI not working on RHEL7 (for pulp_rpm)

2018-07-11 Thread David Davis
I agree we should carry the dependency until it’s released. The RHEL7 breakage is blocking QE currently so let’s revert the change[0] while @milan and I can work on getting a PR open to pulp-packaging to get the dependency into our repos. [0] https://github.com/pulp/pulp-packaging/pull/46 David

[Pulp-dev] DeclarativeVersion Deep Dive -- Thursday July 12

2018-07-11 Thread Brian Bouterse
I'm giving a live, less than 30 min YouTube broadcast on some of the challenges facing the plugin API for Pulp3 and a possible resolution to those issues. This will be a chat-based, public, live event. where: https://www.youtube.com/watch?v=V6SJ7M-e1rU when: 11:30 AM EDT(15:30 UTC) Agenda:

Re: [Pulp-dev] Revising PUPs

2018-07-11 Thread Ina Panova
+1 Regards, Ina Panova Software Engineer| Pulp| Red Hat Inc. "Do not go where the path may lead, go instead where there is no path and leave a trail." On Mon, Jul 9, 2018 at 3:22 PM, Dana Walker wrote: > +1 > > Dana Walker > > Associate Software Engineer > > Red Hat > >

Re: [Pulp-dev] Branch protection

2018-07-11 Thread Ina Panova
+1 Regards, Ina Panova Software Engineer| Pulp| Red Hat Inc. "Do not go where the path may lead, go instead where there is no path and leave a trail." On Tue, Jul 10, 2018 at 11:31 PM, Jeff Ortel wrote: > +1 > > > On 07/10/2018 02:30 PM, David Davis wrote: > > We noticed in Pulp

Re: [Pulp-dev] Call for Presenters: Community Demo, Wednesday July 11th

2018-07-11 Thread Brian Bouterse
We're moving this back 3 weeks to August 1, to have more presenters. If you want to present on August 1 add your name to the agenda here: https://etherpad.net/p/Pulp_Community_Demo_Agenda On Wed, Jul 4, 2018 at 3:57 PM, Brian Bouterse wrote: > Have you contributed to Pulp or the Pulp community

[Pulp-dev] CI not working on RHEL7 (for pulp_rpm)

2018-07-11 Thread Milan Kovacik
Folks, We've merged a package dependency requirement update[1] to make it possible for the rich-dependencies work to be mergeable[2]. This has broken the RHEL7 builds, which was expected and there's a bug to track the update of RHEL7 with that regard[3], scheduled for RHEL7.7 Fedora 27&28

Re: [Pulp-dev] Integer IDs in Pulp 3

2018-07-11 Thread Daniel Alley
w/ creating 400,000 units, the non-uuid PK is 30% faster at 42.22 seconds vs. 55.98 seconds. w/ searching through the same 400,000 units, performance is still about 30% faster. Doing a filter for file content units that have a relative_path__startswith={some random letter} (I put UUIDs in all

Re: [Pulp-dev] Integer IDs in Pulp 3

2018-07-11 Thread David Davis
I actually started working on converting IDs from UUIDs to integer IDs. It was pretty easy with one exception. Jobs in rq/redis are created using task id[0] and this job id needs to be a uuid. I see two possible solutions: 1. We leave task id as a UUID but every other id is an integer 2. We add a

Re: [Pulp-dev] Integer IDs in Pulp 3

2018-07-11 Thread Brian Bouterse
A 30% improvement I think is a good case for integers over uuids. Is there a ticket tracking that change? On Wed, Jul 11, 2018 at 3:55 PM, Daniel Alley wrote: > w/ creating 400,000 units, the non-uuid PK is 30% faster at 42.22 seconds > vs. 55.98 seconds. > > w/ searching through the same

Re: [Pulp-dev] Integer IDs in Pulp 3

2018-07-11 Thread David Davis
There is now: https://pulp.plan.io/issues/3848 David On Wed, Jul 11, 2018 at 4:23 PM Brian Bouterse wrote: > A 30% improvement I think is a good case for integers over uuids. > > Is there a ticket tracking that change? > > On Wed, Jul 11, 2018 at 3:55 PM, Daniel Alley wrote: > >> w/

Re: [Pulp-dev] Integer IDs in Pulp 3

2018-07-11 Thread Dennis Kliban
Thanks David. I am in favor of this change. On Wed, Jul 11, 2018 at 4:39 PM, David Davis wrote: > There is now: > > https://pulp.plan.io/issues/3848 > > David > > > On Wed, Jul 11, 2018 at 4:23 PM Brian Bouterse > wrote: > >> A 30% improvement I think is a good case for integers over uuids.