I agree that scheduling these is the best way to go. We have a new distributed design coming in pulp 2.4 that will make scheduling especially effective for use cases like this.
For more immediate ideas, you might try experimenting with the "--bg" option on the sync command. The command you're using now will block until the sync is done, so there's not an opportunity to run multiple syncs at a time. Michael ----- Original Message ----- From: "Josh Baird" <[email protected]> To: "Paul Jochum" <[email protected]>, [email protected] Sent: Thursday, January 9, 2014 7:53:50 AM Subject: Re: [Pulp-list] How to speed up nightly repo syncs on pulp? I'm not sure if this will actually speed your sync up, but you should consider scheduling sync's of the repos that you need. This is a built in function of Pulp: $ pulp-admin rpm repo sync schedules create --schedule=2013-10-23T00:00Z/P1D --repo-id=rhel6-server-x86_64 Josh -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Paul Jochum Sent: Thursday, January 09, 2014 7:39 AM To: [email protected] Subject: [Pulp-list] How to speed up nightly repo syncs on pulp? Hi All: Short Synopsis: What is the most efficient way to sync nightly repos from RHEL using pulp? Long explanation: We currently have a RH Satellite Server, and would like to replace it with a pulp server. Each night, we have our Satellite Server perform a nightly sync of all of its channels from RedHat with the command "satellite-sync -email". This command takes about 20 minutes to run normally. What is the best way to replicate this on my pulp server? I have written a ksh script that basically performs a for loop of the command "pulp-admin -u xxxx -p xxxx rpm repo sync run --repo-id=$i" on all of my repos, but this usually takes 2+ hours to run. Am I running the wrong command, or is there a better way to do this? thanks, Paul _______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list _______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list _______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list
