On Wed, 2008-07-23 at 14:03 -0700, Toshio Kuratomi wrote: > Mike Bonnet wrote: > > On Wed, 2008-07-23 at 15:56 -0400, Naveen Gavini wrote: > >> Hello all, > >> > >> When importing or building RPM's from source is there an option that is > >> throttling the upload speed of the package? > >> We are seeing speeds of 10kbps which makes importing/building large > >> packages very slow. > > > > Package upload happens via xml-rpc, and to avoid holding the entire > > contents of the file in memory, it's done in chunks. Unfortunately > > python xml-rpc libs don't support keep-alive, so if you're using SSL > > authentication you incur the non-trivial SSL connection setup/teardown > > overhead for every chunk, in addition to the TCP connection > > setup/teardown. The chunk size in your version is probably very small > > (64k?). That has been increased in the Koji repo, but not released yet. > > The next version will improve this situation somewhat. > > > Any chance we could port to pycurl which does support keep-alive? Or is > urllib pretty deeply embedded in the code ATM?
I don't know anything about pycurl, but the transport layer is decently separated from the XML-RPC layer in xmlrpclib, so it should be possible to replace that it with a transport that supports SSL and keep-alive. I haven't looked at how much work this might be though. > -Toshio > > -- > Fedora-buildsys-list mailing list > [email protected] > https://www.redhat.com/mailman/listinfo/fedora-buildsys-list -- Fedora-buildsys-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
