[Spacewalk-list] Using spacewalk-create-yumrepo.py - Linking issues
Hi all. As I continue my quest for spacewalk happiness it seems the script spacewalk-create-yumrepo.py from the spacewalk-api-scripts-master package is having some issues with large repositories. I tried to replicate the Oracle Linux 6.x and while the repo has approx 20976 packages, there are only 6800 links being created. Does anyone know if there is a debug to this script? I like it and would love to send in a debug report with some useful output. It give me no errors to stdout and really don't know if it logs anyplace. Anyway, time to continue on. Regards, Glen Collins ___ Spacewalk-list mailing list Spacewalk-list@redhat.com https://www.redhat.com/mailman/listinfo/spacewalk-list
Re: [Spacewalk-list] Using spacewalk-create-yumrepo.py - Linking issues
Hey, On 1 Oct 2014, at 12:07 pm, Glen Collins glenc2...@comcast.net wrote: As I continue my quest for spacewalk happiness it seems the script spacewalk-create-yumrepo.py from the spacewalk-api-scripts-master package is having some issues with large repositories. Have you checked the rhn_taskomatic_daemon.log and catalina.out (for Tomcat)? I’ve noticed that they tend to throw OutOfMemory errors using the default memory limits with the big OL repos. I’ve bumped up my Java memory limit to 8GB, but then I have Spacewalk on a machine with 256GB of RAM. :) -- Oracle http://www.oracle.com Avi Miller | Product Management Director | +61 (3) 8616 3496 Oracle Linux and Virtualization 417 St Kilda Road, Melbourne, Victoria 3004 Australia ___ Spacewalk-list mailing list Spacewalk-list@redhat.com https://www.redhat.com/mailman/listinfo/spacewalk-list
Re: [Spacewalk-list] Using spacewalk-create-yumrepo.py - Linking issues
Unfortunately I look at all the logs ad searched for the outofmemory and nothing came up. Looking at the code this is more python but maybe the api connection is failing and not returning all the rpm's in the repository. I'm just wondering what log I should be looking at for the kind of api connectivity. I did look at the rhn_web_api.log and see the request for the packages but no sort of errors. Not sure where to go from here. While I needed this repo for just the client software it would be nice to have my oracle available. Regards, Glen Collins - Original Message - Hey, On 1 Oct 2014, at 12:07 pm, Glen Collins glenc2...@comcast.net wrote: As I continue my quest for spacewalk happiness it seems the script spacewalk-create-yumrepo.py from the spacewalk-api-scripts-master package is having some issues with large repositories. Have you checked the rhn_taskomatic_daemon.log and catalina.out (for Tomcat)? I’ve noticed that they tend to throw OutOfMemory errors using the default memory limits with the big OL repos. I’ve bumped up my Java memory limit to 8GB, but then I have Spacewalk on a machine with 256GB of RAM. :) -- Oracle http://www.oracle.com Avi Miller | Product Management Director | +61 (3) 8616 3496 Oracle Linux and Virtualization 417 St Kilda Road, Melbourne, Victoria 3004 Australia ___ Spacewalk-list mailing list Spacewalk-list@redhat.com https://www.redhat.com/mailman/listinfo/spacewalk-list
Re: [Spacewalk-list] Using spacewalk-create-yumrepo.py - Linking issues
Ah...I see it. It's not a problem with the code at all or the spacewalk services. I looked at the code a little better and the RPC call used in the script is xmlrpclib.Server.channel.software.listLatestPackages Which I assume it maybe a several months back. So it's only returning the latest packages and creating the links. I changed the code to use: xmlrpclib.Server.channel.software.listAllPackages and it looks like so far it's going to return everything in the repo as I expected. So false alarm! Thanks for the info though. Regards, Glen Collins - Original Message - Unfortunately I look at all the logs ad searched for the outofmemory and nothing came up. Looking at the code this is more python but maybe the api connection is failing and not returning all the rpm's in the repository. I'm just wondering what log I should be looking at for the kind of api connectivity. I did look at the rhn_web_api.log and see the request for the packages but no sort of errors. Not sure where to go from here. While I needed this repo for just the client software it would be nice to have my oracle available. Regards, Glen Collins - Original Message - Hey, On 1 Oct 2014, at 12:07 pm, Glen Collins glenc2...@comcast.net wrote: As I continue my quest for spacewalk happiness it seems the script spacewalk-create-yumrepo.py from the spacewalk-api-scripts-master package is having some issues with large repositories. Have you checked the rhn_taskomatic_daemon.log and catalina.out (for Tomcat)? I’ve noticed that they tend to throw OutOfMemory errors using the default memory limits with the big OL repos. I’ve bumped up my Java memory limit to 8GB, but then I have Spacewalk on a machine with 256GB of RAM. :) -- Oracle http://www.oracle.com Avi Miller | Product Management Director | +61 (3) 8616 3496 Oracle Linux and Virtualization 417 St Kilda Road, Melbourne, Victoria 3004 Australia ___ Spacewalk-list mailing list Spacewalk-list@redhat.com https://www.redhat.com/mailman/listinfo/spacewalk-list
Re: [Spacewalk-list] Using spacewalk-create-yumrepo.py - Linking issues
On 1 Oct 2014, at 7:55 pm, Glen Collins glenc2...@comcast.net wrote: and it looks like so far it's going to return everything in the repo as I expected. Yeah, the Oracle Linux “latest” repos actually store every version of every RPM from GA release which is why there are so many RPMs in that repo. :) It also means you can install any version of an RPM with just the latest repo enabled, though. -- Oracle http://www.oracle.com Avi Miller | Product Management Director | +61 (3) 8616 3496 Oracle Linux and Virtualization 417 St Kilda Road, Melbourne, Victoria 3004 Australia ___ Spacewalk-list mailing list Spacewalk-list@redhat.com https://www.redhat.com/mailman/listinfo/spacewalk-list
