Re: [Spacewalk-devel] Spacewalk on RHEL8 - Step 3 completed - YUM replacement
Hi Am Mittwoch, 6. Mai 2020, 10:25:06 CEST schrieb Stefan Bluhm: > Hello all, [...] > Open topics: > - Move the server to Python 3 and remove Python 2 scripts. Uyuni made the move to python3 over a year ago ... and we still find places which break. I would strongly suggest you check the uyuni git repo and try to find the commits. It will save you month of work. -- Regards Michael Calmer -- Michael Calmer SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, D-90409 Nuernberg T: +49 (0) 911 74053 0 F: +49 (0) 911 74053575 - e-mail: michael.cal...@suse.com -- SUSE Software Solutions Germany GmbH, GF: Felix Imendörffer (HRB 36809, AG Nürnberg) ___ Spacewalk-devel mailing list Spacewalk-devel@redhat.com https://www.redhat.com/mailman/listinfo/spacewalk-devel
Re: [Spacewalk-devel] Spacewalk on RHEL8 - Step 3 completed - YUM replacement
Hello Pau, I think I am likely to join forces with Neal in future then. Thank you for sharing the video. I will not put a focus on optimising reposync anymore. I can be patient at times :) Best wishes, Stefan Von: "Pau Garcia Quiles" An: "spacewalk-devel" Gesendet: Mittwoch, 6. Mai 2020 12:54:37 Betreff: Re: [Spacewalk-devel] Spacewalk on RHEL8 - Step 3 completed - YUM replacement Hi Stefan In Uyuni we are using zypper instead of yum or dnf. I guess Neal Gompa, who is working on making Uyuni available on Fedora without zypper, may be interested. [ https://github.com/uyuni-project/uyuni/blob/master/backend/satellite_tools/repo_plugins/yum_src.py | https://github.com/uyuni-project/uyuni/blob/master/backend/satellite_tools/repo_plugins/yum_src.py ] BTW, in Uyuni we have recently made some optimizations in reposync that led to a 600% performance increase. I don't how portable they are to Spacewalk. Here's a video explaining how the developer attacked the problem, in case you are curious: [ https://www.youtube.com/watch?v=HY7TtYVv6DM=youtu.be | https://www.youtube.com/watch?v=HY7TtYVv6DM=youtu.be ] Thank you Pau Garcia Quiles SUSE Manager Product Owner & Technical Project Manager SUSE Software Solutions Spain De: spacewalk-devel-boun...@redhat.com en nombre de Stefan Bluhm Enviado: miércoles, 6 de mayo de 2020 10:25 Para: spacewalk-devel Asunto: [Spacewalk-devel] Spacewalk on RHEL8 - Step 3 completed - YUM replacement Hello all, another update: YUM has now been replaced by DNF (pull request has been created). @Oracle and SUSE Teams, can you please check if reposync is still working for you as expected? I made significant changes to yum_src.py which might impact your code (although the idea was to not have an impact). You can find packaged versions here: [ https://copr.fedorainfracloud.org/coprs/sbluhm/nightly/ | https://copr.fedorainfracloud.org/coprs/sbluhm/nightly/ ] (spacewalk-backend-tools and spacewalk-utils) Overall, the journey to replace yum with dnf was not too much fun and took way longer than I planned. I tried to test as many scenarios as possible (Mirror lists, base urls, filters, Erratas) but I am sure there are still plenty of bugs in there that I did not find yet. I did not test headers, proxys or non-basic scenarios. Open topics: - Move the server to Python 3 and remove Python 2 scripts. - Redo package dependencies and clean them - Transfer new/missing dependencies to the nightly/copr repositories - Migrate my Spacewalk Server to CentOS 8 This is where my activity here with Spacewalk will stop. You can visit my personal project note to get the latest working installation instructions: [ https://www.bluhm-de.com/content/os-tools/en/applications/spacewalk/installing-spacewalk-nightly-on-centos8-rhel8.html | https://www.bluhm-de.com/content/os-tools/en/applications/spacewalk/installing-spacewalk-nightly-on-centos8-rhel8.html ] Best wishes, Stefan - Ursprüngliche Mail - Von: "Stefan Bluhm" An: "spacewalk-devel" Gesendet: Sonntag, 15. März 2020 16:18:36 Betreff: Spacewalk on RHEL8 - Step 2 (of many) completed Hello all, just to give you an update: I now have Spacewalk 8 installing and running on CentOS 8. I have created pull requests for all my modifications. Couple of issues I noticed straight away: - When installing the setup packages, some dependencies seem to be not automatically installing (spacewalk-selinux, taskomatic,...) - the password field at the first registration. It does not show a green tick when the password is OK. (optical issue) - The overview page is pretty empty. Not sure if this is just due to an empty system or of this is an issue. - When creating a repo, CSRF token issues/403 show up. I expect these things to show up at some places then. Clicking through the rest, I do not see any issues on the pages at first glance. To try this yourself, get started with a minimal CentOS 8 in 12 lines: systemctl disable firewalld; systemctl stop firewalld # no need to play with individual ports dnf config-manager --add-repo [ https://raw.githubusercontent.com/sbluhm | https://raw.githubusercontent.com/sbluhm ] # packages that still need to be put to COPR echo "gpgcheck=0" >> /etc/yum.repos.d/raw.githubusercontent.com_sbluhm.repo dnf -y copr enable sbluhm/python-packages; dnf -y copr enable sbluhm/java-packages # stuff to move to spacewalkproject dnf -y copr enable sbluhm/nightly # as soon as the official nightly builds with my pull requests, I will update this section dnf -y config-manager --enable PowerTools dnf -y module enable javapackages-tools:201801/common dnf -y install epel-release langpacks-en langpacks-de glibc-all-langpacks # without the langpacks, Postgresql will not run. dnf -y update python3-dmidecode # own version required to install python2-dmicode rpm -e yum # r
Re: [Spacewalk-devel] Spacewalk on RHEL8 - Step 3 completed - YUM replacement
Hi Stefan In Uyuni we are using zypper instead of yum or dnf. I guess Neal Gompa, who is working on making Uyuni available on Fedora without zypper, may be interested. https://github.com/uyuni-project/uyuni/blob/master/backend/satellite_tools/repo_plugins/yum_src.py BTW, in Uyuni we have recently made some optimizations in reposync that led to a 600% performance increase. I don't how portable they are to Spacewalk. Here's a video explaining how the developer attacked the problem, in case you are curious: https://www.youtube.com/watch?v=HY7TtYVv6DM=youtu.be Thank you Pau Garcia Quiles SUSE Manager Product Owner & Technical Project Manager SUSE Software Solutions Spain De: spacewalk-devel-boun...@redhat.com en nombre de Stefan Bluhm Enviado: miércoles, 6 de mayo de 2020 10:25 Para: spacewalk-devel Asunto: [Spacewalk-devel] Spacewalk on RHEL8 - Step 3 completed - YUM replacement Hello all, another update: YUM has now been replaced by DNF (pull request has been created). @Oracle and SUSE Teams, can you please check if reposync is still working for you as expected? I made significant changes to yum_src.py which might impact your code (although the idea was to not have an impact). You can find packaged versions here: https://copr.fedorainfracloud.org/coprs/sbluhm/nightly/ (spacewalk-backend-tools and spacewalk-utils) Overall, the journey to replace yum with dnf was not too much fun and took way longer than I planned. I tried to test as many scenarios as possible (Mirror lists, base urls, filters, Erratas) but I am sure there are still plenty of bugs in there that I did not find yet. I did not test headers, proxys or non-basic scenarios. Open topics: - Move the server to Python 3 and remove Python 2 scripts. - Redo package dependencies and clean them - Transfer new/missing dependencies to the nightly/copr repositories - Migrate my Spacewalk Server to CentOS 8 This is where my activity here with Spacewalk will stop. You can visit my personal project note to get the latest working installation instructions: https://www.bluhm-de.com/content/os-tools/en/applications/spacewalk/installing-spacewalk-nightly-on-centos8-rhel8.html Best wishes, Stefan - Ursprüngliche Mail - Von: "Stefan Bluhm" An: "spacewalk-devel" Gesendet: Sonntag, 15. März 2020 16:18:36 Betreff: Spacewalk on RHEL8 - Step 2 (of many) completed Hello all, just to give you an update: I now have Spacewalk 8 installing and running on CentOS 8. I have created pull requests for all my modifications. Couple of issues I noticed straight away: - When installing the setup packages, some dependencies seem to be not automatically installing (spacewalk-selinux, taskomatic,...) - the password field at the first registration. It does not show a green tick when the password is OK. (optical issue) - The overview page is pretty empty. Not sure if this is just due to an empty system or of this is an issue. - When creating a repo, CSRF token issues/403 show up. I expect these things to show up at some places then. Clicking through the rest, I do not see any issues on the pages at first glance. To try this yourself, get started with a minimal CentOS 8 in 12 lines: systemctl disable firewalld; systemctl stop firewalld # no need to play with individual ports dnf config-manager --add-repo https://raw.githubusercontent.com/sbluhm # packages that still need to be put to COPR echo "gpgcheck=0" >> /etc/yum.repos.d/raw.githubusercontent.com_sbluhm.repo dnf -y copr enable sbluhm/python-packages; dnf -y copr enable sbluhm/java-packages # stuff to move to spacewalkproject dnf -y copr enable sbluhm/nightly # as soon as the official nightly builds with my pull requests, I will update this section dnf -y config-manager --enable PowerTools dnf -y module enable javapackages-tools:201801/common dnf -y install epel-release langpacks-en langpacks-de glibc-all-langpacks # without the langpacks, Postgresql will not run. dnf -y update python3-dmidecode # own version required to install python2-dmicode rpm -e yum # remove yum 4 to install yum 3 dnf -y install spacewalk-setup spacewalk-setup-postgresql tomcat osa-dispatcher spacewalk-search spacewalk-backend-sql-postgresql spacewalk-taskomatic spacewalk-java spacewalk-java-postgresql spacewalk-selinux # not all dependencies are strangely installed so doing it all here. spacewalk-setup You can visit my personal project note to get the latest working installation instructions (currently same as above): https://www.bluhm-de.com/content/os-tools/en/applications/spacewalk/installing-spacewalk-nightly-on-centos8-rhel8.html Open topics: - How will the Spacewalk Project continue? - Remove Python 2 scripts. - Update to latest/newer required packages if possible. - Test for non-working items - Update package requirements/dependencies in
