Re: [Spacewalk-list] rhnsd or osad?

2020-09-05 Thread Matt Moldvan
Wedges/segfaults/crashes, I think. On Fri, Aug 7, 2020 at 12:40 PM Guy Matz wrote: > Thanks! What does "wedges" mean? > > On Thu, Aug 6, 2020 at 7:11 PM Avi Miller wrote: > >> Hey, >> >> > On 7 Aug 2020, at 8:54 am, Guy Matz wrote: >> > >> > Do I want rhnsd running if I'm running osad? >> >>

Re: [Spacewalk-list] remove package in spacewalk repo

2018-12-18 Thread Matt Moldvan
Have a look at https://github.com/sandwormusmc/spacewalk-api-scripts/tree/master/spacewalk-remove-old-packages I made some updates there to check if a package is installed first before removing it, maybe it fits your use case and maybe the original version at

Re: [Spacewalk-list] Subtask repo-sync failed

2018-12-12 Thread Matt Moldvan
I found a similar issue yesterday while training someone else on Spacewalk. I noticed some provisioning/patching issues with our systems, and found that a spacewalk-repo-sync job had been stuck since October 1st. >From a technical perspective, I have trouble understanding how a process could be

Re: [Spacewalk-list] osa-dispatcher installation on spacewalk proxy

2018-12-12 Thread Matt Moldvan
It's extremely brittle... I struggled for months getting a global load balancer (GTM) placed in front of the Spacewalk proxies and terminating SSL, only to eventually give up and point my systems back at the master. We have the systems pointed at the GTM now, however there were multiple Jabber

Re: [Spacewalk-list] RHEL repo sync error - CURL #60

2018-10-09 Thread Matt Moldvan
using RHEL as much as possible in favor of CentOS... On Tue, Oct 9, 2018 at 11:55 AM Raymond Setchfield < raymond.setchfi...@gmail.com> wrote: > Have you got this working, Matt? > > On 9 Oct 2018, at 16:21, Matt Moldvan wrote: > > Oops, looks like my replies weren't making i

Re: [Spacewalk-list] RHEL repo sync error - CURL #60

2018-10-09 Thread Matt Moldvan
Oops, looks like my replies weren't making it to the mailing list (forgot to change the "From" option). Anyway, I intended to reply to the list and not just Robert... On Tue, Oct 9, 2018 at 11:18 AM Matt Moldvan wrote: > Yeah, makes sense. My point was that Red Hat expecting th

Re: [Spacewalk-list] Taskomatic runs indefinitely without ever generating repodata

2018-07-05 Thread Matt Moldvan
-22 09:44:48.748142-05 | 2018-07-05 09:11:28.553-05 centos7-x86_64-nonprod | centos7-x86_64-nonprod | 2015-10-21 22:02:28.107902-05 | (85 rows) On Thu, Jul 5, 2018 at 11:48 AM Gerald Vogt wrote: > On 05.07.18 16:05, Matt Moldvan wrote: > > How is the server ut

Re: [Spacewalk-list] Upgrade Spacewalk 2.6 to 2.8

2018-07-05 Thread Matt Moldvan
://github.com/spacewalkproject/spacewalk/wiki/WikiContribute On Thu, Jul 5, 2018 at 10:56 AM Gerald Vogt wrote: > On 05.07.18 16:08, Matt Moldvan wrote: > > I believe it's there: > > > > > > Remove conflicting packages > > > > When running on RHEL6, Scientifi

Re: [Spacewalk-list] Upgrade Spacewalk 2.6 to 2.8

2018-07-05 Thread Matt Moldvan
I believe it's there: Remove conflicting packages When running on RHEL6, Scientific Linux 6, CentOS 6, you need to remove certain packages formerly installed from jpackage repo which are not used anymore and cause dependency conflicts. Execute the following command: # rpm -e --nodeps

Re: [Spacewalk-list] Taskomatic runs indefinitely without ever generating repodata

2018-07-05 Thread Matt Moldvan
How is the server utilization with respect to disk I/O (something like iotop or htop might help here)? Maybe there is something else blocking and the server doesn't have enough resources to complete. Have you tried running an strace against the running process? I also had an (well, many)

Re: [Spacewalk-list] spacewalk: jabber/osad connection issue

2018-07-05 Thread Matt Moldvan
>From the client, try "echo 1 | openssl s_client -connect serverXXX.YYY.ZZZ -starttls xmpp". Does the client throw any errors about not being able to verify the certificate presented by the server? Is the CA cert used to generate that certificate present on the client? Also, what is in

Re: [Spacewalk-list] Unknown Error for OSA-DISPATCHER - No Resolution yet

2018-01-12 Thread Matt Moldvan
If you've changed the back end multiple times it's possible the password for your master in the rhnpushdispatcher table of your Spacewalk database is now incorrect. Try deleting the entries in the rhnpushdispatcher table and restarting osa-dispatcher. That service fails on a somewhat regular

Re: [Spacewalk-list] osa-dispatcher Error Caught

2017-03-30 Thread Matt Moldvan
cher and stopped jabberd. I removed > /var/lib/jabberd/db/* and started jabberd. I waited for jabberd to start up > and then started osa-dispatcher. It is staying up and I checked a host and > it is showing as online for OSA status. Thank you for your help! > > > > *From: *<

Re: [Spacewalk-list] osa-dispatcher Error Caught

2017-03-30 Thread Matt Moldvan
Looks like osa-dispatcher is having trouble connecting to your database... have you tried running "spacewalk-sql -i" from your master (or the same system you're seeing that error from) to get a n idea of the connectivity from that system to your database? Once you have that tested take a look at

Re: [Spacewalk-list] Spacewalk fails

2017-03-24 Thread Matt Moldvan
I just reread my message and realized I made a typo that fundamentally changed what I meant to say... I meant to say "After setting that to 0 Spacewalk was no longer having the same issue". :D On Thu, Mar 23, 2017 at 5:13 PM Matt Moldvan <m...@moldvan.com> wrote: > I had

Re: [Spacewalk-list] Spacewalk fails

2017-03-23 Thread Matt Moldvan
I had similar issues when scaling to 6,000 or so systems and it took me months of searching and trying different things to find enable_snapshots in /etc/rhn/rhn.conf... After setting that to 0 Spacewalk having the same issue. Try it out, it may work for you as well... In /etc/rhn/rhn.conf:

Re: [Spacewalk-list] How to tell what Errata has been applied

2017-02-24 Thread Matt Moldvan
those to when I installed SW. > > Is there a way for me to pull that information from the database? > > Thanks > > Daryl > > -- > > *From:* spacewalk-list-boun...@redhat.com < > spacewalk-list-boun...@redhat.com> on behalf of Matt Moldva

Re: [Spacewalk-list] Alternative ways without OSAD

2017-01-17 Thread Matt Moldvan
Depends on the volume of your systems... I tried this as well, but rhn_check initially makes HTTPS calls and with 6,000+ systems it overwhelmed the Apache instances and caused deadlocks in the Postgres databases (even with Apache and pgsql variables increased). I ended up switching the jabberd

Re: [Spacewalk-list] osa-dispatcher still fails with Spacewalk 2.6

2016-11-30 Thread Matt Moldvan
('ERROR', (, InvalidClientError(' osad-3a0bfed...@spacewalk.prod.ch3.s.com/osad',), )) Seems that in the jabber_lib.py is where the exception is thrown, in main somewhere at the very last except statement. I didn't get any further than that, though. On Tue, Nov 29, 2016 at 11:12 AM Matt Moldvan &l

Re: [Spacewalk-list] osa-dispatcher still fails with Spacewalk 2.6

2016-11-29 Thread Matt Moldvan
Ours has similar behavior on 2.5, crashing every so often. I didn't find any useful information in any of the log files, even when setting debug modes relatively high. I found the Python code that runs osa-dispatcher, and put a print statement in to watch when it crashes... unfortunately I

Re: [Spacewalk-list] New Packages in Channel, Repo Rebuild

2016-11-21 Thread Matt Moldvan
If you have a lot of packages or channels, or even if you don't, I would recommend increasing the value of the memory settings on taskomatic. From my experience they are very low by default... in /usr/share/rhn/config-defaults/rhn_taskomatic_daemon.conf update the values wrapper.java.maxmemory

Re: [Spacewalk-list] spacewalk osad No module named i18n

2016-11-10 Thread Matt Moldvan
I think I recall having this issue, as well... try updating the rhnlib package to the most recent available, it should include the i18n python code OSAD is looking for: rpm -ql rhnlib | grep i18n /usr/lib/python2.6/site-packages/rhn/i18n.py /usr/lib/python2.6/site-packages/rhn/i18n.pyc

Re: [Spacewalk-list] Satellite not offering latest kernel versions for hours after they are downloaded

2016-10-27 Thread Matt Moldvan
Take a look at taskomatic logs, you may have to update the max and min settings for memory to speed things up... Also keep an eye on rhntaskqueue to see if there are jobs in there lingering around for a long time. There are some sparsely documented options for taskomatic workers, you may have

Re: [Spacewalk-list] Spacewalk - PostgreSQL High I/O

2016-10-12 Thread Matt Moldvan
t with multi TB databases in the past with great > success but it takes a lot of planning and testing to get it right. > > On Tue, Oct 11, 2016 at 10:04 PM, Matt Moldvan <m...@moldvan.com> wrote: > > Yeah, it was quite a trial to get it to scale to that degree, so I tried &g

Re: [Spacewalk-list] Spacewalk - PostgreSQL High I/O

2016-10-11 Thread Matt Moldvan
> postgres disk. Other disks, the I/O is normal. The system not is using > swap > > and there is 3GB of swap. > > > > I will separate the postgre and apply your tips. > > > > 2016-10-10 21:58 GMT-03:00 Matt Moldvan <m...@moldvan.com>: > >> > >

Re: [Spacewalk-list] Spacewalk - PostgreSQL High I/O

2016-10-11 Thread Matt Moldvan
e is available 6GB of memory and the high I/O occur at > the postgres disk. Other disks, the I/O is normal. The system not is using > swap and there is 3GB of swap. > > I will separate the postgre and apply your tips. > > 2016-10-10 21:58 GMT-03:00 Matt Moldvan <m...@moldvan.com>:

Re: [Spacewalk-list] Spacewalk - PostgreSQL High I/O

2016-10-10 Thread Matt Moldvan
e IO during read operations because it will have to swap the data > out to the temp files, note setting the number of connections too high > would exacerbate that issue f its the root cause. > By the way I managed up to 400 with spacewalk and never had to disable > the snapshots. >

Re: [Spacewalk-list] Spacewalk - PostgreSQL High I/O

2016-10-10 Thread Matt Moldvan
I had similar issues and ended up first breaking out the database to it's own VM, then increasing the Postgres debug logs. I saw that there were a large number of operations running against the snapshot tables, with locks and so on being set for a long period of time. In /etc/rhn/rhn.conf, try

Re: [Spacewalk-list] Osad problems

2016-09-01 Thread Matt Moldvan
I have the same issues with 2.5 and latest OSAD packages... the connection still looks like it's established at the client side, but for some reason it has stopped trying to send data. The master no longer sees the connection as open and therefore cannot send anything to it. The only resolution

Re: [Spacewalk-list] Osa dispatcher can't connect to JabberD after restarting JabberD

2016-08-23 Thread Matt Moldvan
Check the rhndispatcher table in the Spacewalk database... if there are multiple entries there delete those rows first, they will be recreated. I had a long rant about it earlier this week on the list that gets into a lot of detail and is partly related... On Tue, Aug 23, 2016 at 12:22 PM

Re: [Spacewalk-list] Ongoing jabberd/osad issues.

2016-08-22 Thread Matt Moldvan
did not see any additional logging. > > > Thanks > > > Daryl > > -- > *From:* spacewalk-list-boun...@redhat.com < > spacewalk-list-boun...@redhat.com> on behalf of Matt Moldvan < > m...@moldvan.com> > *Sent:* Friday, August 1

Re: [Spacewalk-list] Ongoing jabberd/osad issues.

2016-08-19 Thread Matt Moldvan
To answer your question about how you can tell if clients are registering (to OSA dispatcher, not jabber), set osa_dispatcher.debug = 4 (goes up to 9 but that is -too much- info in my experience) in /etc/rhn/rhn.conf and restart osa-dispatcher. This will tell you if systems are subscribing to the

Re: [Spacewalk-list] Jabber failed to start after spacewalk-service restart

2016-08-19 Thread Matt Moldvan
I replied to another thread here about Jabber and OSA dispatcher and my trials and tribulations... in the end I settled on an ugly hack that uses anything but the Berkley DB because of all the documented issues with it. Try SQLite or Postgres for the back end database for C2S and SM jabber

Re: [Spacewalk-list] OSAD not picking up updates

2016-05-13 Thread Matt Moldvan
ou use spacewalk proxies connected to the > spacewalk server or you'll run into osad problems with clients connected to > the proxy. > > Am 13. Mai 2016 19:00:32 MESZ, schrieb Paul Robert Marino < > prmari...@gmail.com>: > > I have had success with a weekly cron

Re: [Spacewalk-list] OSAD not picking up updates

2016-05-13 Thread Matt Moldvan
I'm with Maxime... I spent months trying to get OSAD to work properly, and we recently had a major issue with some network equipment that lead to many OSAD clients going offline. Personally I'm just about done with it and ready to implement a cron job to do rhn_check every 5 minutes... On Fri,

Re: [Spacewalk-list] Fwd: how to keep spacewalk with errata update.

2016-05-13 Thread Matt Moldvan
I switched to ya-errata-import a few months ago due to having both RHEL and CentOS channels, and the CEFS script was not creating errata in both because of some implementation details... ya-errata-import works well, also (though I haven't gone back to separate RHEL/CentOS channels), and has hooks

Re: [Spacewalk-list] Spacewalk Client OSAD status offline

2016-05-12 Thread Matt Moldvan
You might also want to set "debug = 9" in /etc/sysconfig/rhn/osad.conf on the client, then restart OSAD to get some additional information on what the client is doing, in the logs that Konstantin mentioned (not sure the updatedb and find commands are necessary)... from there it gets relatively

Re: [Spacewalk-list] Unsigned Packages

2016-05-11 Thread Matt Moldvan
There are a set of GPG keys for the RPMs from the Spacewalk YUM repo, here: http://spacewalk.redhat.com/yum/ Did you import those into your client systems? On a somewhat related topic, it's been an issue of mine (and I believe one for the project in general) that Spacewalk (or maybe the

Re: [Spacewalk-list] OSA Dispatcher error

2016-04-26 Thread Matt Moldvan
Your SSL cert on the jabber server is most likely set to something other than what OSAD is attempting to connect to. What do you see when you try "openssl s_client -connect -starttls xmpp spacewalk1-eqix"? The subject name of the cert has to match the configuration option exactly with what you

Re: [Spacewalk-list] Spacewalk client updates

2016-04-26 Thread Matt Moldvan
Check that taskomatic is running and if you have entries in the spacewalk database table rhntaskqueue, the clients will not show updates until the update_server_errata_cache tasks complete. When waiting for tasks to complete, I like to use watch to see the numbers decrease, or you can query them

Re: [Spacewalk-list] registering the kids

2016-04-22 Thread Matt Moldvan
In the activation keys area, there is a tab titled "Child Channels" where you can specify which child channels to join along with the base channel. Have you tried that? On 2016-04-22 11:35, Elizabeth Jones wrote: > I have my spacewalk channels configured so that I have a main channel with >

Re: [Spacewalk-list] Action Chains?

2016-04-15 Thread Matt Moldvan
update process and the way you want to organize each cycle, and then go > ahead with the code. > > We have choosen the perl API because of your skills here being way higher > in this language, but python works even better, i’ve been told. > > > > Good luck. > > Maxime &

Re: [Spacewalk-list] Action Chains?

2016-04-14 Thread Matt Moldvan
’t use them (yet) but the description of this page > states “Below is a list of all Action Chains available to the current user. > Click on a label to view or edit it.” Seems legit. > > > > *From:* spacewalk-list-boun...@redhat.com [mailto: > spacewalk-list-boun...@redhat.

Re: [Spacewalk-list] Action Chains?

2016-04-12 Thread Matt Moldvan
I don't think so, unfortunately. If I'm wrong I'd love to hear otherwise... would be nice if they could be saved, shared among other users, etc. But seems like they are one time use and they fly away... On Tue, Apr 12, 2016 at 9:20 PM Lachlan Musicman wrote: > I just set up

Re: [Spacewalk-list] RHEL 5 Client Registration fails.

2016-04-01 Thread Matt Moldvan
What do you see if you run rhn-profile-sync manually on the client? Might be interesting to run that with "strace -f" to see exactly what it's attempting to gather and send to Spacewalk. On Thu, Mar 31, 2016 at 8:59 PM Eric B wrote: > All, hope somebody may have some

Re: [Spacewalk-list] Cannot retrieve repository metadata (repomd.xml) for repository: epel_sci_6. Please verify its path and try again

2016-03-31 Thread Matt Moldvan
-serverUrl=https://spacewalk/XMLRPC > --sslCACert=/usr/share/rhn/RHN-ORG-TRUSTED-SSL-CERT --activationkey=linux > > On Thu, Mar 31, 2016 at 11:53 AM, Matt Moldvan <m...@moldvan.com> wrote: > >> Oh, that error you're seeing is because your system(s) don't recognize &

Re: [Spacewalk-list] Cannot retrieve repository metadata (repomd.xml) for repository: epel_sci_6. Please verify its path and try again

2016-03-30 Thread Matt Moldvan
I had a similar issue for systems that had old versions of nss, they couldn't deal with an HTTPS repo for some reason. Is your /etc/sysconfig/rhn/up2date pointing to https://something by chance? If so try changing it to http, updating yum and nss fully, then changing it back to https. One

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-29 Thread Matt Moldvan
nra...@gmail.com> wrote: > Wow, checked your profile, works the same speed as mine. > > I think the main problem we have a lot of Errata pending ~1000 per host. > That's the main problem. > > Thank you! > > On Tue, Mar 29, 2016 at 11:34 AM, Matt Moldvan <m...@moldvan.com

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-29 Thread Matt Moldvan
= 100 > > Full load of 250 nodes about 20second. Was 150. > What's you load time if you can share? > Thanks! > > On Tue, Mar 29, 2016 at 10:44 AM, Matt Moldvan <m...@moldvan.com> wrote: > >> Sounds like since you're giving Tomcat more resources it's able to do >&

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-29 Thread Matt Moldvan
he memory anymore, but postgres eat > 100%. > Loading of the page with this settings is 100second. > With default 70 > > On Mon, Mar 28, 2016 at 8:53 PM, Matt Moldvan <m...@moldvan.com> wrote: > >> At those values I'm not surprised you see some slowness... try Xmx/Xms of

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-28 Thread Matt Moldvan
-Dorg.xml.sax.driver=org.apache.xerces.parsers.SAXParser > -Dorg.apache.tomcat.util.http.Parameters.MAX_COUNT=1024 -XX:MaxNewSize=256 > Tried to increase Xms & Xmx, but didn't find any advantages > > On Fri, Mar 25, 2016 at 8:09 PM, Matt Moldvan <m...@moldvan.com> wrote: > >> You mentioned you

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-25 Thread Matt Moldvan
orking (Systems menu), even > if i list 25 hosts or search for a specific one. The top doesn't show any > processes locking the system. > Thanks! > > On Fri, Mar 25, 2016 at 10:41 AM, Matt Moldvan <m...@moldvan.com> wrote: > >> Yes I think the way the depe

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-25 Thread Matt Moldvan
Raskoshnyi <konra...@gmail.com> wrote: > Yep. I double checked the version, and it's 2.3. > Is it necessary to update the whole packages with yum? > It's the main deployment server. Don't want to get any troubles :). > Thanks! > > > On Friday, March 25, 2016, Matt Moldv

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-25 Thread Matt Moldvan
nyi <konra...@gmail.com> wrote: > Hi Matt! > > I tried to tune tomcat, but looks like here's my problem > https://bugzilla.redhat.com/show_bug.cgi?id=1214437 > > Going to upgrade to version 2.4.. > > Thanks! > > On Thu, Mar 24, 2016 at 8:06 PM, Matt Moldvan <m

Re: [Spacewalk-list] Spacewalk slow opens full list of nodes (Systems) 250nodes

2016-03-24 Thread Matt Moldvan
What are your tomcat settings like? We have maxThreads set to 2048 for the 8009 and 8080 connectors in /etc/tomcat6/server.xml: Also, /etc/tomcat6/tomcat6.conf has some settings for JAVA_OPTS that are interesting for tuning purposes: JAVA_OPTS="-XX:NewRatio=4 -XX:PermSize=1024m

Re: [Spacewalk-list] Cannot get Spacewalk to start after upgrade from 2.3 to Spacewalk 2.4

2016-03-14 Thread Matt Moldvan
What output do you get from running spacewalk-sql -i from that server as root? You can also check your database connection with a psql command. On Sat, Mar 12, 2016 at 3:28 AM Robert Paschedag wrote: > Did you update the database schema after the upgrade to 2.4? > >

Re: [Spacewalk-list] Saving the "Sync only latest packages" option in channel sync page

2016-03-11 Thread Matt Moldvan
ot; or > "Schedule". So while you want to reschedule sync, you must check these > options again. > > Regards, > Jiri > > > Dne 8.3.2016 v 05:06 Matt Moldvan napsal(a): > > Hello all, > > I'm trying to modify an existing channel and enable the "Sync only

Re: [Spacewalk-list] Spacewalk Failover?

2016-03-08 Thread Matt Moldvan
I think to get this working you'll have to implement a way for both instances to use the same data source (Postgres is what we use). To do this you'll have to use an external database, and for true redundancy, have something like pgpool or pgbouncer in front of a set of Postgres servers. Oracle

[Spacewalk-list] Saving the "Sync only latest packages" option in channel sync page

2016-03-07 Thread Matt Moldvan
Hello all, I'm trying to modify an existing channel and enable the "Sync only latest packages" option, however I can't seem to find the right combination of clicks to save the option after clicking it. I've tried clicking "Sync Now", Schedule, and even switching to the Add/Remove subtab under

[Spacewalk-list] 500 Internal Server Error - Delete kickstart distribution (was: Group Admin Page)

2011-08-24 Thread Matt Moldvan
Hi everyone, On a somewhat related note to the 500 errors discussed earlier, I'm also receiving a 500 Internal Server error when attempting to delete a kickstart distribution. Here is a background on what I've done: - Setup a kickstart distribution - Attempting to delete my only remaining

Re: [Spacewalk-list] Filtering webui access

2011-08-24 Thread Matt Moldvan
If all else fails a simple IPTables rule could do this also, or even complement the Allow From rules. Regards, Matt. From: spacewalk-list-boun...@redhat.com [spacewalk-list-boun...@redhat.com] on behalf of Michael Mraka [michael.mr...@redhat.com] Sent:

[Spacewalk-list] FW: Updating software channel to new minor version

2011-08-18 Thread Matt Moldvan
In response to Sascha: Our spacewalk server is now working quite well. Before rollout I tested the update of our Scientific Linux 6 channel from 6.0 to 6.1 (6.1 is called 6rolling, because it is not release yet). New kickstarted clients work well, 6.0 clients can update, but after the update to