Problem with 72_scores.cf generation

n. The garescorer.c is identical in the backups and in SVN so that's not it. Again, I wish I had a 'scores' file to compare to from mid March. -- Dave Jones

Re: 72_scores.cf incomplete

I am going to spend a few more hours on this tomorrow morning on the new sa-vm1.apache.org box. I have some new ideas on how to look into this 72_scores.cf issue. Dave On 08/18/2017 07:02 AM, Kevin A. McGrail wrote: FYI, zones2 is not going to be able to be onlined again most likely due to

Re: ruleqa.spamassassin.org

Nevermind. I figured it out. I needed to have some data files for the script to read. It's working now showing the last backup we had on Jan 26th. Now I am working on getting the backend scripts to run... Dave On 05/14/2017 10:42 AM, Dave Jones wrote: Kevin, http

ruleqa.spamassassin.org

Kevin, http://ruleqa.spamassassin.org/ Software error: Can't use an undefined value as an ARRAY reference at /usr/local/spamassassin/svn/trunk/masses/rule-qa/automc/ruleqa.cgi line 725. I am stuck on a perl issue. I tried to get the config file in the same dir setup properly to make sure

Re: SysAdmin Tasklist was Re: Next priority to get running on sa-vm1.apache.org

On 05/14/2017 08:31 AM, Kevin A. McGrail wrote: On 5/14/2017 7:38 AM, Dave Jones wrote: Thank goodness! I took a look at that README and my head started to explode. I am not a perl developer so that was going to be very time consuming to get up to speed on that. I will let you have

Re: Onboarding, Documentation, etc.

/spamassassin/AdminGroup - Members of SA SysAdmins (SASA): Dave Jones - da...@apache.org Kevin A. McGrail - 703-798-0171 - kmcgr...@apache.org Bryan Vest - bv...@apache.org - Who's in Charge? The PMC. There is no leadership hierarchy in the SpamAssassin SysAdmins. NOTE: As with any ASF role, if you

Re: Intorduction

For my introduction, I have been computing since college in '88. Started out as a Master CNE in Novell Netware and really looked forward to Unixware taking over the world but that flopped. I switched to a Microsoft MCSE for a few years until going full time as an AIX/UNIX/Linux admin in 2003.

Re: SVN update area

in smaller directories? I guess it depends on if we have general users like automc or bbmass that can commit to SVN in cron'd scripts. Dave On 05/10/2017 08:32 PM, Kevin A. McGrail wrote: On 5/10/2017 8:49 PM, Dave Jones wrote: Kevin, I was wanting to setup /usr/local/spamassassin/svn as a check

ApacheCon 2017

Kevin, Good luck this week in Miami. I think you were trying to get SA 4.0 built, released, and announced so I hope all goes well. -- Dave

Re: SysAdmin Tasklist was Re: Next priority to get running on sa-vm1.apache.org

On 05/14/2017 09:25 AM, Kevin A. McGrail wrote: On 5/14/2017 10:11 AM, Dave Jones wrote: Do we want to subscribe root like this? It doesn't need to receive any of these emails that will just fill up the root mailbox or possibly create a mail loop. I was thinking about allowing

Re: My stumbles on-boarding

at 10:19 AM, Bryan Vest <murli...@gmail.com> wrote: Time zone is Ohio EDT. I sent an email to infra asking for access since I was still getting the LDAP error last night. I have an account setup everywhere I think I need to have them setup. --Bryan Vest On Mon, May 15, 2017 at 10:05 AM

DNS hosting of spamassassin.org

Kevin, Please go ahead and open a jira ticket to get the registrar updated to remove ns.hyperreal.org and replace it with ns2.pccc.com. If I am allowed to do this I will but I wasn't sure if this needed to come from you. ns.hyperreal.org is getting very far behind and will be handing out

SVN update area

Kevin, I was wanting to setup /usr/local/spamassassin/svn as a check out area and a general update area. Do you normally set it up with your own creds or is there a generic user that was used on the previous server for cron jobs to do commits? -- Dave

Re: Next priority to get running on sa-vm1.apache.org

on sa-vm1.apache.org by using OPIE. Here is the OPIE client I am using: https://reference.apache.org/committer/otp-md5 Dave On 05/08/2017 10:15 AM, Kevin A. McGrail wrote: On 5/7/2017 3:43 PM, Dave Jones wrote: Do you know what the long-term plan is for the /x1 mount? Was it setup as a

Re: PowerDNS web interface

and they would know how to help her get access of all of my online accounts. We need something like this for this team. *Reminder: *Bryan, you need to get your public key on http://people.apache.org/~bvest/ Regards, KAM On 5/15/2017 4:01 PM, Dave Jones wrote: I setup nesedit and wanted

Re: Onboarding, Documentation, etc.

On 05/13/2017 08:13 AM, Kevin A. McGrail wrote: On 5/12/2017 7:32 PM, Dave Jones wrote: I have all of this information on https://wiki.apache.org/spamassassin/InfraNotes2017 now. Please review and comment/update as needed. Overall, the organization and edits are very good. Thanks

Re: Rsync config on sa-vm1.apache.org

, Kevin A. McGrail wrote: On 5/13/2017 3:16 PM, Dave Jones wrote: Are you going to pop on the box and scp your tar over? Another option is to use https://filedrop.ena.com and send it to me (djo...@ena.com) that way. The /var/www/bbmass.spamassassin.org dir is going to have most of the files

Re: Rsync config on sa-vm1.apache.org

On 05/13/2017 01:21 PM, Dave Jones wrote: On 05/13/2017 01:15 PM, Dave Jones wrote: Kevin, I am nearly complete setting up the rsyncd again. I have firewalled off port 873 to a single test IP of my masscheck server at ENA. My automasscheck-minimal.sh is working properly now and able

Re: Rsync config on sa-vm1.apache.org

could rsync the delta from your mirror. Dave On 05/13/2017 02:11 PM, Kevin A. McGrail wrote: Don't turn it on yet. I run a mirror and will tar it up. Regards, KAM On May 13, 2017 3:00:54 PM EDT, Dave Jones <da...@apache.org> wrote: On 05/13/2017 01:21 PM, Dave Jones

Re: Rsync config on sa-vm1.apache.org

to the list. Dave On 05/13/2017 03:06 PM, Kevin A. McGrail wrote: Sure. We have a tar file if we need to resync. Regards, KAM On May 13, 2017 4:02:26 PM EDT, Dave Jones <da...@apache.org> wrote: I have it working now and was able to rsync to my server that is allowed through the fi

Re: Rsync config on sa-vm1.apache.org

On 05/13/2017 01:15 PM, Dave Jones wrote: Kevin, I am nearly complete setting up the rsyncd again. I have firewalled off port 873 to a single test IP of my masscheck server at ENA. My automasscheck-minimal.sh is working properly now and able to upload result logs like normal. My

sa-update mirror addition

Have setup sa-update.ena.com and they are ready to be checked and added to the MIRRORED.BY file. -- Dave

Re: bugzilla canconfirm Can confirm a bug.

A. McGrail wrote: Never really thought about it much. Most of the project committees just ask and get everything. If you want less than everything I can send you a list and you can tell me which you want. Regards, KAM On June 12, 2017 2:28:16 PM EDT, Dave Jones <da...@apache.org> wrote:

Re: bugzilla canconfirm Can confirm a bug.

Really? I would think that anyone would be allowed to "take" a bug without needing "keys to the castle." Dave On 06/12/2017 07:54 AM, Bryan Vest wrote: I only seem to have the bugzilla permission "canconfirm Can confirm a bug". Should I have different permissions? Just making sure

Re: Fwd: Cron <root@sa-vm1> svn update /var/www/automc.spamassassin.org/updates > /dev/null

On 06/19/2017 08:41 PM, Kevin A. McGrail wrote: I thought this was an interesting one... Forwarded Message Subject: Cron svn update /var/www/automc.spamassassin.org/updates > /dev/null Date: Tue, 20 Jun 2017 01:30:02 + (UTC) From: Cron Daemon

Fixing the 72_scores.cf problem

Kevin, I am seeing other mailing list all complain about SA allowing more spam lately. I really want to get this triaged tomorrow morning when I finally get time to work on this. What do you recommend? I was thinking of taking an old 72_scores.cf from March and manually creating the 3

Re: sa-update mirror addition

! Regards, KAM On May 15, 2017 9:09:18 PM EDT, Dave Jones <da...@apache.org> wrote: Not sure how to do this. I am not able to SFTP into minotaur.apache.org and when I SFTP into people.apache.org I am limited to my home directory. I searched the wiki and didn't find any details so I gue

Re: sa-update mirror addition

servers. Dave On 05/24/2017 07:42 PM, Dave Jones wrote: Got it. I will setup the /updates directory to be managed by SVN with exclusions for all of the extra files. The link I was missing that I understand now is the spamassassin.apache.org/updates is managed from SVN. Makes complete sense now

Re: sa-update mirror addition

It seems to be nearly instant on the update so there has to be some direct hook to SVN. Nice. On 05/24/2017 08:15 PM, Kevin A. McGrail wrote: Yes the website uses something called svnpubsub and it rebuilds from an svn commit. Regards, KAM On May 24, 2017 9:11:25 PM EDT, Dave Jones <

Questions about build/mkupdates/run_part2

. -- Dave Jones

SA updates files archive

rules more than once a day. -- Dave Jones

Re: sa-update mirror addition

wrote: I think there is a leap missing, sorry. Ok, so mirrored.by is in svn in site/. The copy for rsync should perhaps be a checkout with the extra files on top. Then an svn up keeps things in sync. Mirrored.by should be cleared.up how to update. On 5/22/2017 8:15 PM, Dave Jones wrote: I

What a mess!

the dust settles a little on all of this setup, I definitely want to go back and simply/standardize all of these script to be more modular to untangle all of this mess. -- Dave Jones

Re: Potential problem with do-stable-update-with-scores cron job

is the corpora it is run against maintained. Is there parts of rule qa that aren't working other than these quick checks? Regards, KAM On May 30, 2017 7:50:40 PM EDT, Dave Jones <da...@apache.org> wrote: In looking into what updates the RuleQAApp web interface for

Re: SA updates files archive

are official project release artifacts so yes, we need to keep them. And the update mirrors have served as our backups of those files. I'd prefer it stay as is. Regards, KAM On 5/28/2017 10:59 AM, Dave Jones wrote: Kevin, Do we need to keep rule update files back to 2007? It seems like

Re: SA updates files archive

, Dave Jones wrote: Kevin, Do we need to keep rule update files back to 2007? It seems like having only the past year or even few months is all that we need. Technically, the only ones that need to be in the updates directory are ones that are pointed to by the [reverse version

Re: Potential problem with do-stable-update-with-scores cron job

e out what was running that. Dave On May 30, 2017 8:15:16 PM EDT, Dave Jones <da...@apache.org> wrote: If you look on the sa-vm1 box in /etc/cron.d/automc you will see all of the cron jobs that I found from the /home/kmcgrail/SAcron mbox. I updated the bottom of the InfraNote2017 wiki page with

Re: Cron <root@sa-vm1> cd / && run-parts --report /etc/cron.hourly

This is a script I am testing out just for notifications to my email address. I will set it up to be silent now like it should have been. :) The goal of this script is to let me know when the ruleqa submissions are not lining up with the current tagged SVN version of rules to be masscheck'd.

Re: Cron <root@sa-vm1> cd / && run-parts --report /etc/cron.hourly

PM EDT, Dave Jones <da...@apache.org> wrote: This is a script I am testing out just for notifications to my email address. I will set it up to be silent now like it should have been. :) The goal of this script is to let me know when the ruleqa submissions are not lin

Re: Cron <automc@sa-vm1> ~/svn/trunk/build/mkupdates/do-stable-update-with-scores

I am rerunning this. I made a change to rm the old temporary work dir which should solve the problem. If it does, then I will commit the change to SVN. Dave On 06/06/2017 09:40 PM, Cron Daemon wrote: [ running make freqs ]

Mirror bandwidth

Now that we have rule updates going, I am seeing about 22 GB of traffic a day combined on both of my sa-update.ena.com mirrors. This is from about 20,000 unique IP visits a day. Currently we have 2 ruleset publishes cron'd each day where the DNS TXT record is getting updated. One from the

Re: Backups & Crashplan

On 05/30/2017 05:44 PM, Kevin A. McGrail wrote: We should add /etc and /var/www and exclude /usr/local/spamassassin/backups since it's so large. Added/excluded as suggested. Thanks very much for the feedback Do we need to setup crashplan to run under supervisord and have monit email the

Re: Tracking tasks/work for sysadmins

ote: On 6/8/2017 12:05 PM, Dave Jones wrote: Kevin, Do we have access to something like Jira or BZ where we can put in our tasks for this team and track them? I think it will be essential to plan out future goals and track issues/tasks for our group. Yes, that is a GREAT idea. We have ht

Re: Tracking tasks/work for sysadmins

First item. The sysadmins area (component) is setup on BZ. There is a component called "Website/Infrastructure" that has 4 bugs in it that we need to address. There was a 5th one about our old zones2 hosting needing to be decommissioned but I closed that one since that is behind us now. :)

Re: Mirrors

On 06/08/2017 12:36 PM, Kevin A. McGrail wrote: On 6/8/2017 1:19 PM, Bryan Vest wrote: As I read through the email's there was some talk about mirrors. Does SA need more mirrors at this time? We run on a 10Gb/s backbone, well multiple backbone providers that add up to about 10Gb/s. Depending

Tracking tasks/work for sysadmins

Kevin, Do we have access to something like Jira or BZ where we can put in our tasks for this team and track them? I think it will be essential to plan out future goals and track issues/tasks for our group. -- Dave Jones

Re: Cron <root@sa-vm1> svn update /var/www/automc.spamassassin.org/updates > /dev/null

On 06/06/2017 09:45 AM, Cron Daemon wrote: svn: E170013: Unable to connect to a repository at URL 'http://svn.apache.org/repos/asf/spamassassin/site/updates' svn: E175013: Access to '/repos/asf/spamassassin/site/updates' forbidden Must have been some hiccup on the SVN server since this runs

Re: Fwd: [jira] [Updated] (INFRA-14294) Increase RAM and VMs for SA-VM1

Normally a KVM guest would need to be shutdown completely "cold" to get the new resources to become active. A "warm" reboot from the server itself would not do it. I just rebooted it and confirmed we are still at the old allocations. It looks like we will need someone from INFRA to take it

Re: checkDNShosting.sh on sa-vm1.apache.org - 104 DNS hosting issues found

Looks like b.auth-ns.sonic.net. 184.173.92.18 is down at the moment. Dave On 06/09/2017 09:17 AM, root wrote: spamassassin.org: = Registry Expiry Date: 2017-12-17T02:01:49Z a.auth-ns.sonic.net: -

Re: Cron <automc@sa-vm1> ~/svn/trunk/build/mkupdates/do-stable-update-with-scores > /dev/null

That's an optional module caused by the "make" process. I did have to install a few perl modules to get the make to work but I didn't worry about the optional modules. Dave On 06/13/2017 09:29 AM, Bryan Vest wrote: I noticed this in the output above "Warning: prerequisite Digest::SHA1 0 not

Re: Adding RBLs to default SA rules

entries in it, we dont rsync from anyone it is maintained by perl scripts that have been doing the job pretty well for around 7 years now. Our spamhaus feed is included in our contract with the mail system vendor. --Bryan On Thu, Jun 15, 2017 at 9:19 AM, Dave Jones <da...@apache.org> wrote:

Re: checkMasscheckContribs.sh on sa-vm1.apache.org - not enough contributors for SVN 1798299

ck any old logs for the delay? Regards, KAM On June 10, 2017 8:19:50 AM EDT, Dave Jones <da...@apache.org> wrote: I need to update this to wait longer on Saturdays since the net checks are running today. I will add this logic now to the script. Dave On 06/10/2017 07:1

Re: checkMasscheckContribs.sh on sa-vm1.apache.org - not enough contributors for SVN 1798299

I need to update this to wait longer on Saturdays since the net checks are running today. I will add this logic now to the script. Dave On 06/10/2017 07:17 AM, root wrote: Corpus total: 128, Old: 80, Recent: 16, New: 6 SVN tagged rev in weekly_mass_check: 1798299 New masscheck submission

DNS history in SVN

the commits list. If you feel like this script should run daily, I can change the /etc/cron.d/svn to '@daily' instead of '@weekly'. I thought weekly would be enough to start since it's really only the sa-update TXT records that are changing daily so far. -- Dave Jones

Re: Main Developer

On 06/14/2017 08:33 AM, Kevin A. McGrail wrote: On 6/14/2017 8:04 AM, Dave Jones wrote: That seems correct from what I have seen. Speaking of development. rspamd is starting to really take off: https://rspamd.com/ I hope we can keep SA out there as the leader that everyone compares

Re: Main Developer

On 06/14/2017 08:53 AM, Kevin A. McGrail wrote: Some comments in-line below: On 6/14/2017 9:47 AM, Dave Jones wrote: There are soo many bugs already open. I looked around BZ some last week and it seems like there is no real recent movement on anything. I would like to create a BZ to get

Fwd: Re: Errors since upgrading to 3.4.1: "meta test ... with a zero score"

Ugg! I asked for some help QA'ing the rules for over a week but got zero response then. I wonder if what was in SVN wasn't what was really running on the old masscheck box. I used what was in SVN. I guess I will dig through the old VM backup to see if I can find the difference related to

Re: Fwd: Re: [Bug 7432] Update cron jobs on sa-vm1 to run at UTC and ignore daylight savings change

amassassin.apache.org https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7432 Dave Jones<da...@apache.org> changed: What|Removed |Added CC|

Re: Fwd: Re: [Bug 7432] Update cron jobs on sa-vm1 to run at UTC and ignore daylight savings change

-vm1 to run at UTC and ignore daylight savings change Date: Tue, 13 Jun 2017 13:31:02 -0500 From: Dave Jones <da...@apache.org> To: sysadmins@spamassassin.apache.org Thanks, In a few hours, I will change the TZ and update the /etc/cron.d/automc with the real hours in UTC. This will be much

Re: Main Developer

That seems correct from what I have seen. Speaking of development. rspamd is starting to really take off: https://rspamd.com/ I hope we can keep SA out there as the leader that everyone compares themselves to: https://rspamd.com/comparison.html There are some meaningless red X's under SA

Re: Fwd: Re: Copy of the current SA Zone?

On 5/2/17 7:34 AM, Kevin A. McGrail wrote: +cc: sysadmins On 5/1/2017 10:30 PM, David Jones wrote: Yes. I did. Boy was that painful! The format of the hyperreal.org zone file was not standard so I had to manually verify all of the records. There were a few differences (see below) that

Re: Fwd: Re: Ready for the Hidden Master to be Polled

On 05/02/2017 03:00 PM, Kevin A. McGrail wrote: On 5/2/2017 3:27 PM, Dave Jones wrote: I had .92 in the PowerDNS allowed-axfr list so it must be coming from .90. I have added .90 to the list so please try it again when you get a chance. Will do! P.S. You can easily check the outbound

Re: Fwd: Re: Ready for the Hidden Master to be Polled

On 05/05/2017 07:38 AM, Dave Jones wrote: On 05/04/2017 11:20 PM, Kevin A. McGrail wrote: On 5/3/2017 7:19 AM, Dave Jones wrote: Thought: Open up transfer from 69.171.29.37 and I'll test if I can pull the zone. Is there anything you can see wrong with that record? It's looking like

Re: Fwd: Re: Copy of the current SA Zone?

On 5/2/17 8:20 AM, Kevin A. McGrail wrote: On 5/2/2017 9:14 AM, Dave Jones wrote: My plan is to setup a script on sa-vm1.apache.org that would run daily and email if there are record differences since we don't have control of the public DNS servers. I seem to remember that they might use

Re: Fwd: Re: Copy of the current SA Zone?

On 5/2/17 8:39 AM, Kevin A. McGrail wrote: On 5/2/2017 9:31 AM, Dave Jones wrote: On 5/2/17 8:20 AM, Kevin A. McGrail wrote: On 5/2/2017 9:14 AM, Dave Jones wrote: My plan is to setup a script on sa-vm1.apache.org that would run daily and email if there are record differences since we don't

Re: Backups & Crashplan was Re: What a mess!

On 05/30/2017 12:07 PM, Kevin A. McGrail wrote: On 5/28/2017 5:29 PM, Dave Jones wrote: I hope this server is being backed up after all of this time spent on getting everything working again. Your question asking about backups was important because no, I don't know what backups exist

Question about sabuildtools/bin

this specific version of perl need to be back on the server and in the PATH for a build? Can the system perl be used or do you want this particular version of perl? If we need it back, then I was going to put it in /usr/local/perl586 if that is OK. -- Dave Jones

Re: Question about sabuildtools/bin

PM EDT, Dave Jones <da...@apache.org> wrote: Kevin, This script was in the old server cron and it adds sabuildtools/bin to the PATH. http://svn.apache.org/repos/asf/spamassassin/trunk/build/mkupdates/do-stable-update-with-scores When I look at an old backup the sabuil

Re: Questions about build/mkupdates/run_part2

wrote: I can only guess that wasn't run. Did the cron file logs i sent over show it running? Regards, KAM On May 21, 2017 5:50:36 PM EDT, Dave Jones <da...@apache.org> wrote: Kevin, The old server had a cron job to run this but the script itself says it needing to

Re: Fwd: [jira] [Updated] (INFRA-14986) sa-vm1.apache.org appears offline.

Something is wrong if that VM is running out of RAM. There must be a memory leak or something. I guess we will have to figure that out somehow. Dave On 08/30/2017 12:49 PM, Kevin A. McGrail wrote: Ran it out of memory it appears and we have no swap to gracefully recover.  Thoughts?  Ask for

Re: Fwd: New CrashPlan Backup Alerts

Yikes. Do the drives spin and get recognized by the controller? Did you try Spinrite on the drives to see if that could bring it back to life just enough to rebuild the RAID and copy the data off? I can loan you my copy of SpinRite if you want to try. Dave On 10/02/2017 12:08 PM, Kevin A.

Re: Fwd: New CrashPlan Backup Alerts

Ok. No problem. Just thought I would comment in case that RAID set had other things of importance that you needed to get back. I have had to do this in the past on servers with critical data. Dave On 10/02/2017 12:29 PM, Kevin A. McGrail wrote: On 10/2/2017 1:12 PM, Dave Jones wrote: Yikes

Re: Eureka: truncation of 72_active.cf

On 11/09/2017 09:45 AM, Merijn van den Kroonenberg wrote: solved /usr/local/spamassassin/automc/svn/trunk/build/mkupdates/do-stable-update-with-scores should be calling /usr/local/spamassassin/automc/svn/masses/rule-update-score-gen/do-nightly-rescore-example.sh Here you actually explain

Re: 72_scores.cf compared to the one from march 15

On 11/15/2017 07:10 AM, Dave Jones wrote: On 11/15/2017 06:40 AM, Kevin A. McGrail wrote: On 11/15/2017 6:33 AM, Merijn van den Kroonenberg wrote: That, or maybe Kevin can step in for now and do the commit for you? Good to know you are on the road and thanks for still trying to help! Happy

Re: notes about new mirrors as Re: NOTE: Warning to Abusers of Update Servers

On 11/25/2017 04:59 PM, Kevin A. McGrail wrote: On 11/25/2017 8:38 AM, David Jones wrote: I too would like to clean up old unused rulesets but Kevin says this causes some problems.  I would think that if there are no DNS entries pointing to the ruleset, it should no longer be needed and

Re: sa-update ruleset updates enabled again

On 11/20/2017 11:33 PM, Matthias Leisi wrote: In addition to server-side blocking, would it make sense for sa-update to rate-limit itself? — Matthias Von meinem iPhone gesendet Am 21.11.2017 um 03:53 schrieb Kevin A. McGrail <kevin.mcgr...@mcgrail.com>: On 11/20/2017 7:17 PM, Dave

Ruleset updates cleaned out

your backups have been working. -- Dave Jones

Re: Ruleset updates cleaned out

On 11/29/2017 04:15 PM, Kevin A. McGrail wrote: On 11/29/2017 4:33 PM, Dave Jones wrote: Kevin, When you get a few minutes, please look at the sa-vm1.apache.org:/var/www/automc.spamassassin.org/update dir. Something or somebody has removed most of the files that were in there. I set

Re: ruleqa.cgi issue

On 11/11/2017 11:09 AM, Merijn van den Kroonenberg wrote: On 11/11/2017 07:45 AM, Merijn van den Kroonenberg wrote: I saw you applied my patch for ruleqa.cgi and if I read the apache conf correctly, then the webserver serves pages directly from the checkout

Re: Cron <automc@sa-vm1> ~/svn/trunk/build/mkupdates/run_nightly | /usr/bin/tee /var/www/automc.spamassassin.org/mkupdates/mkupdates.txt

On 11/14/2017 06:32 AM, Dave Jones wrote: On 11/14/2017 02:37 AM, Merijn van den Kroonenberg wrote: seeing the cron output (also from mkupdates) it looks like /usr/local/spamassassin/automc/svn/trunk is now readonly? -Original Message- From: Cron Daemon Sent: Tuesday, November 14

Re: Access to rsync.spamassassin.org

On 11/11/2017 05:08 AM, Sidney Markowitz wrote: It's been a while since I had a request from someone to give the an rsync account. When I tried to ssh to rsync.spamassassin.org (after dealing with the hos key changing) using my apache.org ssh key (which still works on minotaur as a check) I get

Re: sa-update issue follow-up

On 11/13/2017 08:21 PM, Kevin A. McGrail wrote: OK, so following up my last email, it appears all old updates were gone too.  I have only 57 update files.  These are release artifacts and need to be put back. Apologies if I said to move them but people are using them it appears.  I think I

Re: sa-update ruleset updates enabled again

On 11/19/2017 02:33 AM, Matthias Leisi wrote: Heads up.  DNS updates for sa-update have been enabled again. The next rules promotion will happen in about 11 hours around 2:30 AM UTC. Traffic on my mirror picked up at around 03:00 UTC (time in chart below is in UTC+01:00), traffic is at

Re: sa-update ruleset updates enabled again

with a centralized .htaccess file that gets distributed with the normal rsync pulls by each mirror. Regards, KAM On 11/20/2017 2:14 PM, Dave Jones wrote: On 11/19/2017 02:33 AM, Matthias Leisi wrote: Heads up.  DNS updates for sa-update have been enabled again. The next rules promotion

Re: sa-update ruleset updates enabled again

n.mcgr...@mcgrail.com>: On 11/20/2017 7:17 PM, Dave Jones wrote: Could we use something like mod_evasive to limit any IP connecting more than 3 times (one batch of ruleset files) an hour? SA instances behind NAT'd IPs could cause a legitimate reason for more than 2x hits per day. I'd lik

Re: 72_scores.cf compared to the one from march 15

On 11/15/2017 05:22 AM, Merijn van den Kroonenberg wrote: I updated the masses/rule-update-score-gen/lock-scores file from rulesrc/sandbox/dos/new-rule-score-gen/lock-scores on the sa-vm1.apache.org server so fingers crossed on the 72_scores.cf here in about 5 hours. This script is always

Re: comparing 72_scores.cf files

Nice script.  Very useful.  Now it would be good to extend it to check the rules still exist.  For example, I wrote a quick bash on-liner to find the rules no longer exist in the main SA rules so we shouldn't expect these 6 to be in the new 72_scores.cf: AXB_XMAILER_MIMEOLE_OL_1ECD5

Re: 72_scores.cf compared to the one from march 15

On 11/15/2017 06:40 AM, Kevin A. McGrail wrote: On 11/15/2017 6:33 AM, Merijn van den Kroonenberg wrote: That, or maybe Kevin can step in for now and do the commit for you? Good to know you are on the road and thanks for still trying to help! Happy to try and help! Regards, KAM On the

Re: ruleqa user llanga

On 11/10/2017 09:01 AM, Merijn van den Kroonenberg wrote: Day 2 doesn't have that table with "mcviewing". The next question is what is causing this problem. Is it related to new commits that throw off the masscheck processing? The 2 days ago doesn't highlight a current masscheckbut

Good 72_scores.cf

Woo hoo!  Looks like we have a full 72_scores after the fix to MILLION_USD.  Thanks Merijn! Forwarded Message Subject: svn commit: r1814132 - in /spamassassin/trunk/rulesrc/scores: 72_scores.cf scores-set0 scores-set1 scores-set2 scores-set3 stats-set0 stats-set1 Date:

Re: Good 72_scores.cf

On 11/03/2017 07:33 AM, Merijn van den Kroonenberg wrote: On 11/3/2017 8:21 AM, Merijn van den Kroonenberg wrote: we only have the 'random removal' issue left. But I am confident the merge-scoresets fix will take care of that. I don't know the random removal issue you are referring to. Can you

Eureka: truncation of 72_active.cf

Merijn, I patched the generate-new-scores.sh locally on sa-vm1 using your patch file with a slight adjustment. I changed the copied file name to "72_active_before_grep.cf" just to make it a little more obvious. We will see how it looks tomorrow in the tmp working area on sa-vm1 and I will

Re: mailspike in 72_scores

On 11/05/2017 10:26 AM, Merijn van den Kroonenberg wrote: Note to self: investigate why in do-nightly-rescore-example.sh is called like this: merge-scoresets $SCORESET With a $SCORESET param. It will cause all rules which are not in that scores-set$SCORESET file to be ignored and not written to

Re: Fwd: Cron <root@sa-vm1> svn update /var/www/automc.spamassassin.org/updates > /dev/null

On 11/06/2017 05:53 AM, Kevin A. McGrail wrote: Neat Regards, KAM That seemed to be a temporary problem with DNS or SVN. I was able to run the same command just now without a problem. Dave Original Message From: r...@sa-vm1.apache.org Sent: November 6, 2017

Re: Eureka: truncation of 72_active.cf

Well crap. I found another odd dependency that throws off the masscheck processing thrown off when commits are done outside the few hour window: https://wiki.apache.org/spamassassin/InfraNotes2017#nitemc automc@sa-vm1:~$ ~/svn/trunk/build/mkupdates/run_nightly + promote_active_rules + pwd

Re: Eureka: truncation of 72_active.cf

On 11/07/2017 01:07 PM, Merijn van den Kroonenberg wrote: On 11/07/2017 10:24 AM, Merijn van den Kroonenberg wrote: Merijn, I patched the generate-new-scores.sh locally on sa-vm1 using your patch file with a slight adjustment. I changed the copied file name to "72_active_before_grep.cf" just

Re: Eureka: truncation of 72_active.cf

On 11/07/2017 01:07 PM, Merijn van den Kroonenberg wrote: On 11/07/2017 10:24 AM, Merijn van den Kroonenberg wrote: Merijn, I patched the generate-new-scores.sh locally on sa-vm1 using your patch file with a slight adjustment. I changed the copied file name to "72_active_before_grep.cf" just

Re: Cron <automc@sa-vm1> ~/svn/trunk/build/mkupdates/run_nightly | /usr/bin/tee /var/www/automc.spamassassin.org/mkupdates/mkupdates.txt

I need some help understanding this problem now. The "promotions validated" have failed for 3 weeks now so the active.list is not updating. There seems to be some relationship to the masscheck ruleqa web output that is stuck on "day 2" failing. See the output at the very bottom. Can

Re: Eureka: truncation of 72_active.cf

On 11/09/2017 07:27 AM, Merijn van den Kroonenberg wrote: Well... My local patch is still in place. This is lines 195-206 of the current trunk/masses/rule-update-score-gen/generate-new-scores.sh: What is the full path? The question is in which working copy did you apply this change (what

Re: Mailserver at 52.169.9.191

On 11/08/2017 08:45 AM, Kevin A. McGrail wrote: I’m very much in favor of aggregating and analyzing data, that’s bascially what we do at dnswl.org  :) Having said that, I usually don’t see that much load on our sa-update mirror, just a bit of bandwidth being used.

  1   2   >