https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6793

             Bug #: 6793
           Summary: PATCH reduce sa-awl memory usage
           Product: Spamassassin
           Version: unspecified
          Platform: PC
        OS/Version: All
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Tools
        AssignedTo: [email protected]
        ReportedBy: [email protected]
    Classification: Unclassified


Created attachment 5050
  --> https://issues.apache.org/SpamAssassin/attachment.cgi?id=5050
patch

Hello,

current version of sa-awl loads full database key list to memory before showing
any
stats or performing maintenance. I believe it's obvious that this behavior is
undesirable and makes large databases impossible to handle.

The patch below improves sa-awl scaling and responsiveness by scanning database
row-by-row basis instead of loading all keys to memory first.

Tested cleaning db with over 8 million rows.

For a cached db with 850K rows memory usage lowers from 1G to 6M, execution
time
is around 12% slower (26 vs. 29 sec), though.

I'm not a perl expert, please review.

Thanks.

-- 
Configure bugmail: 
https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

Reply via email to