Re: Problem with makemap and hash tables
On Feb 4, 2008, at 18:08, Doug Hardie wrote: I am just under 300K lines in that map at present. While I have always wondered where hash was going to break, I hadn't found the limit yet. However, the time to build the hash table is extremely large with that many entries. I ran some tests a couple months ago using btree for the map type (subject was 'Map size'). I didn't test over 300K entries, but it sure built the maps a whole lot faster. You might try that and see if it builds or not. I just ran some tests using the BTREE method. I was able to build a database with 1,000,000 entries. It builds successfully and I can read all the entries in it. I believe that BTREE must also have a limit, but haven't found it yet. I doubt I will need to past a million records though so its now academic. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Problem with makemap and hash tables
On Tuesday 05 February 2008 02:27:50 Olivier Nicole wrote: > Hi, > > I am having problem with /usr/sbin/makemap hash on huge databases > under FreeBSD 5.5 and 6.3 while it is working on 4.11. > > By huge I mean around 380,000 lines in the /etc/mail/access file. > > After approximately 375,000 lines added into access.db I get: > > makemap: access.db: line 375135: key abcd.efgh: put error: Operation > not permitted Operation not permitted hints at a limit being hit, looking at when write(2) can fail, I'd guess: [EDQUOT] The user's quota of disk blocks on the file system containing the file has been exhausted. [EFBIG]An attempt was made to write a file that exceeds the process's file size limit or the maximum file size. But then again this can be a translated error by the makemap utility that has a totally different cause. -- Mel ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Problem with makemap and hash tables
I got that error when there was a duplicate entry.
I broke down and am now restricting emails to mailers that have a valid
forward and reverse DNS entries. Most real mailers have properly configured
DNS, but I also added a permission for those that have a DNS entry that
comes back as possibly forged.
the file /etc/mail/ForgedIP are the hosts that I will bypass the new
filter. Added to sendmail.cf:
F{ForgedIP} /etc/mail/ForgedIP
(and in the relay area)
SLocal_check_relay
R$+ $| $={ForgedIP}$* $@ $1 $| $2
R$*$={ForgedNames} $| $*$@ $1 $| $2
R$* $: < $&{client_resolve} >
R $#error $@ 4.7.1 $: "450 Access denied. Cannot resolve
PTR record for " $&{client_addr}
R $#error $@ 4.7.1 $: "550 Access denied. IP name
possibly forged " $&{client_name}
R $#error $@ 4.7.1 $: "550 Access denied. IP name lookup
failed " $&{client_name}
Scheck_relay
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Problem with makemap and hash tables
> I am just under 300K lines in that map at present. While I have > always wondered where hash was going to break, I hadn't found the > limit yet. And what is even more weird is that last night it managed to build the hash, with yet about 385,000 lines in /etc/mail/access... Thanks any way. Best regards, Olivier ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Problem with makemap and hash tables
On Feb 4, 2008, at 17:27, Olivier Nicole wrote: Hi, I am having problem with /usr/sbin/makemap hash on huge databases under FreeBSD 5.5 and 6.3 while it is working on 4.11. By huge I mean around 380,000 lines in the /etc/mail/access file. After approximately 375,000 lines added into access.db I get: makemap: access.db: line 375135: key abcd.efgh: put error: Operation not permitted and no more line will add. I know that having 380,000 REJECT rules in access.db may not be the best choice, but it is easy and it was working si far (still works under 4.11). Did anything changed in makemap since 4.11? Any limit in the size of the DB? It seems that my message yesterday was zapped by SpamAssassin (because I included names of infamous spamers as part of my examplke), so I rewrote it. I am just under 300K lines in that map at present. While I have always wondered where hash was going to break, I hadn't found the limit yet. However, the time to build the hash table is extremely large with that many entries. I ran some tests a couple months ago using btree for the map type (subject was 'Map size'). I didn't test over 300K entries, but it sure built the maps a whole lot faster. You might try that and see if it builds or not. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
