On Mon, 16 Aug 2004, James wrote:
I've made it this far by what I can find on the mailing-lists, but have bumped into my good friend, the 2GB limit on a 64bit Compaq6400r running SuSE9.1. Doesn't seem to wanna leave me alone. Moved up from a 32 bit to ditch him, but 3.1.6 still finds that guy when running htdig. I really thought he'd get the message when I dumped Redhat for SuSE.
As far as I know, there is no simple way to work around the file size limitations with 3.1.6, regardless of which flavor of Linux you run or what hardware you run it on. The underlying database support just isn't there with the version of BDB used with 3.1.6.
I found on the lists that Berthold Cogel says ' Perhaps using -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 during build solves our problem? ' He got a 5.5 gig file after he did this trick. I'm glad that he was able to solve his problem, but I have no idea what to do with this.
This doesn't entirely solve the problem. Adding these options at build time provided a work around for the db.wordlist file, but not for the database files. If you follow that thread a bit farther, I believe you will find that he also reported htmerge crashing at a 4 GB limit.
If your wordlist file is going over the 2 GB limit, but your databases are staying below 4 GB, the largefile support mentioned previously might provide a work around. To test, you would need to manually add in the options for largefile support and then build from source. There are build instructions at http://www.htdig.org/install.html After running configure you could try adding the -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 options to the DEFINES line in Makefile.config. I am not 100% certain, but
I think that would get the options into all of the places that you need
them during the build.
Jim
-------------------------------------------------------
This SF.Net email is sponsored by: YOU BE THE JUDGE. Be one of 170
Project Admins to receive an Apple iPod Mini FREE for your judgement on
who ports your project to Linux PPC the best. Sponsored by IBM. Deadline: Sept. 13. Go here: http://sf.net/ppc_contest.php
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
