This dump is happening using the old compression scheme. Notice that the code starts out in the HtDig code (Retriever/WordList) then travels to the BDB code (CDB_*) then pops back into HtDig code (WordDBCompress & WordDBPage)
WordDBCompress & WordDBPage is the mifluz page compression scheme. stick a printf in mp_cmpr.c:CDB___memp_cmpr_deflate This function does the zlib page compression for the wordlist_compress_zlib=true option. The current mifluz code has issues and may be replaced by a newer milfuz snapshot in the future. Thanks. On Tue, 11 Feb 2003, Lachlan Andrew wrote: > Greetings Neal, > > I've found a repeatable crash in the database code (stack dump below). > The bug seems to be very sensitive to the code, so I can't easily > print out debugging information. If you can suggest things to try in > ddd then I'll happily give them a go. The crash is about 30 mins > into execution. > > Thanks :) > Lachlan > > Program received signal SIGABRT, Aborted. > 0x4027e621 in kill () from /lib/libc.so.6 > Current language: auto; currently c > (gdb) where > #0 0x4027e621 in kill () from /lib/libc.so.6 > #1 0x4027e425 in raise () from /lib/libc.so.6 > #2 0x4027fa53 in abort () from /lib/libc.so.6 > #3 0x401ff45c in std::terminate() () from /usr/lib/libstdc++.so.5 > #4 0x401ff616 in __cxa_throw () from /usr/lib/libstdc++.so.5 > #5 0x401ff862 in operator new(unsigned) () from > /usr/lib/libstdc++.so.5 > #6 0x401ff94f in operator new[](unsigned) () from > /usr/lib/libstdc++.so.5 > #7 0x4007f24e in Compressor::get_vals(unsigned**, char const*) > (this=0xbfffe4a0, pres=0x85c3058, tag=0x2 <Address 0x2 out of > bounds>) at WordBitCompress.cc:815 > #8 0x40085268 in WordDBPage::Uncompress_main(Compressor*) > (this=0xbfffe500, pin=0xbfffe4a0) at WordDBPage.cc:213 > #9 0x40084fef in WordDBPage::Uncompress(Compressor*, int, > __db_cmpr_info*) (this=0xbfffe500, pin=0xbfffe4a0, ndebug=2) at > WordDBPage.cc:155 > #10 0x40083547 in WordDBCompress::Uncompress(unsigned char const*, > int, unsigned char*, int) (this=0x8245c88, inbuff=0x87d2678 "\004", > inbuff_length=2032, outbuff=0x408309b0 "\001", outbuff_length=8192) > at WordDBCompress.cc:156 > #11 0x40082e11 in WordDBCompress_uncompress_c (inbuff=0x87d2678 > "\004", inbuff_length=2032, outbuff=0x408309b0 "\001", > outbuff_length=8192, user_data=0x2) at WordDBCompress.cc:48 > #12 0x400fea93 in CDB___memp_cmpr_read (dbmfp=0x82db790, > bhp=0x40830978, db_io=0xbfffe680, niop=0xbfffe67c) at mp_cmpr.c:306 > #13 0x400fe832 in CDB___memp_cmpr (dbmfp=0x82db790, bhp=0x40830978, > db_io=0xbfffe680, flag=1, niop=0xbfffe67c) at mp_cmpr.c:153 > #14 0x400fdcdf in CDB___memp_pgread (dbmfp=0x82db790, bhp=0x40830978, > can_create=0) at mp_bh.c:212 > #15 0x400ffdfb in CDB_memp_fget (dbmfp=0x82db790, pgnoaddr=0xbfffe758, > flags=0, addrp=0xbfffe75c) at mp_fget.c:353 > #16 0x400d1747 in CDB___bam_search (dbc=0x82dbab0, key=0xbfffe970, > flags=12802, stop=1, recnop=0x0, exactp=0xbfffe844) at > bt_search.c:251 > #17 0x400c95a9 in CDB___bam_c_search (dbc=0x82dbab0, key=0xbfffe970, > flags=15, exactp=0xbfffe844) at bt_cursor.c:1594 > #18 0x400c8740 in CDB___bam_c_put (dbc_orig=0x82dbd50, key=0xbfffe970, > data=0xbfffe990, flags=15) at bt_cursor.c:982 > #19 0x400da9ea in CDB___db_put (dbp=0x80e5f88, txn=0x0, > key=0xbfffe970, data=0xbfffe990, flags=0) at db_am.c:508 > #20 0x40092796 in WordList::Put(WordReference const&, int) > (this=0xbffff190, arg=@0xbfffe970, flags=0) at WordDB.h:126 > #21 0x4003ab7e in HtWordList::Flush() (this=0xbffff190) at > ../htword/WordList.h:118 > #22 0x08056012 in Retriever::parse_url(URLRef&) (this=0xbffff0e0, > urlRef=@0x837c560) at Retriever.cc:667 > #23 0x08055612 in Retriever::Start() (this=0xbffff0e0) at > Retriever.cc:432 > #24 0x0805daa5 in main (ac=5, av=0xbffff704) at htdig.cc:338 > #25 0x4026c280 in __libc_start_main () from /lib/libc.so.6 > (gdb) > > On Tuesday 28 January 2003 09:38, Neal Richter wrote: > > > What DB errors are you speaking of? Turning on > > wordlist_compress_zlib should be a workaround for the DB errors I > > know about. > Neal Richter Knowledgebase Developer RightNow Technologies, Inc. Customer Service for Every Web Site Office: 406-522-1485 ------------------------------------------------------- This SF.NET email is sponsored by: SourceForge Enterprise Edition + IBM + LinuxWorld = Something 2 See! http://www.vasoftware.com _______________________________________________ htdig-dev mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/htdig-dev
