- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: seirge
Subject: segfault на 4.48

Версия 4.48, indexer падает в segfault при запуске такой командой:
./indexer -o -U -N 30 -z 16 -c 600 -n 1000
(количество потоков просто увеличивает шанс на segfault).

Последняя фраза:
*** glibc detected *** double free or corruption (!prev): 0x088daf80 ***
Aborted (core dumped)

Вывод gdb по core:
gdb indexer core.20090 
GNU gdb Red Hat Linux (6.3.0.0-1.143.el4rh)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db 
library "/lib/tls/libthread_db.so.1".

Core was generated by `/indexer:[2] URL:http://www.pemwell.com/Art'.
Program terminated with signal 6, Aborted.
Reading symbols from 
/hsphere/local/home/incontxt/search/4.48/lib/libdpsearch-4.so...done.
Loaded symbols for 
/hsphere/local/home/incontxt/search/4.48//lib/libdpsearch-4.so
Reading symbols from 
/hsphere/local/home/incontxt/search/4.48/lib/libdpcharset-4.so...done.
Loaded symbols for 
/hsphere/local/home/incontxt/search/4.48//lib/libdpcharset-4.so
Reading symbols from /lib/tls/librt.so.1...done.
Loaded symbols for /lib/tls/librt.so.1
Reading symbols from /usr/lib/libdns.so.16...done.
Loaded symbols for /usr/lib/libdns.so.16
Reading symbols from /usr/lib/libisc.so.7...done.
Loaded symbols for /usr/lib/libisc.so.7
Reading symbols from /lib/libcrypto.so.4...done.
Loaded symbols for /lib/libcrypto.so.4
Reading symbols from /lib/libcrypt.so.1...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/tls/libm.so.6...done.
Loaded symbols for /lib/tls/libm.so.6
Reading symbols from /lib/tls/libpthread.so.0...done.
Loaded symbols for /lib/tls/libpthread.so.0
Reading symbols from /lib/tls/libc.so.6...done.
Loaded symbols for /lib/tls/libc.so.6
Reading symbols from /usr/lib/libz.so.1...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /usr/lib/libmysqlclient.so.14...done.
Loaded symbols for /usr/lib/libmysqlclient.so.14
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /usr/lib/libgssapi_krb5.so.2...done.
Loaded symbols for /usr/lib/libgssapi_krb5.so.2
Reading symbols from /usr/lib/libkrb5.so.3...done.
Loaded symbols for /usr/lib/libkrb5.so.3
Reading symbols from /lib/libcom_err.so.2...done.
Loaded symbols for /lib/libcom_err.so.2
Reading symbols from /usr/lib/libk5crypto.so.3...done.
Loaded symbols for /usr/lib/libk5crypto.so.3
Reading symbols from /lib/libresolv.so.2...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/libnss_dns.so.2...done.
Loaded symbols for /lib/libnss_dns.so.2
#0  0x0067e7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
(gdb) backtrace
#0  0x0067e7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x006bf7a5 in raise () from /lib/tls/libc.so.6
#2  0x006c1209 in abort () from /lib/tls/libc.so.6
#3  0x006f3a1a in __libc_message () from /lib/tls/libc.so.6
#4  0x006fa2bf in _int_free () from /lib/tls/libc.so.6
#5  0x006fa63a in free () from /lib/tls/libc.so.6
#6  0x00d74991 in my_no_flags_free (ptr=0x0) at my_malloc.c:60
#7  0x00d9928d in vio_delete (vio=0x7c1840) at vio.c:223
#8  0x00d94716 in end_server (mysql=0x88d866c) at client.c:847
#9  0x00d9485d in net_safe_read (mysql=0x88d866c) at client.c:610
#10 0x00d95ee5 in cli_read_query_result (mysql=0x88d866c) at client.c:2432
#11 0x00d731d4 in mysql_read_query_result (mysql=0x0) at libmysql.c:4783
#12 0x00d0e8e1 in _DpsSQLAsyncQuery (db=0x88d6140, SQLRes=0x0, query=0xb654cc90 
"DELETE FROM robots WHERE hostinfo='www.pemwell.com'", 
    file=0xd3b449 "robots.c", line=86) at sqldbms.c:224
#13 0x00cc6191 in DeleteRobotRules (A=0x88d2418, Robots=Variable "Robots" is 
not available.
) at robots.c:91
#14 0x00cc6a6c in DpsRobotParse (Indexer=0x88d2418, Srv=0x0, content=0x0, 
hostinfo=0x88cef28 "www.pemwell.com") at robots.c:608
#15 0x00ca49fd in DpsIndexNextURL (Indexer=0x88d2418) at indexer.c:1351
#16 0x0804ba53 in thread_main (arg=0x88d2418) at main.c:879
#17 0x008873cc in start_thread () from /lib/tls/libpthread.so.0
#18 0x00760c3e in clone () from /lib/tls/libc.so.6

Грешу на игнорирование robots.txt, но оно очень нужно.

- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=06;post=

Ответить