Dear Paul, [ Please keep Debian-BTS in CC line. ]
a Debian user of txt2pdbdoc has reported a bug on converting chinese documents. (http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=346348) I can confirm the bug with his test file on my side. Please test it and give us your opinion. URL to test file: http://bugs.debian.org/cgi-bin/bugreport.cgi/gbk.txt?bug=346348;msg=20;att=1 Thank you in advance. ---------- Forwarded Message ---------- Subject: Bug#346348: txt2pdbdoc core dump when compress chinese document Date: Sonntag, 8. Januar 2006 09:06 From: Xie Yanbo <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] On 1/8/06, Erik Schanze <[EMAIL PROTECTED]> wrote: > Please provide some sample data for testing. (No private material!) > A backtrace of gdb would also be nice, if you are able to do so. I got this backgrace running with attachment file `gbk.txt'. 0$ echo $LANG C 0$ export LANG=C 0$ ./txt2pdbdoc test gbk.txt gbk.pdb *** glibc detected *** double free or corruption (out): 0x0804da50 *** Aborted (core dumped) 134$ gdb ./txt2pdbdoc ./core GNU gdb 6.4-debian Copyright 2005 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i486-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Core was generated by `./txt2pdbdoc test gbk.txt gbk.pdb'. Program terminated with signal 6, Aborted. warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0xb7e3a7a7 in raise () from /lib/tls/libc.so.6 (gdb) bt #0 0xb7e3a7a7 in raise () from /lib/tls/libc.so.6 #1 0xb7e3c04b in abort () from /lib/tls/libc.so.6 #2 0xb7e71015 in __fsetlocking () from /lib/tls/libc.so.6 #3 0xb7e77667 in malloc_usable_size () from /lib/tls/libc.so.6 #4 0xb7e77b02 in free () from /lib/tls/libc.so.6 #5 0x08048cfb in compress (b=0xbfe6c11c) at txt2pdbdoc.c:306 #6 0x0804950b in encode (document_name=0xbfe6d8f6 "test", src_file_name=0x0, dest_file_name=0x0) at txt2pdbdoc.c:561 #7 0x08049b3f in main (argc=3, argv=0xbfe6c204) at txt2pdbdoc.c:217 (gdb) frame #0 0xb7e3a7a7 in raise () from /lib/tls/libc.so.6 (gdb) l txt2pdbdoc.c:306 301 /* when we get to the end of the buffer, don't inc past the */ 302 /* end; this forces the residue chars out one at a time */ 303 if ( tail != end ) 304 ++tail; 305 } 306 free( buf_orig ); 307 308 if ( space ) 309 b->data[ b->len++ ] = ' '; /* add left-over space */ 310 (gdb) 0$ And compress utf8 file will be ok. 0$ cat gbk.txt | iconv -f gbk -t utf8 > utf8.txt 0$ ./txt2pdbdoc test utf8.txt utf8.pdb These can explain what happens: 0$ gdb ./txt2pdbdoc (gdb) b txt2pdbdoc.c:306 Breakpoint 1 at 0x8048cf0: file txt2pdbdoc.c, line 306. (gdb) b txt2pdbdoc.c:561 Breakpoint 2 at 0x8049500: file txt2pdbdoc.c, line 561. (gdb) r test gbk.txt gbk.pdb Starting program: /home/xyb/deb/txt2pdbdoc/txt2pdbdoc-1.4.4/txt2pdbdoc test gbk.txt gbk.pdb Breakpoint 2, encode (document_name=0xbfab38ca "test", src_file_name=0x1 <Address 0x1 out of bounds>, dest_file_name=0x1 <Address 0x1 out of bounds>) at txt2pdbdoc.c:561 561 compress( &buf ); (gdb) p buf.len $1 = 4004 (gdb) c Continuing. Breakpoint 1, compress (b=0xbfab1a0c) at txt2pdbdoc.c:306 306 free( buf_orig ); (gdb) p b.len $2 = 6034 (gdb) s *** glibc detected *** double free or corruption (out): 0x0804da50 *** Program received signal SIGABRT, Aborted. 0xb7e807a7 in raise () from /lib/tls/libc.so.6 (gdb) c Continuing. Program terminated with signal SIGABRT, Aborted. The program no longer exists. (gdb) q 0$ 0$ gdb ./txt2pdbdoc (gdb) b txt2pdbdoc.c:306 Breakpoint 1 at 0x8048cf0: file txt2pdbdoc.c, line 306. (gdb) b txt2pdbdoc.c:561 Breakpoint 2 at 0x8049500: file txt2pdbdoc.c, line 561. (gdb) r test utf8.txt utf8.pdb Starting program: /home/xyb/deb/txt2pdbdoc/txt2pdbdoc-1.4.4/txt2pdbdoc test utf8.txt utf8.pdb Breakpoint 2, encode (document_name=0xbfe518c8 "test", src_file_name=0x1 <Address 0x1 out of bounds>, dest_file_name=0x1 <Address 0x1 out of bounds>) at txt2pdbdoc.c:561 561 compress( &buf ); (gdb) p buf.len $1 = 4096 (gdb) c Continuing. Breakpoint 1, compress (b=0xbfe4ff7c) at txt2pdbdoc.c:306 306 free( buf_orig ); (gdb) p b.len $2 = 4351 (gdb) c Continuing. Breakpoint 2, encode (document_name=0xbfe518c8 "test", src_file_name=0x1 <Address 0x1 out of bounds>, dest_file_name=0x1 <Address 0x1 out of bounds>) at txt2pdbdoc.c:561 561 compress( &buf ); (gdb) p buf.len $3 = 1872 (gdb) c Continuing. Breakpoint 1, compress (b=0xbfe4ff7c) at txt2pdbdoc.c:306 306 free( buf_orig ); (gdb) p b.len $4 = 2256 (gdb) c Continuing. Program exited normally. (gdb) q 0$ ------------------------------------------------------- Kindly regards, Erik -- www.ErikSchanze.de ********************************************* Bitte keine HTML-E-Mails! No HTML mails, please! Limit: 100 kB * - Chemnitzer Linux-Tage am 4. und 5. März 2006 * Info: http://chemnitzer.linux-tage.de/ *
