[lftp] 4.7.4 zlib buffer error?
Hi, I’ve compiled lftp 4.7.4 on CentOS 7 and am running into an error when running (reverse) mirror with a high parallel number. Running with parallel <5 seems to be fine, but when I run with 10 or 20, I get the following: lftp: buffer_zlib.cc:131: virtual void DataDeflator::PutTranslated(Buffer*, const char*, int): Assertion `ret != (-2)' failed. which is maybe zlib running out of buffer? Any help would be appreciated. Thanks. -David___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] 4.7.4 zlib buffer error?
> On Dec 7, 2016, at 2:47 AM, Alexander V. Lukyanov wrote: > > On Tue, Dec 06, 2016 at 08:26:25AM -0800, David R Bosso wrote: >> I’ve compiled lftp 4.7.4 on CentOS 7 and am running into an error when >> running (reverse) mirror with a high parallel number. >> Running with parallel <5 seems to be fine, but when I run with 10 or 20, I >> get the following: >> lftp: buffer_zlib.cc:131: virtual void DataDeflator::PutTranslated(Buffer*, >> const char*, int): Assertion `ret != (-2)' failed. > > Please compile lftp using "configure --with-debug", run it under gdb and when > it faults type "info stack" or "bt"; post the output. > Also it could be useful if you turned on debug messages using "debug" command > in lftp. > > -- > Alexander. Thanks. Let me know if this helps. This was with "mirror --parallel=20 —reverse" -David lftp: buffer_zlib.cc:131: virtual void DataDeflator::PutTranslated(Buffer*, const char*, int): Assertion `ret != (-2)' failed. Program received signal SIGABRT, Aborted. 0x7646c5f7 in raise () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install glibc-2.17-106.el7_2.8.x86_64 gmp-6.0.0-12.el7_1.x86_64 gnutls-3.3.8-14.el7_2.x86_64 keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.13.2-12.el7_2.x86_64 libcom_err-1.42.9-7.el7.x86_64 libffi-3.0.13-16.el7.x86_64 libgcc-4.8.5-4.el7.x86_64 libselinux-2.2.2-6.el7.x86_64 libstdc++-4.8.5-4.el7.x86_64 libtasn1-3.8-2.el7.x86_64 ncurses-libs-5.9-13.20130511.el7.x86_64 nettle-2.7.1-4.el7.x86_64 openssl-libs-1.0.1e-51.el7_2.7.x86_64 p11-kit-0.20.7-3.el7.x86_64 pcre-8.32-15.el7_2.1.x86_64 readline-6.2-9.el7.x86_64 trousers-0.3.13-1.el7.x86_64 xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-15.el7.x86_64 (gdb) bt #0 0x7646c5f7 in raise () from /lib64/libc.so.6 #1 0x7646dce8 in abort () from /lib64/libc.so.6 #2 0x76465566 in __assert_fail_base () from /lib64/libc.so.6 #3 0x76465612 in __assert_fail () from /lib64/libc.so.6 #4 0x0055b13e in DataDeflator::PutTranslated (this=0x13e1fb0, target=0x14e4958, put_buf=0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., size=4947) at buffer_zlib.cc:131 #5 0x004ec98d in DirectedBuffer::Put (this=0x14e4958, buf=0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., size=4947) at buffer.cc:400 #6 0x004ece31 in IOBuffer::Put (this=0x14e48e0, buf=0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., size=4947) at buffer.cc:470 #7 0x0051f080 in Ftp::Write (this=0x12ec9f0, buf=0x1672e30, size=4947) at ftpclass.cc:3825 #8 0x004de7b9 in FileCopyPeerFA::Put_LL (this=0x1136290, buf=0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., len=131072) at FileCopy.cc:1303 #9 0x004ecdb6 in IOBuffer::Put (this=0x1136290, buf=0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., size=131072) at buffer.cc:458 #10 0x004da268 in FileCopy::Do (this=0x12dd730) at FileCopy.cc:333 #11 0x004cb57b in SMTask::ScheduleThis (this=0x12dd730) at SMTask.cc:209 #12 0x004cb701 in SMTask::Schedule () at SMTask.cc:248 #13 0x004704d1 in J
Re: [lftp] 4.7.4 zlib buffer error?
> On Dec 7, 2016, at 10:58 PM, Alexander V. Lukyanov wrote: > > On Wed, Dec 07, 2016 at 09:16:29AM -0800, David R Bosso wrote: >> Thanks. Let me know if this helps. This was with "mirror --parallel=20 >> —reverse" >> >> -David >> >> lftp: buffer_zlib.cc:131: virtual void DataDeflator::PutTranslated(Buffer*, >> const char*, int): Assertion `ret != (-2)' failed. >> >> Program received signal SIGABRT, Aborted. >> 0x7646c5f7 in raise () from /lib64/libc.so.6 >> Missing separate debuginfos, use: debuginfo-install >> glibc-2.17-106.el7_2.8.x86_64 gmp-6.0.0-12.el7_1.x86_64 >> gnutls-3.3.8-14.el7_2.x86_64 keyutils-libs-1.5.8-3.el7.x86_64 >> krb5-libs-1.13.2-12.el7_2.x86_64 libcom_err-1.42.9-7.el7.x86_64 >> libffi-3.0.13-16.el7.x86_64 libgcc-4.8.5-4.el7.x86_64 >> libselinux-2.2.2-6.el7.x86_64 libstdc++-4.8.5-4.el7.x86_64 >> libtasn1-3.8-2.el7.x86_64 ncurses-libs-5.9-13.20130511.el7.x86_64 >> nettle-2.7.1-4.el7.x86_64 openssl-libs-1.0.1e-51.el7_2.7.x86_64 >> p11-kit-0.20.7-3.el7.x86_64 pcre-8.32-15.el7_2.1.x86_64 >> readline-6.2-9.el7.x86_64 trousers-0.3.13-1.el7.x86_64 >> xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-15.el7.x86_64 >> (gdb) bt >> #0 0x7646c5f7 in raise () from /lib64/libc.so.6 >> #1 0x7646dce8 in abort () from /lib64/libc.so.6 >> #2 0x76465566 in __assert_fail_base () from /lib64/libc.so.6 >> #3 0x76465612 in __assert_fail () from /lib64/libc.so.6 >> #4 0x0055b13e in DataDeflator::PutTranslated (this=0x13e1fb0, >> target=0x14e4958, >>put_buf=0x1672e30 >> "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c> ..., size=4947) at buffer_zlib.cc:131 > > Thanks. Please do also these commands in gdb: > >frame 4 >p z >p &z >p z.state > > Also try to run lftp under valgrind. > > -- > Alexander. (gdb) frame 4 #4 0x0055b13e in DataDeflator::PutTranslated (this=0x13e1fb0, target=0x14e4958, put_buf=0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., size=4947) at buffer_zlib.cc:131 131 assert(ret != Z_STREAM_ERROR); /* state not clobbered */ (gdb) p z $1 = { next_in = 0x1672e30 "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c..., avail_in = 4947, total_in = 393216, next_out = 0x1733c5d "", avail_out = 5203, total_out = 361024, msg = 0x778a2760 "stream error", state = 0x14febb0, zalloc = 0x7789c560 , zfree = 0x7789c570 , opaque = 0x0, data_type = 0, adler = 2504375505, reserved = 140737328916424} (gdb) p &z $2 = (z_stream *) 0x13e2010 (gdb) p z.state $3 = (internal_state *) 0x14febb0 (gdb) I will see about running in valgrind later today. Thanks. -David ___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp
Re: [lftp] 4.7.4 zlib buffer error?
> On Dec 8, 2016, at 8:33 AM, David R Bosso wrote: > > >> On Dec 7, 2016, at 10:58 PM, Alexander V. Lukyanov > <mailto:l...@netis.ru>> wrote: >> >> >> Thanks. Please do also these commands in gdb: >> >>frame 4 >>p z >>p &z >>p z.state >> >> Also try to run lftp under valgrind. >> >> -- >> Alexander. > > (gdb) frame 4 > #4 0x0055b13e in DataDeflator::PutTranslated (this=0x13e1fb0, > target=0x14e4958, > put_buf=0x1672e30 > "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c ..., size=4947) at buffer_zlib.cc:131 > 131 assert(ret != Z_STREAM_ERROR); /* state not clobbered */ > (gdb) p z > $1 = { > next_in = 0x1672e30 > "\334[Esm;\255\301\302H\233q\234\343\034\236\275\351\001s^\361\005\276\202\221Iw\005\303\305+m\017\020R\003z\034\221[ڮ\242\272f\231-\364\220\273\210\300&5#w$\fu\306y\240\016R\373\304֚}坥\334SE%\312\356\313.\026>:\023\334\347\216\063\315a\307\342}?P\323\365G\236\322\177&\314\354\232)#\311e9\355\333\361\351L\vQ\353\061\303\341H\365-3O\177(DLp\f\001\030\031\344\363\320c ..., avail_in = 4947, total_in = 393216, next_out > = 0x1733c5d "", > avail_out = 5203, total_out = 361024, msg = 0x778a2760 "stream error", > state = 0x14febb0, zalloc = 0x7789c560 , zfree = 0x7789c570 > , opaque = 0x0, data_type = 0, > adler = 2504375505, reserved = 140737328916424} > (gdb) p &z > $2 = (z_stream *) 0x13e2010 > (gdb) p z.state > $3 = (internal_state *) 0x14febb0 > (gdb) > > I will see about running in valgrind later today. > > Thanks. > > -David Hi, here’s a first run at valgrind. It’s been a while since I’ve used it, let me know if you want it run with other options. http://pastebin.com/BHSFAQtX Thanks. -David___ lftp mailing list lftp@uniyar.ac.ru http://univ.uniyar.ac.ru/mailman/listinfo/lftp