[FOSSology] filter_license job failing
I just recently did a clean install of v1.1 on Ubuntu. I did some license analysis on a couple files I uploaded from url and the analysis completed fine. Now I am trying to do some analysis on some files I uploaded from server and the analysis keeps failing at the filter_license stage. I'm attaching my log file from the point I restarted Fossology upto the latest failure. Please let me know if you can tell me why the job is failing. Dave McLoughlin | OpenLogic fossology.log Description: fossology.log ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] filter_license job failing
Dave, I've reported similar issue in Ubuntu about a month ago, see thread starting at this message: http://www.mail-archive.com/fossology@fossology.org/msg00545.html You could confirm you are seeing the same issue by capturing the agent stdout/stderr and seeing if Filter_License is crashing due to stack smashing. (I captured agent stderr/stdout by restarting fossology service from shell command line.) The last message in the thread contains my diagnosis of the likely cause. What I did NOT report to the list was my workaround: I recompiled Filter_License agent with stack smashing protection disabled, by adding -fno-stack-protector into CFLAGS_LOCAL in agents/foss_license_agent/Filter_License/Makefile, and Filter_License has been running fine ever since. Of course, your issue may be something totally different, in which case someone more qualified than myself will have to help. Best regards, -Dragoslav On Thu, 2009-09-03 at 11:56 -0600, Dave McLoughlin wrote: I just recently did a clean install of v1.1 on Ubuntu. I did some license analysis on a couple files I uploaded “from url” and the analysis completed fine. Now I am trying to do some analysis on some files I uploaded “from server” and the analysis keeps failing at the filter_license stage. I’m attaching my log file from the point I restarted Fossology upto the latest failure. Please let me know if you can tell me why the job is failing. Dave McLoughlin | OpenLogic ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] filter_license job failing
Great, thanks for the info. Yes, I did see the stack smashing detected in my stdout. Unfortunately, I didn't realize it was related to my issue. I should have read it more carefully. $ *** stack smashing detected ***: /usr/local/lib/fossology/agents/Filter_License terminated === Backtrace: = /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x48)[0xb7effda8] /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x0)[0xb7effd60] /usr/local/lib/fossology/agents/Filter_License[0x804d38d] /usr/local/lib/fossology/agents/Filter_License[0x804e1e3] /usr/local/lib/fossology/agents/Filter_License[0x804b68c] /usr/local/lib/fossology/agents/Filter_License[0x804d84a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7e18775] /usr/local/lib/fossology/agents/Filter_License[0x80498f1] === Memory map: 08048000-08055000 r-xp 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08055000-08056000 r--p c000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08056000-08057000 rw-p d000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08057000-0805a000 rw-p 08057000 00:00 0 08d67000-08e5d000 rw-p 08d67000 00:00 0 [heap] Etc... I'll try your workaround. Thanks, you saved me a bunch of time. Dave McLoughlin | OpenLogic 720 240 4530 | phone 303 818 1686 | cell -Original Message- From: Dragoslav Mitrinovic [mailto:dr...@motorola.com] Sent: Thursday, September 03, 2009 1:02 PM To: Dave McLoughlin Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Dave, I've reported similar issue in Ubuntu about a month ago, see thread starting at this message: http://www.mail-archive.com/fossology@fossology.org/msg00545.html You could confirm you are seeing the same issue by capturing the agent stdout/stderr and seeing if Filter_License is crashing due to stack smashing. (I captured agent stderr/stdout by restarting fossology service from shell command line.) The last message in the thread contains my diagnosis of the likely cause. What I did NOT report to the list was my workaround: I recompiled Filter_License agent with stack smashing protection disabled, by adding -fno-stack-protector into CFLAGS_LOCAL in agents/foss_license_agent/Filter_License/Makefile, and Filter_License has been running fine ever since. Of course, your issue may be something totally different, in which case someone more qualified than myself will have to help. Best regards, -Dragoslav On Thu, 2009-09-03 at 11:56 -0600, Dave McLoughlin wrote: I just recently did a clean install of v1.1 on Ubuntu. I did some license analysis on a couple files I uploaded from url and the analysis completed fine. Now I am trying to do some analysis on some files I uploaded from server and the analysis keeps failing at the filter_license stage. I'm attaching my log file from the point I restarted Fossology upto the latest failure. Please let me know if you can tell me why the job is failing. Dave McLoughlin | OpenLogic ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] filter_license job failing
A workaround is nice, but we really ought to fix the stack overflow issue itself in filter_license, yes (assuming that is what's happening)? Dan -Original Message- From: fossology-boun...@fossology.org [mailto:fossology-boun...@fossology.org] On Behalf Of Dave McLoughlin Sent: Thursday, September 03, 2009 1:14 PM To: Dragoslav Mitrinovic Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Great, thanks for the info. Yes, I did see the stack smashing detected in my stdout. Unfortunately, I didn't realize it was related to my issue. I should have read it more carefully. $ *** stack smashing detected ***: /usr/local/lib/fossology/agents/Filter_License terminated === Backtrace: = /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x48)[0xb7effda8] /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x0)[0xb7effd60] /usr/local/lib/fossology/agents/Filter_License[0x804d38d] /usr/local/lib/fossology/agents/Filter_License[0x804e1e3] /usr/local/lib/fossology/agents/Filter_License[0x804b68c] /usr/local/lib/fossology/agents/Filter_License[0x804d84a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7e18775] /usr/local/lib/fossology/agents/Filter_License[0x80498f1] === Memory map: 08048000-08055000 r-xp 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08055000-08056000 r--p c000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08056000-08057000 rw-p d000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08057000-0805a000 rw-p 08057000 00:00 0 08d67000-08e5d000 rw-p 08d67000 00:00 0 [heap] Etc... I'll try your workaround. Thanks, you saved me a bunch of time. Dave McLoughlin | OpenLogic 720 240 4530 | phone 303 818 1686 | cell -Original Message- From: Dragoslav Mitrinovic [mailto:dr...@motorola.com] Sent: Thursday, September 03, 2009 1:02 PM To: Dave McLoughlin Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Dave, I've reported similar issue in Ubuntu about a month ago, see thread starting at this message: http://www.mail-archive.com/fossology@fossology.org/msg00545.html You could confirm you are seeing the same issue by capturing the agent stdout/stderr and seeing if Filter_License is crashing due to stack smashing. (I captured agent stderr/stdout by restarting fossology service from shell command line.) The last message in the thread contains my diagnosis of the likely cause. What I did NOT report to the list was my workaround: I recompiled Filter_License agent with stack smashing protection disabled, by adding -fno-stack-protector into CFLAGS_LOCAL in agents/foss_license_agent/Filter_License/Makefile, and Filter_License has been running fine ever since. Of course, your issue may be something totally different, in which case someone more qualified than myself will have to help. Best regards, -Dragoslav On Thu, 2009-09-03 at 11:56 -0600, Dave McLoughlin wrote: I just recently did a clean install of v1.1 on Ubuntu. I did some license analysis on a couple files I uploaded from url and the analysis completed fine. Now I am trying to do some analysis on some files I uploaded from server and the analysis keeps failing at the filter_license stage. I'm attaching my log file from the point I restarted Fossology upto the latest failure. Please let me know if you can tell me why the job is failing. Dave McLoughlin | OpenLogic ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] filter_license job failing
Dan, Is there any other information I can supply to help? Let me know. BTW, I'm attaching the complete dump from my stdout in case you find it useful. Dave McLoughlin | OpenLogic -Original Message- From: Dan Stangel [mailto:dan...@fossology.org] Sent: Thursday, September 03, 2009 2:36 PM To: Dave McLoughlin; Dragoslav Mitrinovic Cc: fossology@fossology.org Subject: RE: [FOSSology] filter_license job failing A workaround is nice, but we really ought to fix the stack overflow issue itself in filter_license, yes (assuming that is what's happening)? Dan -Original Message- From: fossology-boun...@fossology.org [mailto:fossology-boun...@fossology.org] On Behalf Of Dave McLoughlin Sent: Thursday, September 03, 2009 1:14 PM To: Dragoslav Mitrinovic Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Great, thanks for the info. Yes, I did see the stack smashing detected in my stdout. Unfortunately, I didn't realize it was related to my issue. I should have read it more carefully. $ *** stack smashing detected ***: /usr/local/lib/fossology/agents/Filter_License terminated === Backtrace: = /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x48)[0xb7effda8] /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x0)[0xb7effd60] /usr/local/lib/fossology/agents/Filter_License[0x804d38d] /usr/local/lib/fossology/agents/Filter_License[0x804e1e3] /usr/local/lib/fossology/agents/Filter_License[0x804b68c] /usr/local/lib/fossology/agents/Filter_License[0x804d84a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7e18775] /usr/local/lib/fossology/agents/Filter_License[0x80498f1] === Memory map: 08048000-08055000 r-xp 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08055000-08056000 r--p c000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08056000-08057000 rw-p d000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08057000-0805a000 rw-p 08057000 00:00 0 08d67000-08e5d000 rw-p 08d67000 00:00 0 [heap] Etc... I'll try your workaround. Thanks, you saved me a bunch of time. Dave McLoughlin | OpenLogic 720 240 4530 | phone 303 818 1686 | cell -Original Message- From: Dragoslav Mitrinovic [mailto:dr...@motorola.com] Sent: Thursday, September 03, 2009 1:02 PM To: Dave McLoughlin Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Dave, I've reported similar issue in Ubuntu about a month ago, see thread starting at this message: http://www.mail-archive.com/fossology@fossology.org/msg00545.html You could confirm you are seeing the same issue by capturing the agent stdout/stderr and seeing if Filter_License is crashing due to stack smashing. (I captured agent stderr/stdout by restarting fossology service from shell command line.) The last message in the thread contains my diagnosis of the likely cause. What I did NOT report to the list was my workaround: I recompiled Filter_License agent with stack smashing protection disabled, by adding -fno-stack-protector into CFLAGS_LOCAL in agents/foss_license_agent/Filter_License/Makefile, and Filter_License has been running fine ever since. Of course, your issue may be something totally different, in which case someone more qualified than myself will have to help. Best regards, -Dragoslav On Thu, 2009-09-03 at 11:56 -0600, Dave McLoughlin wrote: I just recently did a clean install of v1.1 on Ubuntu. I did some license analysis on a couple files I uploaded from url and the analysis completed fine. Now I am trying to do some analysis on some files I uploaded from server and the analysis keeps failing at the filter_license stage. I'm attaching my log file from the point I restarted Fossology upto the latest failure. Please let me know if you can tell me why the job is failing. Dave McLoughlin | OpenLogic ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology $ *** stack smashing detected ***: /usr/local/lib/fossology/agents/Filter_License terminated === Backtrace: = /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x48)[0xb7effda8] /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x0)[0xb7effd60] /usr/local/lib/fossology/agents/Filter_License[0x804d38d] /usr/local/lib/fossology/agents/Filter_License[0x804e1e3] /usr/local/lib/fossology/agents/Filter_License[0x804b68c] /usr/local/lib/fossology/agents/Filter_License[0x804d84a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7e18775] /usr/local/lib/fossology/agents/Filter_License[0x80498f1] === Memory map: 08048000-08055000 r-xp 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08055000-08056000 r--p c000 08
Re: [FOSSology] filter_license job failing
AFAIK Debian still defaults to SSP (stack smashing protection) disabled, while Ubuntu defaults to SSP enabled. That's why this is popping up in Ubuntu only. It should be easy though to reproduce it in Debian; just recompile with -fstack-protection. -Dragoslav On Thu, 2009-09-03 at 14:35 -0600, Dan Stangel wrote: A workaround is nice, but we really ought to fix the stack overflow issue itself in filter_license, yes (assuming that is what's happening)? Dan -Original Message- From: fossology-boun...@fossology.org [mailto:fossology-boun...@fossology.org] On Behalf Of Dave McLoughlin Sent: Thursday, September 03, 2009 1:14 PM To: Dragoslav Mitrinovic Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Great, thanks for the info. Yes, I did see the stack smashing detected in my stdout. Unfortunately, I didn't realize it was related to my issue. I should have read it more carefully. $ *** stack smashing detected ***: /usr/local/lib/fossology/agents/Filter_License terminated === Backtrace: = /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x48)[0xb7effda8] /lib/tls/i686/cmov/libc.so.6(__fortify_fail+0x0)[0xb7effd60] /usr/local/lib/fossology/agents/Filter_License[0x804d38d] /usr/local/lib/fossology/agents/Filter_License[0x804e1e3] /usr/local/lib/fossology/agents/Filter_License[0x804b68c] /usr/local/lib/fossology/agents/Filter_License[0x804d84a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7e18775] /usr/local/lib/fossology/agents/Filter_License[0x80498f1] === Memory map: 08048000-08055000 r-xp 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08055000-08056000 r--p c000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08056000-08057000 rw-p d000 08:01 2778370 /usr/local/lib/fossology/agents/Filter_License 08057000-0805a000 rw-p 08057000 00:00 0 08d67000-08e5d000 rw-p 08d67000 00:00 0 [heap] Etc... I'll try your workaround. Thanks, you saved me a bunch of time. Dave McLoughlin | OpenLogic 720 240 4530 | phone 303 818 1686 | cell -Original Message- From: Dragoslav Mitrinovic [mailto:dr...@motorola.com] Sent: Thursday, September 03, 2009 1:02 PM To: Dave McLoughlin Cc: fossology@fossology.org Subject: Re: [FOSSology] filter_license job failing Dave, I've reported similar issue in Ubuntu about a month ago, see thread starting at this message: http://www.mail-archive.com/fossology@fossology.org/msg00545.html You could confirm you are seeing the same issue by capturing the agent stdout/stderr and seeing if Filter_License is crashing due to stack smashing. (I captured agent stderr/stdout by restarting fossology service from shell command line.) The last message in the thread contains my diagnosis of the likely cause. What I did NOT report to the list was my workaround: I recompiled Filter_License agent with stack smashing protection disabled, by adding -fno-stack-protector into CFLAGS_LOCAL in agents/foss_license_agent/Filter_License/Makefile, and Filter_License has been running fine ever since. Of course, your issue may be something totally different, in which case someone more qualified than myself will have to help. Best regards, -Dragoslav On Thu, 2009-09-03 at 11:56 -0600, Dave McLoughlin wrote: I just recently did a clean install of v1.1 on Ubuntu. I did some license analysis on a couple files I uploaded from url and the analysis completed fine. Now I am trying to do some analysis on some files I uploaded from server and the analysis keeps failing at the filter_license stage. I'm attaching my log file from the point I restarted Fossology upto the latest failure. Please let me know if you can tell me why the job is failing. Dave McLoughlin | OpenLogic ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
