Hi Vincent, Since there are two problems: 1) wrong mimetype 2) pkgagent crashing
You should be able to reproduce the latter problem by taking Jeroen's file, manually setting the mimetype to x-rpm, then run pkgagent. Bob Gobeille On Feb 15, 2011, at 1:43 AM, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: > Jeroen, I will follow up this bug. > > Thanks, > Vincent > >> -----Original Message----- >> From: Jeroen Baten [mailto:jba...@onvz.nl] >> Sent: Tuesday, February 15, 2011 4:36 PM >> To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) >> Cc: fossology@fossology.org >> Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package >> Scan >> >> Hello Vincent, >> >> This issue is not that important that I need a workaround. >> I just tested the fossology program with its own tar file. >> I just thought I mention the bug when it occured. >> >> kind regards, >> >> >> On Tue, 2011-02-15 at 08:31 +0000, Ma, Dong (Vincent, >> ES-Best-Shore-Services-China-BJ) wrote: >>> Jeroen, I didn't have an Fedora14 system for now, I need create one for >> testing. >>> >>> I can give you a workaround about this issue, you can use this sql to update >> your database, and rerun pkgagent. >>> 'UPDATE pfile SET pfile_mimetypefk=NULL WHERE pfile_pk=$pfile_pk; ' >> $pfile_pk is the pfile ID about this file, you can find from [info] page >> about >> this file. >>> >>> Thanks, >>> Vincent >>> >>>> -----Original Message----- >>>> From: Jeroen Baten [mailto:jba...@onvz.nl] >>>> Sent: Tuesday, February 15, 2011 4:13 PM >>>> To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) >>>> Cc: fossology@fossology.org >>>> Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails >>>> Package Scan >>>> >>>> Fedora 14 >>>> >>>> On Tue, 2011-02-15 at 08:11 +0000, Ma, Dong (Vincent, >>>> ES-Best-Shore-Services-China-BJ) wrote: >>>>> Hi Jeroen, >>>>> >>>>> In my test system(Debian Lenny), this file mimetype didn't recognize as >> ' >>>> application/x-rpm ', what's your system os? >>>>> >>>>> Thanks, >>>>> Vincent >>>>> >>>>>> -----Original Message----- >>>>>> From: fossology-boun...@fossology.org [mailto:fossology- >>>>>> boun...@fossology.org] On Behalf Of Ma, Dong (Vincent, >>>>>> ES-Best-Shore- >>>>>> Services-China-BJ) >>>>>> Sent: Tuesday, February 15, 2011 3:56 PM >>>>>> To: Jeroen Baten >>>>>> Cc: fossology@fossology.org >>>>>> Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz >>>>>> fails Package Scan >>>>>> >>>>>> Thanks Jeroen, I'll use this for debugging. >>>>>> >>>>>> Vincent >>>>>> >>>>>>> -----Original Message----- >>>>>>> From: Jeroen Baten [mailto:jba...@onvz.nl] >>>>>>> Sent: Tuesday, February 15, 2011 3:54 PM >>>>>>> To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) >>>>>>> Cc: Gobeille, Robert; fossology@fossology.org >>>>>>> Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz >>>>>>> fails Package Scan >>>>>>> >>>>>>> So it is! >>>>>>> >>>>>>> Files associated with >>>>>>> >>>>>> >>>> >> be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33 >>>>>>> 62862.2639 >>>>>>> >>>>>>> 1: Folder: Software Repository/ >>>>>>> Fossology_1_3_0/ >>>>>>> Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/ >>>>>>> RedHat.tar.gz/ >>>>>>> RedHat.tar/ RedHat/ >>>>>>> perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm >>>>>>> >>>>>>> >>>>>>> kind regards, >>>>>>> >>>>>>> On Tue, 2011-02-15 at 07:50 +0000, Ma, Dong (Vincent, >>>>>>> ES-Best-Shore-Services-China-BJ) wrote: >>>>>>>> Jeroen, I think you can use the 'search' menu, select the >>>>>>>> 'Repository' micro- >>>>>>> menu, enter the repository file name >>>>>>> >>>>>> >>>> >> 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3 >>>>>>> 362862.2639' to search. >>>>>>>> >>>>>>>> Vincent >>>>>>>> >>>>>>>>> -----Original Message----- >>>>>>>>> From: Jeroen Baten [mailto:jba...@onvz.nl] >>>>>>>>> Sent: Tuesday, February 15, 2011 3:45 PM >>>>>>>>> To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) >>>>>>>>> Cc: Gobeille, Robert; fossology@fossology.org >>>>>>>>> Subject: RE: [FOSSology] Weird scan of >>>>>>>>> fossology-1.3.0.tar.gz fails Package Scan >>>>>>>>> >>>>>>>>> Hello Vincent, >>>>>>>>> >>>>>>>>> Sending the file is easy. Knowing what it used to be is a >>>>>>>>> little hardder. I guess I need a sql query for that info? >>>>>>>>> >>>>>>>>> kind regards, >>>>>>>>> >>>>>>>>> >>>>>>>>> On Tue, 2011-02-15 at 07:33 +0000, Ma, Dong (Vincent, >>>>>>>>> ES-Best-Shore-Services-China-BJ) wrote: >>>>>>>>>> Hi Jeroen, >>>>>>>>>> >>>>>>>>>> It's weird if the file is not an rpm file, the file >>>>>>>>>> mimetype should not >>>> be ' >>>>>>>>> application/x-rpm '. >>>>>>>>>> >>>>>>>>>> Can you send me the original file or the path in >>>>>>>>>> fossology-1.3.0.tar.gz? Then >>>>>>>>> I can debug this issue. >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Vincent >>>>>>>>>> >>>>>>>>>>> -----Original Message----- >>>>>>>>>>> From: fossology-boun...@fossology.org >>>>>>>>>>> [mailto:fossology- boun...@fossology.org] On Behalf Of >>>>>>>>>>> Jeroen Baten >>>>>>>>>>> Sent: Tuesday, February 15, 2011 3:06 PM >>>>>>>>>>> To: Gobeille, Robert >>>>>>>>>>> Cc: fossology@fossology.org >>>>>>>>>>> Subject: Re: [FOSSology] Weird scan of >>>>>>>>>>> fossology-1.3.0.tar.gz fails Package Scan >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> root cause analyses: it is not an rpm file: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> [root@htn-ws-3092 jbaten]# >>>>>>>>>>> /usr/local/lib/fossology/agents/pkgagent >>>>>>>>>>> -v >>>>>>>>>>> /srv/fossology/repository/localhost/files/be/96/51/be9 >>>>>>>>>>> 651c >>>>>>>>>>> 3d92 >>>>>>>>>>> b8 >>>>>>>>>>> a76f >>>>>>>>>>> d3d0 >>>>>>>>>>> c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2 >>>>>>>>>>> 639 >>>>>>>>>>> error: >>>>>>>>>>> /srv/fossology/repository/localhost/files/be/96/51/be9 >>>>>>>>>>> 651c >>>>>>>>>>> 3d92 >>>>>>>>>>> b8 >>>>>>>>>>> a76f >>>>>>>>>>> d3d0 >>>>>>>>>>> c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2 >>>>>>>>>>> 639 >>>>>>> cannot >>>>>>>>> be >>>>>>>>>>> read or is not an RPM. >>>>>>>>>>> [root@htn-ws-3092 jbaten]# file >>>>>>>>>>> /srv/fossology/repository/localhost/files/be/96/51/be9 >>>>>>>>>>> 651c >>>>>>>>>>> 3d92 >>>>>>>>>>> b8 >>>>>>>>>>> a76f >>>>>>>>>>> d3d0 >>>>>>>>>>> c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2 >>>>>>>>>>> 639 >>>>>>>>>>> /srv/fossology/repository/localhost/files/be/96/51/be9 >>>>>>>>>>> 651c >>>>>>>>>>> 3d92 >>>>>>>>>>> b8 >>>>>>>>>>> a76f >>>>>>>>>>> d3d0 >>>>>>>>>>> >> c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639: >>>>>>>>>>> ASCII English text >>>>>>>>>>> [root@htn-ws-3092 jbaten]# head -30l >>>>>>>>>>> /srv/fossology/repository/localhost/files/be/96/51/be9 >>>>>>>>>>> 651c >>>>>>>>>>> 3d92 >>>>>>>>>>> b8 >>>>>>>>>>> a76f >>>>>>>>>>> d3d0 >>>>>>>>>>> c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2 >>>>>>>>>>> 639 >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>>> >>>> >> ########################################################## >>>>>>>>>>> ################### >>>>>>>>>>> # $Id: Makefile.PL.rpm,v 1.1.2.1 2007/01/10 18:01:48 >>>>>>>>>>> richm% stanfordalumni.org Exp $ # # The contents of >>>>>>>>>>> this file are subject to the Mozilla Public License # >>>>>>>>>>> Version >>>>>>>>>>> 1.1 (the "License"); you may not use this file except >>>>>>>>>>> in # compliance with the License. You may obtain a >>>>>>>>>>> copy of the License at # http://www.mozilla.org/MPL/ # >>>>>>>>>>> # Software distributed under the >>>>>>> License is distributed on an "AS IS" >>>>>>>>>>> # basis, WITHOUT WARRANTY OF ANY KIND, either express >>>>>>>>>>> or >>>>>> implied. >>>>>>>>>>> See the # License for the specific language governing >>>>>>>>>>> rights and limitations # under the License. >>>>>>>>>>> # >>>>>>>>>>> # The Original Code is PerLDAP. The Initial Developer >>>>>>>>>>> of the Original # Code is Netscape Communications >>>>>>>>>>> Corp. and Clayton >>>>>>> Donley. >>>>>>>>>>> Portions # created by Netscape are Copyright (C) >>>>>>>>>>> Netscape Communications # Corp., portions created by >>>>>>>>>>> Clayton Donley are Copyright (C) Clayton # Donley, >>>>>>>>>>> portions created by Leif Hedstrom are Copyright (C) >>>>>>>>>>> Leif # Hedstrom. All Rights >>>> Reserved. >>>>>>>>>>> # >>>>>>>>>>> # Contributor(s): >>>>>>>>>>> # * Leif Hedstrom <l...@perldap.org> >>>>>>>>>>> # >>>>>>>>>>> # DESCRIPTION >>>>>>>>>>> # The Makefile "source". >>>>>>>>>>> # This has been heavily modified to simply use pkg-config >>>>>>>>>>> # to get the components necessary to build. >>>>>>>>>>> # >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>>> >>>> >> ########################################################## >>>>>>>>>>> ################### >>>>>>>>>>> >>>>>>>>>>> [root@htn-ws-3092 jbaten]# >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Fri, 2011-02-11 at 10:32 -0700, Bob Gobeille wrote: >>>>>>>>>>>> Whoops I didn't read the bug carefully and was >>>>>>>>>>>> mixing this up with bug 636. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Jeroen, if the file is from a public upload, could >>>>>>>>>>>> you give us the URL? If not, could you run the >>>>>>>>>>>> pkgagent standalone on the file it crashed on? The basic >> syntax is: >>>>>>>>>>>> >>>>>>>>>>>> pkgagent -v my.rpm >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> pkgagent is installed in either >>>>>>>>>>>> /usr/local/lib/fossology/agents or >> /usr/lib/fossology/agents. >>>>>>>>>>>> The file it crashed on is in your repository. So >>>>>>>>>>>> first you need to find the repository: >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> cat /usr/local/etc/fossology/RepPath.conf >>>>>>>>>>>> or >>>>>>>>>>>> cat /etc/fossology/RepPath.conf >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> For example, let's say your repository is in >>>>>>>>>>>> /srv/fossology/repository and is only on a single host. >>>>>>>>>>>> Then the file to >>>>>>>>> pass to pkgagent is: >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> /srv/fossology/repository/localhost/files/be/96/51/B >>>>>>>>>>>> E965 >>>>>>>>>>>> 1C3D >>>>>>>>>>>> 92 >>>>>>>>>>>> B8A7 >>>>>>>>>>>> 6FD3 >>>>>>>>>>>> >>>>>>> >> D0C03FF5597411E8FF860.A0FD8E3774FED62ABEB6C2CDA3362862.2639 >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Thanks, >>>>>>>>>>>> Bob Gobeille >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Feb 11, 2011, at 9:15 AM, Laser, Mary wrote: >>>>>>>>>>>> >>>>>>>>>>>>> The fix for the bug referenced below (#596) is in 1.3.0. >>>>>>>>>>>>> However, I don't think that bug is the same >>>>>>>>>>>>> problem Jeroen is having, based on what I see >>>>>>>>>>>>> below. The problem description for #596 >>>>>>>>> includes: >>>>>>>>>>>>> >>>>>>>>>>>>> On fedora/rhel system, ununpack agent get the >>>>>>>>>>>>> wrong mimetype for debian binary package, it set >>>>>>>>>>>>> debian binary packages as >>>>>>>>>>>>> application/x-7z-w-compressed, so pkgagent didn't >>>>>>>>>>>>> process these debian binary packages and cannot >>>>>>>>>>>>> get the >>>>>> package info. >>>>>>>>>>>>> >>>>>>>>>>>>> The problem below shows the pkgagent dying. >>>>>>>>>>>>> >>>>>>>>>>>>> Mary >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>>> -----Original Message----- >>>>>>>>>>>>>> From: Gobeille, Robert >>>>>>>>>>>>>> Sent: Friday, February 11, 2011 7:23 AM >>>>>>>>>>>>>> To: Jeroen Baten; Laser, Mary >>>>>>>>>>>>>> Cc: fossology@fossology.org >>>>>>>>>>>>>> Subject: Re: [FOSSology] Weird scan of >>>>>>>>>>>>>> fossology-1.3.0.tar.gz >>>>>>>>>>>>> fails >>>>>>>>>>>>>> Package Scan >>>>>>>>>>>>>> >>>>>>>>>>>>>> This was supposed to be fixed on January 13. >>>>>>>>>>>>>> http://bugs.linux-foundation.org/show_bug.cgi?id >>>>>>>>>>>>>> =596 >>>>>>>>>>>>>> >>>>>>>>>>>>>> 1.3.0 was released January 19. Mary, did this >>>>>>>>>>>>>> fix get into >>>> 1.3.0? >>>>>>>>>>>>>> >>>>>>>>>>>>>> Bob Gobeille >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Feb 11, 2011, at 1:47 AM, Jeroen Baten wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Don't know if this helps, but this is a >>>>>>>>>>>>>>> relevant piece of the >>>>>>>>>>>>> log: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> 2011-02-10 13:42:27 scheduler[716] : Child[15] >>>>>>>>>>>>>>> 'agent=pkgagent host=localhost ' >>>>>>>>>>>>>>> state=SPAWNED(4) @ Thu Feb >>>>>>>>>>>>>>> 10 13:42:27 2011 >>>>>>>>>>>>>>> 2011-02-10 13:42:27 scheduler[716] : Child[15] >>>>>>>>>>>>>>> 'agent=pkgagent host=localhost ' >>>>>>>>>>>>>>> state=READY(5) @ Thu Feb 10 >>>>>>>>>>>>>>> 13:42:27 2011 >>>>>>>>>>>>>>> 2011-02-10 13:42:27 scheduler[716] : Child[6] >>>>>>>>>>>>>>> 'agent=buckets host=localhost ' state=FREE(1) >>>>>>>>>>>>>>> @ Thu Feb >>>>>>>>>>>>>>> 10 13:42:27 2011 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : ERROR: >>>>>>>>>>>>>>> Child[15] died >>>>>>>>>>>>>> prematurely >>>>>>>>>>>>>>> (was state RUNNING, signal was 11) >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : >>>>>>>>>>>>>>> Thread 15: >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : PID: 1736 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Pipes: in=8->9 >> / >>>>>>>>>>>>> out=13- >>>>>>>>>>>>>>> 12 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Attr: >>>>>>>>>>>>> 'agent=pkgagent >>>>>>>>>>>>>>> host=localhost ' >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Command: >>>>>>>>>>>>>>> '/usr/local/lib/fossology/agents/pkgagent' >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Parm: >>>>>>>>>>>>> 'pfile_pk="87202" >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>>> >>>> >> pfilename="BE9651C3D92B8A76FD3D0C03FF5597411E8FF860.A0FD8E3774FED >>>>>>>>>>> 62A >>>>>>>>>>>>> BEB >>>>>>>>>>>>>> 6C2CDA3362862.2639" mimetype="application/x-rpm" >>>>>>>>>>>>>>> ' >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Heartbeat: Thu >>>> Feb 10 >>>>>>>>>>>>>> 13:45:42 >>>>>>>>>>>>>>> 2011 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : State: Thu >> Feb 10 >>>>>>>>>>>>>> 13:45:42 >>>>>>>>>>>>>>> 2011 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Status: 6 >>>> (RUNNING) >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Spawn: 1 at >> Thu >>>> Feb >>>>>>>>>>>>> 10 >>>>>>>>>>>>>>> 13:42:27 2011 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : DB: >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : IsDB: 2 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : DBJobKey: 128 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : DBMSQrow: 1 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : DBagent: 29 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Child[15] >>>>>>>>>>>>>>> 'agent=pkgagent host=localhost ' >>>>>>>>>>>>>>> state=FREEING(2) @ Thu Feb >>>>>>>>>>>>>>> 10 13:45:52 2011 >>>>>>>>>>>>>>> 2011-02-10 13:45:52 scheduler[716] : Child[15] >>>>>>>>>>>>>>> 'agent=pkgagent host=localhost ' state=FREE(1) >>>>>>>>>>>>>>> @ Thu Feb >>>>>>>>>>>>>>> 10 >>>>>>>>>>>>>>> 13:45:52 2011 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Thu, 2011-02-10 at 11:37 -0700, Bob Gobeille >> wrote: >>>>>>>>>>>>>>>> Hi Jeroen, >>>>>>>>>>>>>>>> The best place to see why an agent failed is >>>>>>>>>>>>>>>> in the fossology >>>>>>>>>>>>> log >>>>>>>>>>>>>> file (/var/log/fossology/fossology.log). >>>>>>>>>>>>>>>> If you look there and see a "spawning too fast" >>>>>>>>>>>>>>>> error, that is >>>>>>>>>>>>> a >>>>>>>>>>>>>> known (major) bug. See: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> http://bugs.linux-foundation.org/show_bug.cgi >>>>>>>>>>>>>>>> ?id= >>>>>>>>>>>>>>>> 636 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> If it is something different than what is in >>>>>>>>>>>>>>>> the bug report, >>>>>>>>>>>>> please >>>>>>>>>>>>>> let us know. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>> Bob Gobeille >>>>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >> _______________________________________________ >>>>>>>>>>> fossology mailing list fossology@fossology.org >>>>>>>>>>> http://fossology.org/mailman/listinfo/fossology >>>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> fossology mailing list >>>>>> fossology@fossology.org >>>>>> http://fossology.org/mailman/listinfo/fossology >>> > > _______________________________________________ > fossology mailing list > fossology@fossology.org > http://fossology.org/mailman/listinfo/fossology _______________________________________________ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
