Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
Hi Jeroen, In my test system(Debian Lenny), this file mimetype didn't recognize as ' application/x-rpm ', what's your system os? Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Ma, Dong (Vincent, ES-Best-Shore- Services-China-BJ) Sent: Tuesday, February 15, 2011 3:56 PM To: Jeroen Baten Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Thanks Jeroen, I'll use this for debugging. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:54 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan So it is! Files associated with be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33 62862.2639 1: Folder: Software Repository/ Fossology_1_3_0/ Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/ RedHat.tar.gz/ RedHat.tar/ RedHat/ perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm kind regards, On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Jeroen, I think you can use the 'search' menu, select the 'Repository' micro- menu, enter the repository file name 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3 362862.2639' to search. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:45 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Hello Vincent, Sending the file is easy. Knowing what it used to be is a little hardder. I guess I need a sql query for that info? kind regards, On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, It's weird if the file is not an rpm file, the file mimetype should not be ' application/x-rpm '. Can you send me the original file or the path in fossology-1.3.0.tar.gz? Then I can debug this issue. Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Jeroen Baten Sent: Tuesday, February 15, 2011 3:06 PM To: Gobeille, Robert Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan root cause analyses: it is not an rpm file: [root@htn-ws-3092 jbaten]# /usr/local/lib/fossology/agents/pkgagent -v /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 error: /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 cannot be read or is not an RPM. [root@htn-ws-3092 jbaten]# file /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639: ASCII English text [root@htn-ws-3092 jbaten]# head -30l /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 ## ### # $Id: Makefile.PL.rpm,v 1.1.2.1 2007/01/10 18:01:48 richm% stanfordalumni.org Exp $ # # The contents of this file are subject to the Mozilla Public License # Version 1.1 (the License); you may not use this file except in # compliance with the License. You may obtain a copy of the License at # http://www.mozilla.org/MPL/ # # Software distributed under the License is distributed on an AS IS # basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the # License for the specific language governing rights and limitations # under the License. # # The Original Code is PerLDAP. The Initial Developer of the Original # Code is Netscape Communications Corp. and Clayton Donley. Portions # created by Netscape are Copyright (C) Netscape Communications # Corp., portions created by Clayton Donley are Copyright (C) Clayton
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
Fedora 14 On Tue, 2011-02-15 at 08:11 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, In my test system(Debian Lenny), this file mimetype didn't recognize as ' application/x-rpm ', what's your system os? Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Ma, Dong (Vincent, ES-Best-Shore- Services-China-BJ) Sent: Tuesday, February 15, 2011 3:56 PM To: Jeroen Baten Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Thanks Jeroen, I'll use this for debugging. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:54 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan So it is! Files associated with be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33 62862.2639 1: Folder: Software Repository/ Fossology_1_3_0/ Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/ RedHat.tar.gz/ RedHat.tar/ RedHat/ perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm kind regards, On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Jeroen, I think you can use the 'search' menu, select the 'Repository' micro- menu, enter the repository file name 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3 362862.2639' to search. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:45 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Hello Vincent, Sending the file is easy. Knowing what it used to be is a little hardder. I guess I need a sql query for that info? kind regards, On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, It's weird if the file is not an rpm file, the file mimetype should not be ' application/x-rpm '. Can you send me the original file or the path in fossology-1.3.0.tar.gz? Then I can debug this issue. Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Jeroen Baten Sent: Tuesday, February 15, 2011 3:06 PM To: Gobeille, Robert Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan root cause analyses: it is not an rpm file: [root@htn-ws-3092 jbaten]# /usr/local/lib/fossology/agents/pkgagent -v /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 error: /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 cannot be read or is not an RPM. [root@htn-ws-3092 jbaten]# file /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639: ASCII English text [root@htn-ws-3092 jbaten]# head -30l /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 ## ### # $Id: Makefile.PL.rpm,v 1.1.2.1 2007/01/10 18:01:48 richm% stanfordalumni.org Exp $ # # The contents of this file are subject to the Mozilla Public License # Version 1.1 (the License); you may not use this file except in # compliance with the License. You may obtain a copy of the License at # http://www.mozilla.org/MPL/ # # Software distributed under the License is distributed on an AS IS # basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the # License for the specific language governing rights and limitations # under the License. # # The Original Code is PerLDAP
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
Jeroen, I didn't have an Fedora14 system for now, I need create one for testing. I can give you a workaround about this issue, you can use this sql to update your database, and rerun pkgagent. 'UPDATE pfile SET pfile_mimetypefk=NULL WHERE pfile_pk=$pfile_pk; ' $pfile_pk is the pfile ID about this file, you can find from [info] page about this file. Thanks, Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 4:13 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Fedora 14 On Tue, 2011-02-15 at 08:11 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, In my test system(Debian Lenny), this file mimetype didn't recognize as ' application/x-rpm ', what's your system os? Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Ma, Dong (Vincent, ES-Best-Shore- Services-China-BJ) Sent: Tuesday, February 15, 2011 3:56 PM To: Jeroen Baten Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Thanks Jeroen, I'll use this for debugging. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:54 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan So it is! Files associated with be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33 62862.2639 1: Folder: Software Repository/ Fossology_1_3_0/ Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/ RedHat.tar.gz/ RedHat.tar/ RedHat/ perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm kind regards, On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Jeroen, I think you can use the 'search' menu, select the 'Repository' micro- menu, enter the repository file name 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3 362862.2639' to search. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:45 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Hello Vincent, Sending the file is easy. Knowing what it used to be is a little hardder. I guess I need a sql query for that info? kind regards, On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, It's weird if the file is not an rpm file, the file mimetype should not be ' application/x-rpm '. Can you send me the original file or the path in fossology-1.3.0.tar.gz? Then I can debug this issue. Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Jeroen Baten Sent: Tuesday, February 15, 2011 3:06 PM To: Gobeille, Robert Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan root cause analyses: it is not an rpm file: [root@htn-ws-3092 jbaten]# /usr/local/lib/fossology/agents/pkgagent -v /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 error: /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 cannot be read or is not an RPM. [root@htn-ws-3092 jbaten]# file /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639: ASCII English text [root@htn-ws-3092 jbaten]# head -30l /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
Hello Vincent, This issue is not that important that I need a workaround. I just tested the fossology program with its own tar file. I just thought I mention the bug when it occured. kind regards, On Tue, 2011-02-15 at 08:31 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Jeroen, I didn't have an Fedora14 system for now, I need create one for testing. I can give you a workaround about this issue, you can use this sql to update your database, and rerun pkgagent. 'UPDATE pfile SET pfile_mimetypefk=NULL WHERE pfile_pk=$pfile_pk; ' $pfile_pk is the pfile ID about this file, you can find from [info] page about this file. Thanks, Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 4:13 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Fedora 14 On Tue, 2011-02-15 at 08:11 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, In my test system(Debian Lenny), this file mimetype didn't recognize as ' application/x-rpm ', what's your system os? Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Ma, Dong (Vincent, ES-Best-Shore- Services-China-BJ) Sent: Tuesday, February 15, 2011 3:56 PM To: Jeroen Baten Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Thanks Jeroen, I'll use this for debugging. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:54 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan So it is! Files associated with be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33 62862.2639 1: Folder: Software Repository/ Fossology_1_3_0/ Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/ RedHat.tar.gz/ RedHat.tar/ RedHat/ perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm kind regards, On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Jeroen, I think you can use the 'search' menu, select the 'Repository' micro- menu, enter the repository file name 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3 362862.2639' to search. Vincent -Original Message- From: Jeroen Baten [mailto:jba...@onvz.nl] Sent: Tuesday, February 15, 2011 3:45 PM To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) Cc: Gobeille, Robert; fossology@fossology.org Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan Hello Vincent, Sending the file is easy. Knowing what it used to be is a little hardder. I guess I need a sql query for that info? kind regards, On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ) wrote: Hi Jeroen, It's weird if the file is not an rpm file, the file mimetype should not be ' application/x-rpm '. Can you send me the original file or the path in fossology-1.3.0.tar.gz? Then I can debug this issue. Thanks, Vincent -Original Message- From: fossology-boun...@fossology.org [mailto:fossology- boun...@fossology.org] On Behalf Of Jeroen Baten Sent: Tuesday, February 15, 2011 3:06 PM To: Gobeille, Robert Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan root cause analyses: it is not an rpm file: [root@htn-ws-3092 jbaten]# /usr/local/lib/fossology/agents/pkgagent -v /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 error: /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0 c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 cannot be read or is not an RPM. [root@htn-ws-3092 jbaten]# file /srv/fossology/repository/localhost/files/be/96/51/be9651c 3d92 b8 a76f d3d0
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
Don't know if this helps, but this is a relevant piece of the log: 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=SPAWNED(4) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=READY(5) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:42:27 scheduler[716] : Child[6] 'agent=buckets host=localhost ' state=FREE(1) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:45:52 scheduler[716] : ERROR: Child[15] died prematurely (was state RUNNING, signal was 11) 2011-02-10 13:45:52 scheduler[716] : Thread 15: 2011-02-10 13:45:52 scheduler[716] : PID: 1736 2011-02-10 13:45:52 scheduler[716] : Pipes: in=8-9 / out=13-12 2011-02-10 13:45:52 scheduler[716] : Attr: 'agent=pkgagent host=localhost ' 2011-02-10 13:45:52 scheduler[716] : Command: '/usr/local/lib/fossology/agents/pkgagent' 2011-02-10 13:45:52 scheduler[716] : Parm: 'pfile_pk=87202 pfilename=BE9651C3D92B8A76FD3D0C03FF5597411E8FF860.A0FD8E3774FED62ABEB6C2CDA3362862.2639 mimetype=application/x-rpm ' 2011-02-10 13:45:52 scheduler[716] : Heartbeat: Thu Feb 10 13:45:42 2011 2011-02-10 13:45:52 scheduler[716] : State: Thu Feb 10 13:45:42 2011 2011-02-10 13:45:52 scheduler[716] : Status: 6 (RUNNING) 2011-02-10 13:45:52 scheduler[716] : Spawn: 1 at Thu Feb 10 13:42:27 2011 2011-02-10 13:45:52 scheduler[716] : DB: 2011-02-10 13:45:52 scheduler[716] : IsDB: 2 2011-02-10 13:45:52 scheduler[716] : DBJobKey: 128 2011-02-10 13:45:52 scheduler[716] : DBMSQrow: 1 2011-02-10 13:45:52 scheduler[716] : DBagent: 29 2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=FREEING(2) @ Thu Feb 10 13:45:52 2011 2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=FREE(1) @ Thu Feb 10 13:45:52 2011 On Thu, 2011-02-10 at 11:37 -0700, Bob Gobeille wrote: Hi Jeroen, The best place to see why an agent failed is in the fossology log file (/var/log/fossology/fossology.log). If you look there and see a spawning too fast error, that is a known (major) bug. See: http://bugs.linux-foundation.org/show_bug.cgi?id=636 If it is something different than what is in the bug report, please let us know. Thanks, Bob Gobeille On Feb 10, 2011, at 5:49 AM, Jeroen Baten wrote: This is the info I found. Maybe it helps you people. Kind regards, Jeroen Baten jq_pk 128 jq_job_fk 108 job_namePackage Scan jq_type pkgagent job_priority0 jq_args SELECT pfile_pk as pfile_pk, pfile_sha1 || '.' || pfile_md5 || '.' || pfile_size AS pfilename, mimetype_name AS mimetype FROM uploadtree INNER JOIN pfile ON upload_fk = '7' INNER JOIN mimetype ON (mimetype_pk = '1' OR mimetype_pk = '2' OR mimetype_pk = '3') AND uploadtree.pfile_fk = pfile_pk AND pfile.pfile_mimetypefk = mimetype.mimetype_pk AND pfile_pk NOT IN (SELECT pkg_rpm.pfile_fk FROM pkg_rpm) AND pfile_pk NOT IN (SELECT pkg_deb.pfile_fk FROM pkg_deb) LIMIT 5000; jq_runonpfile pfile_pk jq_starttime2011-02-10 13:45:42.098366+01 jq_endtime 2011-02-10 13:45:52.166725+01 jq_end_bits 2 jq_endtext Failed: Failed: Agent terminated prematurely jq_elapsedtime 00:02:44 jq_processedtime00:00:01 jq_itemsprocessed 29 job_submitter job_queued 2011-02-10 13:40:11.799265+01 job_email_notifyfossy job_upload_fk 7 depends on 40 required by 127, 129 ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
This was supposed to be fixed on January 13. http://bugs.linux-foundation.org/show_bug.cgi?id=596 1.3.0 was released January 19. Mary, did this fix get into 1.3.0? Bob Gobeille On Feb 11, 2011, at 1:47 AM, Jeroen Baten wrote: Don't know if this helps, but this is a relevant piece of the log: 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=SPAWNED(4) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=READY(5) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:42:27 scheduler[716] : Child[6] 'agent=buckets host=localhost ' state=FREE(1) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:45:52 scheduler[716] : ERROR: Child[15] died prematurely (was state RUNNING, signal was 11) 2011-02-10 13:45:52 scheduler[716] : Thread 15: 2011-02-10 13:45:52 scheduler[716] : PID: 1736 2011-02-10 13:45:52 scheduler[716] : Pipes: in=8-9 / out=13-12 2011-02-10 13:45:52 scheduler[716] : Attr: 'agent=pkgagent host=localhost ' 2011-02-10 13:45:52 scheduler[716] : Command: '/usr/local/lib/fossology/agents/pkgagent' 2011-02-10 13:45:52 scheduler[716] : Parm: 'pfile_pk=87202 pfilename=BE9651C3D92B8A76FD3D0C03FF5597411E8FF860.A0FD8E3774FED62ABEB6C2CDA3362862.2639 mimetype=application/x-rpm ' 2011-02-10 13:45:52 scheduler[716] : Heartbeat: Thu Feb 10 13:45:42 2011 2011-02-10 13:45:52 scheduler[716] : State: Thu Feb 10 13:45:42 2011 2011-02-10 13:45:52 scheduler[716] : Status: 6 (RUNNING) 2011-02-10 13:45:52 scheduler[716] : Spawn: 1 at Thu Feb 10 13:42:27 2011 2011-02-10 13:45:52 scheduler[716] : DB: 2011-02-10 13:45:52 scheduler[716] : IsDB: 2 2011-02-10 13:45:52 scheduler[716] : DBJobKey: 128 2011-02-10 13:45:52 scheduler[716] : DBMSQrow: 1 2011-02-10 13:45:52 scheduler[716] : DBagent: 29 2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=FREEING(2) @ Thu Feb 10 13:45:52 2011 2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=FREE(1) @ Thu Feb 10 13:45:52 2011 On Thu, 2011-02-10 at 11:37 -0700, Bob Gobeille wrote: Hi Jeroen, The best place to see why an agent failed is in the fossology log file (/var/log/fossology/fossology.log). If you look there and see a spawning too fast error, that is a known (major) bug. See: http://bugs.linux-foundation.org/show_bug.cgi?id=636 If it is something different than what is in the bug report, please let us know. Thanks, Bob Gobeille ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
The fix for the bug referenced below (#596) is in 1.3.0. However, I don't think that bug is the same problem Jeroen is having, based on what I see below. The problem description for #596 includes: On fedora/rhel system, ununpack agent get the wrong mimetype for debian binary package, it set debian binary packages as application/x-7z-w-compressed, so pkgagent didn't process these debian binary packages and cannot get the package info. The problem below shows the pkgagent dying. Mary -Original Message- From: Gobeille, Robert Sent: Friday, February 11, 2011 7:23 AM To: Jeroen Baten; Laser, Mary Cc: fossology@fossology.org Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan This was supposed to be fixed on January 13. http://bugs.linux-foundation.org/show_bug.cgi?id=596 1.3.0 was released January 19. Mary, did this fix get into 1.3.0? Bob Gobeille On Feb 11, 2011, at 1:47 AM, Jeroen Baten wrote: Don't know if this helps, but this is a relevant piece of the log: 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=SPAWNED(4) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=READY(5) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:42:27 scheduler[716] : Child[6] 'agent=buckets host=localhost ' state=FREE(1) @ Thu Feb 10 13:42:27 2011 2011-02-10 13:45:52 scheduler[716] : ERROR: Child[15] died prematurely (was state RUNNING, signal was 11) 2011-02-10 13:45:52 scheduler[716] : Thread 15: 2011-02-10 13:45:52 scheduler[716] : PID: 1736 2011-02-10 13:45:52 scheduler[716] : Pipes: in=8-9 / out=13- 12 2011-02-10 13:45:52 scheduler[716] : Attr: 'agent=pkgagent host=localhost ' 2011-02-10 13:45:52 scheduler[716] : Command: '/usr/local/lib/fossology/agents/pkgagent' 2011-02-10 13:45:52 scheduler[716] : Parm: 'pfile_pk=87202 pfilename=BE9651C3D92B8A76FD3D0C03FF5597411E8FF860.A0FD8E3774FED62ABEB 6C2CDA3362862.2639 mimetype=application/x-rpm ' 2011-02-10 13:45:52 scheduler[716] : Heartbeat: Thu Feb 10 13:45:42 2011 2011-02-10 13:45:52 scheduler[716] : State: Thu Feb 10 13:45:42 2011 2011-02-10 13:45:52 scheduler[716] : Status: 6 (RUNNING) 2011-02-10 13:45:52 scheduler[716] : Spawn: 1 at Thu Feb 10 13:42:27 2011 2011-02-10 13:45:52 scheduler[716] : DB: 2011-02-10 13:45:52 scheduler[716] : IsDB: 2 2011-02-10 13:45:52 scheduler[716] : DBJobKey: 128 2011-02-10 13:45:52 scheduler[716] : DBMSQrow: 1 2011-02-10 13:45:52 scheduler[716] : DBagent: 29 2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=FREEING(2) @ Thu Feb 10 13:45:52 2011 2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent host=localhost ' state=FREE(1) @ Thu Feb 10 13:45:52 2011 On Thu, 2011-02-10 at 11:37 -0700, Bob Gobeille wrote: Hi Jeroen, The best place to see why an agent failed is in the fossology log file (/var/log/fossology/fossology.log). If you look there and see a spawning too fast error, that is a known (major) bug. See: http://bugs.linux-foundation.org/show_bug.cgi?id=636 If it is something different than what is in the bug report, please let us know. Thanks, Bob Gobeille ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan
Hi Jeroen, The best place to see why an agent failed is in the fossology log file (/var/log/fossology/fossology.log). If you look there and see a spawning too fast error, that is a known (major) bug. See: http://bugs.linux-foundation.org/show_bug.cgi?id=636 If it is something different than what is in the bug report, please let us know. Thanks, Bob Gobeille On Feb 10, 2011, at 5:49 AM, Jeroen Baten wrote: This is the info I found. Maybe it helps you people. Kind regards, Jeroen Baten jq_pk 128 jq_job_fk 108 job_name Package Scan jq_type pkgagent job_priority 0 jq_args SELECT pfile_pk as pfile_pk, pfile_sha1 || '.' || pfile_md5 || '.' || pfile_size AS pfilename, mimetype_name AS mimetype FROM uploadtree INNER JOIN pfile ON upload_fk = '7' INNER JOIN mimetype ON (mimetype_pk = '1' OR mimetype_pk = '2' OR mimetype_pk = '3') AND uploadtree.pfile_fk = pfile_pk AND pfile.pfile_mimetypefk = mimetype.mimetype_pk AND pfile_pk NOT IN (SELECT pkg_rpm.pfile_fk FROM pkg_rpm) AND pfile_pk NOT IN (SELECT pkg_deb.pfile_fk FROM pkg_deb) LIMIT 5000; jq_runonpfile pfile_pk jq_starttime 2011-02-10 13:45:42.098366+01 jq_endtime2011-02-10 13:45:52.166725+01 jq_end_bits 2 jq_endtextFailed: Failed: Agent terminated prematurely jq_elapsedtime00:02:44 jq_processedtime 00:00:01 jq_itemsprocessed 29 job_submitter job_queued2011-02-10 13:40:11.799265+01 job_email_notify fossy job_upload_fk 7 depends on40 required by 127, 129 ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology ___ fossology mailing list fossology@fossology.org http://fossology.org/mailman/listinfo/fossology
