Hi,
     $ python -c "from invenio.search_engine import search_pattern; \
       print search_pattern(p='POETRY', f='980__a')"
This return results for a demo site collection as well as for our
defined collection! (intbitset([105, 106, 107, 108, 109, ..., 5440390,
5440391, 5440392, 5440393, 5440394]))
OK, so the problem seems to be with the `collection' index definition.
You can double check in the BibIndex Admin interface to see how it is
linked, or you can use the following set of SQL statements:

In the BibIndex Admin interface the 'collection' index seem to be
correct defined with the 'collection' field, but as mentioned the index
dosn't contain entries (0 records, 0.00 MB).

Running the SQL Statements, I get exactly the same result as follows.

$ /opt/invenio/bin/dbexec -i

mysql>  SELECT id_field FROM idxINDEX_field, idxINDEX WHERE id_idxINDEX=id AND 
name='collection';
+----------+
| id_field |
+----------+
|       10 |
+----------+
1 row in set (0.00 sec)

mysql>  SELECT * FROM field_tag, tag WHERE id_field=10 AND id_tag=tag.id;
+----------+--------+-------+----+-----------------------+--------+
| id_field | id_tag | score | id | name                  | value  |
+----------+--------+-------+----+-----------------------+--------+
|       10 |     11 |   100 | 11 | collection identifier | 980__% |
+----------+--------+-------+----+-----------------------+--------+
1 row in set (0.02 sec)

This shows that `collection' index is related to field ID 10 that is
related to any 980__* tag, which is what we want.

Is everything alright from this point of view?  If yes, you can try to
list what terms the `collection' word and phrase indexes contain:

   $ echo "SELECT term FROM idxWORD10F" | /opt/invenio/bin/dbexec
   $ echo "SELECT term FROM idxPHRASE10F" | /opt/invenio/bin/dbexec

This result looks a little bit strange for me, because I execpt primary
our collection terms, but I get this: (but maybe it's right, because on
our other installation I got the same)

echo "SELECT term FROM idxWORD10F" | dbexec
 ->
 term
1833
1911
1928
1948
1952
1962
1967
1968
1969
1972
1973
1976
1977
1981
1982
1985
1986
1987
1989
1992
1996
1998
1999
2000
2001
2002
701
701-762
762

$ echo "SELECT term FROM idxPHRASE10F" | dbexec
->
term
1833
1911
1928
1948
1952
1962
1967
1968
1969
1972
1973
1976
1977
1981
1982
1985
1986
1987
1989
1992
1996
1998
1999
2000
2001
2002
701


2010-11-26 12:24:12 -->  Input file 
'/cdsware/home/cdsware/scopus_simple_test.xml', input mode 'replace_or_insert'.
2010-11-26 12:24:12 -->     Error during the creation_new_record function : (1062, 
"Duplicate entry '0' for key 1")
How does `scopus_simple_test.xml' look like?

You can use `bibupload -v9 -ir scopus_simple_test.xml' to see more
verbose messages to debug this issue.


The Testfiles (a very, very simple and normal)  are attached, also the
debug messages. It seems to fail, while checking for Duplicate and
return a TypeError Message. That's strange because the records
definitely  not exists in invenio, we testet it with various new
records. I'm not sure, if this problem is related to the collection
problem, but it could be, because we have this problem after the
mentioned failed bibindex/bibindex repair.

Best Regards
Cornelia

------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDirig Dr. Karl Eugen Huthmacher
Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),
Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Prof. Dr. Sebastian M. Schmidt
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
<?xml version="1.0" ?>
<!--Marc XML VDB Document-->
<collection xmlns="http://www.loc.gov/MARC21/slim";>
<record>
   <datafield tag="100" ind1=" " ind2=" ">
      <subfield code="a">Plott, Cornelia</subfield>
   </datafield>
   <datafield tag="245" ind1=" " ind2=" ">
      <subfield code="a">Testdatensatz</subfield>
   </datafield>
   <datafield tag="980" ind1=" " ind2=" ">
      <subfield code="a">SCOPUS</subfield>
   </datafield>
</record>
</collection>
<?xml version="1.0" ?>
<!--Marc XML VDB Document-->
<collection xmlns="http://www.loc.gov/MARC21/slim";>
<record xmlns:ce="http://www.elsevier.com/xml/ani/common";>
   <datafield tag="017" ind1=" " ind2=" ">
      <subfield code="a">Elsevier</subfield>
      <subfield code="b">Copyright 2008 Elsevier B.V., All rights reserved.</subfield>
   </datafield>
   <datafield tag="022" ind1=" " ind2=" ">
      <subfield code="a">00236438</subfield>
      <subfield code="b">print</subfield>
   </datafield>
   <datafield tag="035" ind1=" " ind2=" ">
      <subfield code="a">SCP:33847073788</subfield>
   </datafield>
   <datafield tag="037" ind1=" " ind2=" ">
      <subfield code="a">SGR:33847073788</subfield>
      <subfield code="b">SGR</subfield>
   </datafield>
   <datafield tag="040" ind1=" " ind2=" ">
      <subfield code="a">SCP</subfield>
      <subfield code="b">eng</subfield>
      <subfield code="c">DE-Juel1</subfield>
   </datafield>
   <datafield tag="041" ind1=" " ind2=" ">
      <subfield code="a">eng</subfield>
      <subfield code="b">eng</subfield>
   </datafield>
   <datafield tag="044" ind1=" " ind2=" ">
      <subfield code="a">gbr</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">1106</subfield>
      <subfield code="2">ASJC</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">2201</subfield>
      <subfield code="2">ASJC</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">99</subfield>
      <subfield code="2">CABSCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">631.1</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">641.1</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">741.1</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">802.2</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">804.1</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">811.0.3</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">815.1.1</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">821.0</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">821.4</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">931.2</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="084" ind1=" " ind2=" ">
      <subfield code="a">944.6</subfield>
      <subfield code="2">CPXCLASS</subfield>
   </datafield>
   <datafield tag="100" ind1=" " ind2=" ">
      <subfield code="a">Raina C.</subfield>
      <subfield code="0">8341768600</subfield>
   </datafield>
   <datafield tag="245" ind1=" " ind2=" ">
      <subfield code="a">A comparative study of Indian rice starches using different modification model solutions</subfield>
   </datafield>
   <datafield tag="260" ind1=" " ind2=" ">
      <subfield code="c">2007</subfield>
      <subfield code="m">06</subfield>
   </datafield>
   <ref-publicationyear first="1996"/>
   <datafield tag="440" ind1="0" ind2=" ">
      <subfield code="a">LWT - Food Science and Technology</subfield>
      <subfield code="s">LWT - Food Sci. Technol.</subfield>
      <subfield code="v">40</subfield>
      <subfield code="x">00236438</subfield>
   </datafield>
   <datafield tag="520" ind1=" " ind2=" ">
      <subfield code="a">Starches extracted from rice flour from broken kernels of three rice cultivars (PUSA-44, PR-106 and PR-114) have been selected for modification studies due to their varied amylose content. Model solutions with different types and concentrations of modifying agents were prepared for comparative study of effect of amylose variation among the varieties and also individual and combined effect of modifying agents used. There was an increase in hot paste viscosity at 90 °C in modified starches whereas, cold paste viscosity decreased upon modification. A greater effect was observed with in dual modification of starches. The total set back was significantly lower in modified starches indicating the decreased retro-gradation of starch gels upon modification. The DSC results showed decreases in ?H, To, Tp, and Tc, indicating that hydroxypropylation cross-linking and acetylation affect the structure of starches granules, requiring less heat for gelatinization. Pasting and thermal properties of PUSA-44 were significantly different from those of PR-106 and PR-114, probably due to relative higher amylose contents in the former. As observed in this study, bi-functional modifying agents can reduce the extent of cross-linking. Acetylation modified the morphology of the starch. However, hydroxypropylation cross-linking and dual modification retained the original structure with little modification. © 2006 Swiss Society of Food Science and Technology.</subfield>
   </datafield>
   <datafield tag="546" ind1=" " ind2=" ">
      <subfield code="a">eng</subfield>
   </datafield>
   <datafield tag="594" ind1=" " ind2=" ">
      <subfield code="a">ar</subfield>
   </datafield>
   <datafield tag="598" ind1=" " ind2=" ">
      <subfield code="a">Copyright 2008 Elsevier B.V., All rights reserved.</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Acetylation</subfield>
      <subfield code="2">CCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Differential scanning calorimetry</subfield>
      <subfield code="2">CCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Grain (agricultural product)</subfield>
      <subfield code="2">CCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Scanning electron microscopy</subfield>
      <subfield code="2">CCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Thermodynamic properties</subfield>
      <subfield code="2">CCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Viscosity</subfield>
      <subfield code="2">CCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Amyloses</subfield>
      <subfield code="2">CLU</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Modifying agents</subfield>
      <subfield code="2">CLU</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Rice cultivars</subfield>
      <subfield code="2">CLU</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Starch</subfield>
      <subfield code="2">CMH</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Acetylation</subfield>
      <subfield code="2">PCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Grain</subfield>
      <subfield code="2">PCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Scanning Electron Microscopy</subfield>
      <subfield code="2">PCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Starch</subfield>
      <subfield code="2">PCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Thermal Properties</subfield>
      <subfield code="2">PCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Viscosity</subfield>
      <subfield code="2">PCV</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Oryza sativa (indica cultivar-group)</subfield>
      <subfield code="2">SPC</subfield>
   </datafield>
   <datafield tag="650" ind1=" " ind2=" ">
      <subfield code="a">Pusa</subfield>
      <subfield code="2">SPC</subfield>
   </datafield>
   <datafield tag="653" ind1="1" ind2=" ">
      <subfield code="a">Acetylation</subfield>
      <subfield code="9">Author</subfield>
   </datafield>
   <datafield tag="653" ind1="1" ind2=" ">
      <subfield code="a">DSC</subfield>
      <subfield code="9">Author</subfield>
   </datafield>
   <datafield tag="653" ind1="1" ind2=" ">
      <subfield code="a">Dual modification</subfield>
      <subfield code="9">Author</subfield>
   </datafield>
   <datafield tag="653" ind1="1" ind2=" ">
      <subfield code="a">Hydroxypropylation cross-linking</subfield>
      <subfield code="9">Author</subfield>
   </datafield>
   <datafield tag="653" ind1="1" ind2=" ">
      <subfield code="a">RVA</subfield>
      <subfield code="9">Author</subfield>
   </datafield>
   <datafield tag="653" ind1="1" ind2=" ">
      <subfield code="a">SEM</subfield>
      <subfield code="9">Author</subfield>
   </datafield>
   <datafield tag="700" ind1=" " ind2=" ">
      <subfield code="a">Raina C.</subfield>
      <subfield code="0">8341768600</subfield>
      <subfield code="l">ind</subfield>
      <subfield code="u">Department of Food Technology S.L. Institute of Engineering and Technology, Longowal, Sangrur, Punjab 148 106, ind</subfield>
   </datafield>
   <datafield tag="700" ind1=" " ind2=" ">
      <subfield code="a">Singh S.</subfield>
      <subfield code="0">15849538900</subfield>
      <subfield code="l">ind</subfield>
      <subfield code="u">Department of Food Technology S.L. Institute of Engineering and Technology, Longowal, Sangrur, Punjab 148 106, ind</subfield>
   </datafield>
   <datafield tag="700" ind1=" " ind2=" ">
      <subfield code="a">Saxena D.</subfield>
      <subfield code="0">7101655057</subfield>
      <subfield code="l">ind</subfield>
      <subfield code="u">Department of Food Technology S.L. Institute of Engineering and Technology, Longowal, Sangrur, Punjab 148 106, ind</subfield>
   </datafield>
   <datafield tag="700" ind1=" " ind2=" ">
      <subfield code="a">Bawa A.</subfield>
      <subfield code="0">7003542065</subfield>
      <subfield code="l">ind</subfield>
      <subfield code="u">Defence Food Research Laboratory, Mysore, ind</subfield>
   </datafield>
   <datafield tag="901" ind1=" " ind2=" ">
      <subfield code="u">Forschungszentrum Jülich, Zentralbibliothek</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">SCP:33847073788</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">PII:S002364380600106X</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">CABS:2007057174</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">CPX:20070810438914</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">PUI:46275768</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">SCP:33847073788</subfield>
   </datafield>
   <datafield tag="970" ind1=" " ind2=" ">
      <subfield code="a">SGR:33847073788</subfield>
   </datafield>
   <datafield tag="980" ind1=" " ind2=" ">
      <subfield code="a">SCOPUS</subfield>
   </datafield>
   <datafield tag="999" ind1=" " ind2=" ">
      <subfield code="a">34</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Al Bayati S.H.;Lorenz K.;</subfield>
      <subfield code="t">Lebensmittel-Wissenschaft-und-Technologie (LWT)</subfield>
      <subfield code="p">163-167</subfield>
      <subfield code="v">8</subfield>
      <subfield code="n">4</subfield>
      <subfield code="y">1975</subfield>
      <subfield code="r">SGR:33645698412</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="r">SGR:33847041661</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Arisaka M.;Yoshii Y.;</subfield>
      <subfield code="t">Applied Glycosciences</subfield>
      <subfield code="p">1-7</subfield>
      <subfield code="v">41</subfield>
      <subfield code="n">1</subfield>
      <subfield code="y">1999</subfield>
      <subfield code="r">SGR:33847079703</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Aziz A.;Daik R.;Ghani M.A.;Daud N.I.K.;Yamin B.M.;</subfield>
      <subfield code="t">Malaysian Journal of Chemistry</subfield>
      <subfield code="p">048-054</subfield>
      <subfield code="v">6</subfield>
      <subfield code="n">1</subfield>
      <subfield code="y">2004</subfield>
      <subfield code="r">SGR:33847033927</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Champagne E.T.;</subfield>
      <subfield code="t">Cereal Food World</subfield>
      <subfield code="p">833-838</subfield>
      <subfield code="v">41</subfield>
      <subfield code="y">1996</subfield>
      <subfield code="r">SGR:0030359849</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Chatakanonda P.;Varavinit S.;Chinachoti P.;</subfield>
      <subfield code="t">LWT</subfield>
      <subfield code="p">276-284</subfield>
      <subfield code="v">33</subfield>
      <subfield code="n">4</subfield>
      <subfield code="y">2000</subfield>
      <subfield code="r">SGR:0013052146</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Cheng Y.L.;Mei L.T.;Kuo H.T.;</subfield>
      <subfield code="t">Cereal Chemistry</subfield>
      <subfield code="p">415-420</subfield>
      <subfield code="v">73</subfield>
      <subfield code="n">4</subfield>
      <subfield code="y">1996</subfield>
      <subfield code="r">SGR:0029911393</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Cheol Y.;Un-Hua P.;Kwan-Hwa P.;</subfield>
      <subfield code="t">Journal of Food Science</subfield>
      <subfield code="p">405-407</subfield>
      <subfield code="v">50</subfield>
      <subfield code="n">2</subfield>
      <subfield code="y">1993</subfield>
      <subfield code="r">SGR:0000517260</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Gonzalez Z.;Perez E..;</subfield>
      <subfield code="t">Starch/Stäerke</subfield>
      <subfield code="p">148-154</subfield>
      <subfield code="v">54</subfield>
      <subfield code="y">2002</subfield>
      <subfield code="r">SGR:0036530129</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Grant L.A.;</subfield>
      <subfield code="t">Cereal Chemistry</subfield>
      <subfield code="p">590-594</subfield>
      <subfield code="v">75</subfield>
      <subfield code="n">5</subfield>
      <subfield code="y">1998</subfield>
      <subfield code="r">SGR:0031669552</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Hoover R.;Sosulski F.;</subfield>
      <subfield code="t">Starch/Stäerke</subfield>
      <subfield code="p">397-404</subfield>
      <subfield code="v">37</subfield>
      <subfield code="y">1985</subfield>
      <subfield code="r">SGR:0000007891</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Jarowenko W.;</subfield>
      <subfield code="t">Modified starches: Properties and uses</subfield>
      <subfield code="p">55-77</subfield>
      <subfield code="y">1986</subfield>
      <subfield code="r">SGR:0003306811</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Jeong J.H.;Lee M.H.;Oh M..J.;</subfield>
      <subfield code="t">Korean Society of Food and Nutrition</subfield>
      <subfield code="p">244-250</subfield>
      <subfield code="v">23</subfield>
      <subfield code="n">2</subfield>
      <subfield code="y">1994</subfield>
      <subfield code="r">SGR:0347880931</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Juliano B.O.;</subfield>
      <subfield code="t">Cereal Food World</subfield>
      <subfield code="p">251-260</subfield>
      <subfield code="v">21</subfield>
      <subfield code="y">1992</subfield>
      <subfield code="r">SGR:33847056438</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Kurasawa H.;Kanauti Y.;Takei K.;Gawa S.;Okabe T.;Hoyakawa T.;</subfield>
      <subfield code="t">Journal of Agricultural and Biological Chemistry</subfield>
      <subfield code="p">1809-1813</subfield>
      <subfield code="v">36</subfield>
      <subfield code="n">10</subfield>
      <subfield code="y">1972</subfield>
      <subfield code="r">SGR:33847046180</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Lares M.;Perez E.;Gonzalez Z.;</subfield>
      <subfield code="t">Journal of Agriculture and Food Chemistry</subfield>
      <subfield code="p">2546-2549</subfield>
      <subfield code="v">45</subfield>
      <subfield code="y">1997</subfield>
      <subfield code="r">SGR:0642332191</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Liu H.;Lawrence R.;Corke H.;</subfield>
      <subfield code="t">Carbohydrate Polymers</subfield>
      <subfield code="p">183-289</subfield>
      <subfield code="v">4</subfield>
      <subfield code="y">1997</subfield>
      <subfield code="r">SGR:33847022485</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Morikawa K.;Nishinari K.;</subfield>
      <subfield code="t">Carbohydrates Polymer</subfield>
      <subfield code="p">241-247</subfield>
      <subfield code="v">43</subfield>
      <subfield code="y">2000</subfield>
      <subfield code="r">SGR:0343341665</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Nurul I.;Azemi B.M.N.M.;</subfield>
      <subfield code="t">Starch/Stäerke</subfield>
      <subfield code="p">461-465</subfield>
      <subfield code="v">47</subfield>
      <subfield code="n">12</subfield>
      <subfield code="y">1995</subfield>
      <subfield code="r">SGR:33847021693</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Pathama C.;Saiyavit V.;Pavinee C.;</subfield>
      <subfield code="t">Cereal Chemistry</subfield>
      <subfield code="p">315-319</subfield>
      <subfield code="v">77</subfield>
      <subfield code="n">3</subfield>
      <subfield code="y">2000</subfield>
      <subfield code="r">SGR:0034090136</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Rincon-Carles A.M.;Perez-Sira E.E.;Gonzalez-Parada Z.M.;Rodriguez-Gonzalez P.J.;</subfield>
      <subfield code="t">Journal of Food Science and Technology</subfield>
      <subfield code="p">306-309</subfield>
      <subfield code="v">30</subfield>
      <subfield code="y">1999</subfield>
      <subfield code="r">SGR:33847031558</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Rutenberg MM.;Solarek D.;</subfield>
      <subfield code="t">Starch chemistry and technology</subfield>
      <subfield code="p">311-</subfield>
      <subfield code="y">1984</subfield>
      <subfield code="r">SGR:0002617835</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Saartrat S.;Puttanlek C.;Rungsadthong V.;Uttapap D.;</subfield>
      <subfield code="t">Paste and gel properties of acetylated canna starches</subfield>
      <subfield code="y">2004</subfield>
      <subfield code="r">SGR:33847043340</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Scott J.M.;Hugh J.C.;Colin J.R.;</subfield>
      <subfield code="t">Starch/Stäerke</subfield>
      <subfield code="p">158-163</subfield>
      <subfield code="v">50</subfield>
      <subfield code="y">1998</subfield>
      <subfield code="r">SGR:0001416575</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Smith R.J.;</subfield>
      <subfield code="t">Starch chemistry and technology</subfield>
      <subfield code="p">569-635</subfield>
      <subfield code="y">1967</subfield>
      <subfield code="r">SGR:0000246452</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="r">SGR:33847070650</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="r">SGR:33847061099</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Tuschhoff J.V.;</subfield>
      <subfield code="t">Modified starches: Properties and uses</subfield>
      <subfield code="p">89-96</subfield>
      <subfield code="y">1986</subfield>
      <subfield code="r">SGR:0003819543</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Wattanachant S.;Muhamad S.K.S.;Mat Hashim D.;Rahman R.A.;</subfield>
      <subfield code="t">Songklanakarin Journal of Science and Technology</subfield>
      <subfield code="p">431-438</subfield>
      <subfield code="v">24</subfield>
      <subfield code="n">3</subfield>
      <subfield code="y">2002</subfield>
      <subfield code="r">SGR:33645188232</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Whistler R.L.;Daniel J.R.;</subfield>
      <subfield code="t">Food chemistry</subfield>
      <subfield code="p">69-137</subfield>
      <subfield code="y">1995</subfield>
      <subfield code="r">SGR:0003176543</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Wu Y.;Seib P.A.;</subfield>
      <subfield code="t">Cereal Chemistry</subfield>
      <subfield code="p">202-208</subfield>
      <subfield code="v">67</subfield>
      <subfield code="y">1990</subfield>
      <subfield code="r">SGR:0000613851</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Wurzburg O.B.;</subfield>
      <subfield code="t">Methods in carbohydrate chemistry</subfield>
      <subfield code="p">286-288</subfield>
      <subfield code="y">1964</subfield>
      <subfield code="r">SGR:0001821633</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Yeh A.I.;Li J.Y.;</subfield>
      <subfield code="t">Starch/Starke</subfield>
      <subfield code="p">17-21</subfield>
      <subfield code="v">48</subfield>
      <subfield code="n">1</subfield>
      <subfield code="y">1996</subfield>
      <subfield code="r">SGR:0002742262</subfield>
   </datafield>
   <datafield tag="999" ind1="C" ind2="5">
      <subfield code="m">Yeh A.I.;Yeh S.L.;</subfield>
      <subfield code="t">Cereal Chemistry</subfield>
      <subfield code="p">596-601</subfield>
      <subfield code="v">70</subfield>
      <subfield code="y">1993</subfield>
      <subfield code="r">SGR:0001063879</subfield>
   </datafield>
</record>
</collection>
submitting output:

[cdsware@zb0035 ~]$ bibupload -v9 -ir scopus_simple_test.xml
2010-11-29 12:39:04 --> argv=['/cdsware/cds-invenio/bin/bibupload', '-v9', 
'-ir', '/cdsware/home/cdsware/scopus_simple_test.xml']
2010-11-29 12:39:04 --> _OPTIONS={'notimechange': 0, 'tag': None, 'verbose': 1, 
'stage_to_start_from': 1, 'pretend': False, 'file_path': 
'/cdsware/home/cdsware/scopus_simple_test.xml', 'mode': 'replace_or_insert'}
2010-11-29 12:39:04 --> _TASK_PARAMS={'profile': [], 'task_stop_helper_fnc': 
None, 'verbose': 9, 'sleeptime': '', 'runtime_limit': None, 'priority': 0, 
'task_specific_name': '', 'version': '$Id$', 'user': '', 'task_name': 
'bibupload', 'runtime': '2010-11-29 12:39:04'}
2010-11-29 12:39:04 --> storing task options 
['/cdsware/cds-invenio/bin/bibupload', '-v9', '-ir', 
'/cdsware/home/cdsware/scopus_simple_test.xml']

2010-11-29 12:39:04 --> Task #7718 submitted.

-----------------------------------------------------------------------------------------------------------------
bibsched task log:

2010-11-29 12:43:33 --> argv=['/cdsware/cds-invenio/bin/bibupload', '-v9', 
'-ir', '/cdsware/home/cdsware/scopus_simple_test.xml']
2010-11-29 12:43:33 --> _OPTIONS={'notimechange': 0, 'tag': None, 'verbose': 1, 
'stage_to_start_from': 1, 'pretend': False, 'file_path': '/cdsware/home/cdswa
re/scopus_simple_test.xml', 'mode': 'replace_or_insert'}
2010-11-29 12:43:33 --> _TASK_PARAMS={'profile': [], 'task_stop_helper_fnc': 
None, 'verbose': 9, 'task_id': 7718, 'sleeptime': '', 'runtime_limit': None, 'pr
iority': 0, 'task_specific_name': '', 'version': '$Id$', 'user': '', 
'task_name': 'bibupload', 'runtime': '2010-11-29 12:43:33'}
2010-11-29 12:43:33 --> Task #7718 started.
2010-11-29 12:43:33 --> Updating task status to RUNNING.
2010-11-29 12:43:33 --> Input file 
'/cdsware/home/cdsware/scopus_simple_test.xml', input mode 'replace_or_insert'.
2010-11-29 12:43:33 --> STAGE 0:
2010-11-29 12:43:33 --> start preocessing
2010-11-29 12:43:33 --> Updating task progress to Reading XML input.
2010-11-29 12:43:33 -->    -Open XML marc: DONE
2010-11-29 12:43:33 --> Entering task_sleep_now_if_required with status=RUNNING
2010-11-29 12:43:33 --> Entering records loop
2010-11-29 12:43:33 --> Entering task_sleep_now_if_required with status=RUNNING
2010-11-29 12:43:33 --> Inserting into main database
2010-11-29 12:43:33 -->    -Tag 001 not found in the xml marc file.
2010-11-29 12:43:33 -->    -Tag SYSNO not found in the xml marc file.
2010-11-29 12:43:33 -->    -Tag EXTOAIID not found in the xml marc file.
2010-11-29 12:43:33 -->    -Tag SYSNO not found in the xml marc file.
2010-11-29 12:43:33 -->    -Check if the xml marc file is already in the 
database: DONE
2010-11-29 12:43:33 -->    Error during the creation_new_record function : 
(1062, "Duplicate entry '0' for key 1")
2010-11-29 12:43:33 --> Updating task status to ERROR.
2010-11-29 12:43:33 --> Task #7718 finished. [ERROR]

-----------------------------------------------------------------------------------------------------------------
invenio error log / mail:

The following problem occurred on <http://zb0035.zb.kfa-juelich.de> (CDS 
Invenio 0.99.90.20100628)

>> >> 2010-11-29 12:43:33 -> TypeError: int argument required
>>> >>> User details
No client information available

>>> >>> Traceback details
Traceback (most recent call last):
  File "/usr/lib/python2.4/site-packages/invenio/bibtask.py", line 817, in 
_task_run
    if callable(task_run_fnc) and task_run_fnc():
  File "/usr/lib/python2.4/site-packages/invenio/bibupload.py", line 1976, in 
task_run_core
    pretend=task_get_option('pretend'))
  File "/usr/lib/python2.4/site-packages/invenio/bibupload.py", line 216, in 
bibupload
    write_message("   -Creation of a new record id (%d): DONE" % rec_id, 
verbose=2)
TypeError: int argument required
Locals by frame, innermost last

>>>> >>>> Frame ? in /cdsware/cds-invenio/bin/bibupload at line 55
*******************************************************************************
        52     import sys
        53     sys.exit(1)
        54 
---->   55 main()
*******************************************************************************
                __builtins__ =  "<module '__builtin__' (built-in)>"
                    __name__ =  "'__main__'"
                    __file__ =  "'/cdsware/cds-invenio/bin/bibupload'"
                        main =  '<function main at 0xabfa48c>'
                     __doc__ =  "'\\nBibUpload: Receive MARC XML file and 
update the appropriate database tables according to options.\\n\\n    Usage: 
bibupload [options] input.xml\\n    Examples:  \\n      $ bibupload -i 
input.xml\\n\\n    Options:\\n     -a, --append            new fields are 
appended to the existing record\\n     -c, --correct           fields are 
replaced by the new ones in the existing record\\n     -f, --format            
takes only the FMT fields into account. Does not update\\n     -i, --insert     
    [...]

>>>> >>>> Frame main in /usr/lib/python2.4/site-packages/invenio/bibupload.py 
>>>> >>>> at line 1821
*******************************************************************************
      1818                    "pretend"
      1819                  ]),
      1820             
task_submit_elaborate_specific_parameter_fnc=task_submit_elaborate_specific_parameter,
----> 1821             task_run_fnc=task_run_core)
      1822 
      1823 def task_submit_elaborate_specific_parameter(key, value, opts, args):
      1824     """ Given the string key it checks it's meaning, eventually 
using the
*******************************************************************************

>>>> >>>> Frame task_init in 
>>>> >>>> /usr/lib/python2.4/site-packages/invenio/bibtask.py at line 351
*******************************************************************************
       348                     ret = _task_run(task_run_fnc)
       349                     write_message("ERROR: The Python Profiler is not 
installed!", stream=sys.stderr)
       350             else:
---->  351                 ret = _task_run(task_run_fnc)
       352             if not ret:
       353                 write_message("Error occurred.  Exiting.", 
sys.stderr)
       354         except Exception, e:
*******************************************************************************
        task_submit_check_options_fnc =  'None'
        task_stop_helper_fnc =  'None'
                     version =  "'$Id$'"
         help_specific_usage =  "'  -a, --append\\t\\tnew fields are appended 
to the existing record\\n  -c, --correct\\t\\tfields are replaced by the new 
ones in the existing record\\n  -f, --format\\t\\ttakes only the FMT fields 
into account. Does not update\\n  -i, --insert\\t\\tinsert the new record in 
the database\\n  -r, --replace\\t\\tthe existing record is entirely replaced by 
the new one\\n  -z, --reference\\tupdate references (update only 999 fields)\\n 
 -d, --delete\\t\\tspecified fields are deleted in existing reco [...]
             to_be_submitted =  'False'
                        argv =  "['/cdsware/cds-invenio/bin/bibupload', '-v9', 
'-ir', '/cdsware/home/cdsware/scopus_simple_test.xml']"
             specific_params =  "('ircazdS:fno', ['insert', 'replace', 
'correct', 'append', 'reference', 'delete', 'stage=', 'format', 'notimechange', 
'holdingpen', 'pretend'])"
                task_run_fnc =  '<function task_run_core at 0xabfa56c>'
        authorization_action =  "'runbibupload'"
        task_submit_elaborate_specific_parameter_fnc =  '<function 
task_submit_elaborate_specific_parameter at 0xabfa4c4>'
           authorization_msg =  "'BibUpload Task Submission'"
                 description =  "'Receive MARC XML file and update appropriate 
database\\ntables according to options.\\nExamples:\\n    $ bibupload -i 
input.xml\\n'"

>>>> >>>> Frame _task_run in 
>>>> >>>> /usr/lib/python2.4/site-packages/invenio/bibtask.py at line 824
*******************************************************************************
       821         except SystemExit:
       822             pass
       823         except:
---->  824             register_exception(alert_admin=True)
       825             task_update_status("ERROR")
       826     finally:
       827         task_status = task_read_status()
*******************************************************************************
                   sleeptime =  "''"
                    time_now =  '1291031013.3260081'
                pidfile_name =  
"'/cdsware/cds-invenio/var/run/bibsched_task_7718.pid'"
                task_run_fnc =  '<function task_run_core at 0xabfa56c>'
                 task_status =  "'WAITING'"
                     pidfile =  "<closed file 
'/cdsware/cds-invenio/var/run/bibsched_task_7718.pid', mode 'w' at 0xab55ec0>"

>>>> >>>> Frame task_run_core in 
>>>> >>>> /usr/lib/python2.4/site-packages/invenio/bibupload.py at line 1976
*******************************************************************************
      1973                         
opt_stage_to_start_from=task_get_option('stage_to_start_from'),
      1974                         
opt_notimechange=task_get_option('notimechange'),
      1975                         oai_rec_id=record_id,
----> 1976                         pretend=task_get_option('pretend'))
      1977                     if error[0] == 1:
      1978                         if record:
      1979                             write_message(record_xml_output(record),
*******************************************************************************
                   record_id =  "''"
                        recs =  "[{'245': [([('a', 'Testdatensatz')], ' ', ' ', 
'', 2)], '100': [([('a', 'Plott, Cornelia')], ' ', ' ', '', 1)], '980': 
[([('a', 'SCOPUS')], ' ', ' ', '', 3)]}]"
                      record =  "{'245': [([('a', 'Testdatensatz')], ' ', ' ', 
'', 2)], '100': [([('a', 'Plott, Cornelia')], ' ', ' ', '', 1)], '980': 
[([('a', 'SCOPUS')], ' ', ' ', '', 3)]}"
                       error =  '0'

>>>> >>>> Frame bibupload in 
>>>> >>>> /usr/lib/python2.4/site-packages/invenio/bibupload.py at line 216
*******************************************************************************
       213         insert_mode_p = True
       214         # Insert the record into the bibrec databases to have a 
recordId
       215         rec_id = create_new_record(pretend=pretend)
---->  216         write_message("   -Creation of a new record id (%d): DONE" % 
rec_id, verbose=2)
       217 
       218         # we add the record Id control field to the record
       219         error = record_add_field(record, '001', 
controlfield_value=rec_id)
*******************************************************************************
                    opt_mode =  "'replace_or_insert'"
        opt_stage_to_start_from =  '1'
            record_deleted_p =  'False'
                     opt_tag =  'None'
                     pretend =  'False'
                      rec_id =  'None'
            opt_notimechange =  '0'
                  oai_rec_id =  "''"
               insert_mode_p =  'True'
                       error =  'None'
                      record =  "{'245': [([('a', 'Testdatensatz')], ' ', ' ', 
'', 2)], '100': [([('a', 'Plott, Cornelia')], ' ', ' ', '', 1)], '980': 
[([('a', 'SCOPUS')], ' ', ' ', '', 3)]}"


Reply via email to