> You can also attach the file you're importing. Either the whole file or you
> can keep just the line(s) that cause the error.
I'll have to re-run my scripts to identify problematic lines& that
might only be later. See attachment for structure-builder script
(dspace-structure.xml) and zipped input files [1] (file larger than
mailinglist limit).
To give you some context here, I am test driving metadata-import to
try and determine an appropriate record size to use for successful
ingestion before I ingest my entire datasets. My previous attempt
resulted in 93%, 45% and 0% record ingestion success for 10, 100 and
1000 record-sized files respectively. I am not sure if the size is a
factor (especially that you mentioned in your other response that the
entire file in loaded into memory) or if metadata-import fails to
ingest a file when at least one of the records is problematic.
[1] https://dl.dropbox.com/u/29659698/work/2013/01/31/inputfiles.zip
Lighton Phiri
http://lightonphiri.org
On 31 January 2013 10:58, helix84 <[email protected]> wrote:
> Unfortunately, the class just throws Exception, which is too generic,
> so I couldn't find where the error is originating.
>
> Please, change this:
> System.err.println("Error reading file: " + e.getMessage());
> to this
> System.err.println("Error reading file: " + e.getMessage() + "\n" +
> e.getStackTrace());
> in
> https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/app/bulkedit/MetadataImport.java#L1288
>
> That should give us more details.
>
> You can also attach the file you're importing. Either the whole file
> or you can keep just the line(s) that cause the error.
>
> Generally, I find that working with CSV in MS Excel is very
> uncomfortable and likely to produce wrong CSVs for the purpose of
> import into DSpace. I recommend using OpenOffice.org/LibreOffice.
>
>
> Regards,
> ~~helix84
>
> Compulsory reading: DSpace Mailing List Etiquette
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
<import_structure><community identifier="123456789/1"><name>dspace</name><description>dspace</description><collection identifier="123456789/2"><name>ADTP</name><description>Australiasian Digital Theses Program</description></collection><collection identifier="123456789/3"><name>BGMYU</name><description>Brigham Young University Theses</description></collection><collection identifier="123456789/4"><name>BRADFORD</name><description>Bradford Scholars</description></collection><collection identifier="123456789/5"><name>BSU</name><description>Ball State University</description></collection><collection identifier="123456789/6"><name>CALTECH</name><description>California Institute of Technology</description></collection><collection identifier="123456789/7"><name>CCSD</name><description>CCSD theses-EN-ligne, France</description></collection><collection identifier="123456789/8"><name>CHENGCHI</name><description>National Chengchi University Libraries</description></collection><collection identifier="123456789/9"><name>DRESDEN</name><description>Hochschulschriftenserver (HSSS) der SLUB Dresden</description></collection><collection identifier="123456789/10"><name>DUKE</name><description>Duke University</description></collection><collection identifier="123456789/11"><name>DUQUESNE</name><description>Duquesne University</description></collection><collection identifier="123456789/12"><name>DocTA</name><description>Universita Cattolica del Sacro Cuore. DocTA</description></collection><collection identifier="123456789/13"><name>ETSU</name><description>East Tennessee State University</description></collection><collection identifier="123456789/14"><name>GATECH</name><description>Georgia Tech Electronic Thesis and Dissertation Archive</description></collection><collection identifier="123456789/15"><name>GEORGIA</name><description>Georgia State University</description></collection><collection identifier="123456789/16"><name>HKU</name><description>Hong Kong University Theses</description></collection><collection identifier="123456789/17"><name>HUMBOLT</name><description>Humboldt University of Berlin, GERMANY, Document Server</description></collection><collection identifier="123456789/18"><name>IBICT</name><description>IBICT Brazilian ETDs</description></collection><collection identifier="123456789/19"><name>KSU</name><description>K-State Research Exchange</description></collection><collection identifier="123456789/20"><name>LABT_ETD</name><description>Lithuanian ETD submission system</description></collection><collection identifier="123456789/21"><name>LACETR</name><description>Library and Archives Canada ETDs Repository / Centre d'archives des theses electroniques de Bibliotheque et Archives Canada</description></collection><collection identifier="123456789/22"><name>LAVAL</name><description>Université Laval</description></collection><collection identifier="123456789/23"><name>LSU</name><description>Louisiana State University</description></collection><collection identifier="123456789/24"><name>MAINE</name><description>University of Maine</description></collection><collection identifier="123456789/25"><name>METU</name><description>Middle East Technical Univ.</description></collection><collection identifier="123456789/26"><name>MIT</name><description>M.I.T. Theses and Dissertation</description></collection><collection identifier="123456789/27"><name>MONTANA</name><description>University of Montana Missoula</description></collection><collection identifier="123456789/28"><name>MONTSTATE</name><description>Montana State University</description></collection><collection identifier="123456789/29"><name>MSSTATE</name><description>Mississippi State University</description></collection><collection identifier="123456789/30"><name>MUENCHEN</name><description>Digitale Hochschulschriften der LMU</description></collection><collection identifier="123456789/31"><name>NAGOYA</name><description>Nagoya University</description></collection><collection identifier="123456789/32"><name>NCSU</name><description>North Carolina State University</description></collection><collection identifier="123456789/33"><name>NEU</name><description>Northeastern University, Snell Library</description></collection><collection identifier="123456789/34"><name>NSYSU</name><description>NSYSU Electronic Thesis and Dissertation Archive</description></collection><collection identifier="123456789/35"><name>NWUBOLOKA1</name><description>North-West University</description></collection><collection identifier="123456789/36"><name>OCLC</name><description>OCLC</description></collection><collection identifier="123456789/37"><name>ORGSU</name><description>Oregon State University</description></collection><collection identifier="123456789/38"><name>OhioLink</name><description>Ohiolink ETDs</description></collection><collection identifier="123456789/39"><name>PITT</name><description>University of Pittsburgh</description></collection><collection identifier="123456789/40"><name>PUCP</name><description>Pontificia Universidad Católica del Perú</description></collection><collection identifier="123456789/41"><name>Potsdam</name><description>Potsdam University</description></collection><collection identifier="123456789/42"><name>Quebec</name><description>Université du Québec à Chicoutimi</description></collection><collection identifier="123456789/43"><name>RICE</name><description>Rice University</description></collection><collection identifier="123456789/44"><name>SEDICI</name><description>Universidad Nacional de La Plata, Sedici</description></collection><collection identifier="123456789/45"><name>TDX_UAB</name><description>Universitat Autònoma de Barcelona</description></collection><collection identifier="123456789/46"><name>TDX_UB</name><description>Universitat de Barcelona</description></collection><collection identifier="123456789/47"><name>TDX_UDL</name><description>Universitat de Lleida</description></collection><collection identifier="123456789/48"><name>TDX_UPC</name><description>Universitat Politècnica de Catalunya</description></collection><collection identifier="123456789/49"><name>TDX_UPF</name><description>Universitat Pompeu Fabra</description></collection><collection identifier="123456789/50"><name>TEMPLE</name><description>Temple University</description></collection><collection identifier="123456789/51"><name>TORONTO</name><description>University of Toronto</description></collection><collection identifier="123456789/52"><name>TULANE</name><description>Tulane University</description></collection><collection identifier="123456789/53"><name>TW</name><description>National Digital Library of Theses and Dissertations in Taiwan</description></collection><collection identifier="123456789/54"><name>UBOLOGNA</name><description>University of Bologna, Italy</description></collection><collection identifier="123456789/55"><name>UCF</name><description>University of Central Florida</description></collection><collection identifier="123456789/56"><name>UCHILE</name><description>Chile Cybertesis</description></collection><collection identifier="123456789/57"><name>UDLA-Thesis</name><description>UDLA-Thesis</description></collection><collection identifier="123456789/58"><name>UHAWAII</name><description>University of Hawaii at Manoa Libraries</description></collection><collection identifier="123456789/59"><name>UMASS</name><description>University of Massachusetts, Amherst</description></collection><collection identifier="123456789/60"><name>UMIAMI</name><description>University of Miami</description></collection><collection identifier="123456789/61"><name>UNESP</name><description>Sao Paulo State University, Sao Paulo - Brazil.</description></collection><collection identifier="123456789/62"><name>UNWC</name><description>Univ. of Western Cape</description></collection><collection identifier="123456789/63"><name>UPSALLA</name><description>DiVA Archive at Upsalla University</description></collection><collection identifier="123456789/64"><name>UPSALLA1</name><description>DiVA Archive at Upsalla University</description></collection><collection identifier="123456789/65"><name>USASK</name><description>University of Saskatchewan Library </description></collection><collection identifier="123456789/66"><name>UTENN</name><description>University of Tennessee Libraries</description></collection><collection identifier="123456789/67"><name>UTEXAS</name><description>University of Texas</description></collection><collection identifier="123456789/68"><name>VTETD</name><description>Virgina Tech. Theses and Dissertation</description></collection><collection identifier="123456789/69"><name>Vidyanidhi</name><description>Vidyanidhi Digital Lib. (India)</description></collection></community></import_structure>
------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
