Hi Nick,
For batch imports I recommend using the DSpace command line "ItemImport".
But, to format your content into a form acceptable by it, you need to turn
it into "Simple Archive Format". As mentioned by Bram above.
I've built a Java / command line tool that does just that. It will take a
CSV with properly formatted metadata (metadata field as column headings,
and data as the rows), and files in a directory that you specify (in the
csv), and build a package suitable for batch importing into DSpace via the
command line ItemImport.
https://wiki.duraspace.org/display/DSPACE/Simple+Archive+Format+Packager
Peter Dietz
On Fri, Sep 21, 2012 at 4:39 AM, Bram Luyten <[email protected]> wrote:
> Hi Nick,
>
> how large, in terms of filesize, are your datasets? Would they be so big
> that they form a challenge for traditional file storage?
>
> In any case, following options might be relevant for you:
>
> - Bulk metadata upload through CSV's:
> https://wiki.duraspace.org/display/DSDOC18/Batch+Metadata+Editing
> While this will be perfect for your metadata, the downside is that it
> currently doesn't offer a way to automatically add your files.
>
> Cambridge has a similar free tool that was able to do this, but it was
> originally designed for DSpace 1.5.x, so be careful:
> http://tools.dspace.cam.ac.uk/metadatamapper/
>
> - Importing and exporting via simple archive format
>
> https://wiki.duraspace.org/display/DSDOC18/Importing+and+Exporting+Items+via+Simple+Archive+Format
>
> This entails that you will need to transform your metadata and files into
> a specific folder structure, with your metadata contained in XML files. If
> your metadata is currently in CSV, you'll have some XSLT transformation
> work to do, but at least this offers support for adding the files as well.
>
> Hope this helps,
>
> Bram Luyten
>
> --
> [image: logo]
> *Bram Luyten* *@mire*
> *2888 Loker Avenue East, Suite 305, Carlsbad, CA. 92010*
> *Esperantolaan 4, Heverlee 3001, Belgium*
>
> <http://www.atmire.com/>www.atmire.com<http://atmire.com/website/?q=services&utm_source=emailfooter&utm_medium=email&utm_campaign=braml>
>
>
>
> On Wed, Sep 19, 2012 at 8:48 PM, Nick Farris <[email protected]>wrote:
>
>> I'm trying to bring a good deal of e-science data into my
>> institutional repository. I was curious whether anyone had experiences
>> with batch uploading large datasets to DSpace1.8 and what the easiest
>> method of going about this might be. All the metadata is already been
>> put into excel spreadsheets and the items' files are all ready to go
>> in a zip archieve with a readme file.
>>
>> My experience to this point has only been individually uploading
>> items, creating hierarchies/communities via the GUI.
>>
>> Forgive me if this has already been answered, but it wasn't readily
>> apparent in the tech documentation or via google search of these
>> listservs.
>>
>> Cheers
>> Nick
>>
>>
>> ------------------------------------------------------------------------------
>> Live Security Virtual Conference
>> Exclusive live event will cover all the ways today's security and
>> threat landscape has changed and how IT managers can respond. Discussions
>> will include endpoint security, mobile security and the latest in malware
>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>> _______________________________________________
>> DSpace-tech mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>
>
>
>
> ------------------------------------------------------------------------------
> Got visibility?
> Most devs has no idea what their production app looks like.
> Find out how fast your code is with AppDynamics Lite.
> http://ad.doubleclick.net/clk;262219671;13503038;y?
> http://info.appdynamics.com/FreeJavaPerformanceDownload.html
> _______________________________________________
> DSpace-tech mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>
>
------------------------------------------------------------------------------
Got visibility?
Most devs has no idea what their production app looks like.
Find out how fast your code is with AppDynamics Lite.
http://ad.doubleclick.net/clk;262219671;13503038;y?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
