Re: [Dspace-tech] Producing mets.xml for SWORD
Mika, You may also want to try out the METS Java API (or other tools) available at http://www.loc.gov/standards/mets/mets-tools.html to see what suits you best. Scott. Date: Fri, 5 Jun 2009 14:37:33 -0400 From: Larry Stone l...@mit.edu Subject: Re: [Dspace-tech] Producing mets.xml for SWORD To: mikan.d.dspace listmail mikan.dsp...@gmail.com Cc: Dspace Tech dspace-tech@lists.sourceforge.net Message-ID: f22e2167-c9ec-4299-a7e6-2297effb0...@mit.edu Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes The Harvard METS toolkit gives you an convenient (though DOM-like) API for the METS data model, takes care of some of the housekeeping, and it has logic to prevent schema mistakes: http://hul.harvard.edu/mets/ There's also a toolkit that helps you build a whole submission package, including the METS. It ought to work with SWORD too; see: http://wiki.dspace.org/index.php/DSpace_SIP_Toolkit (If you develop any tricks or procedures for using it with SWORD, please add them to that wiki page!) -- Larry On Jun 5, 2009, at 5:25 AM, mikan.d.dspace listmail wrote: Im hoping to use SWORD in order to deposit items to DSpace. What would be the best way to produce mets-metadata for the items to be submitted? Should I write the entire metadata file myself or is there templates / frameworks available for this? Thanks, Mika -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Producing mets.xml for SWORD
Hi Stuart, Actually I've been using Sword PHP library and it seems great. The only thing I've noticed, is that if I run, say 10 deposits in a row, my servlet container hangs and Java gives me the following memory error. Now this makes me wonder if there's some leakage somewhere in DSpace SWORD implementation or in PHP SWord library? HTTP ERROR: 500 PermGen space RequestURI=/neuroportti/handle/0/23 Caused by: java.lang.OutOfMemoryError: PermGen space Any ideas what might be causing this? Thanks, Mika 2009/6/8 Stuart Lewis s.le...@auckland.ac.nz: Hi Mika, I don't know what framework / language / environment you want to use this in, but the SWORD PHP library (http://php.swordapp.org/) contains a METS packager. It works as follows: require('packager_mets_swap.php'); // Create a new package with the root and directory of the input files, and the root and directory of the created package $package = new PackagerMetsSwap($rootin, $dirin, $rootout, $fileout); // Add metadata to the package $package-setType($test_type); $package-setTitle($title); $package-setAbstract($abstract); foreach ($creators as $creator) { $package-addCreator($creator); } // Add a file to the package $package-addFile($filename, $mimetype); // Now deposit the package require(swordappclient.php); $sac = new SWORDAPPClient(); $dr = $sac-deposit($depositurl, $username, $password, $onbehalfof, $filename, $packageformat, $pacakgecontenttype); I've been thinking of writing a web service front end to this, to make a packaging service (POST metadata and files, and it returns a package), or to make a deposit proxy service (POST metadata and files, SWORD deposit target and authentication details, and it will make the package and deposit it). If you think this might be a useful service, get in touch. Thanks, Stuart Lewis Digital Services Programmer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -Original Message- From: mikan.d.dspace listmail [mailto:mikan.dsp...@gmail.com] Sent: Friday, 5 June 2009 9:25 p.m. To: Dspace Tech Subject: [Dspace-tech] Producing mets.xml for SWORD Im hoping to use SWORD in order to deposit items to DSpace. What would be the best way to produce mets-metadata for the items to be submitted? Should I write the entire metadata file myself or is there templates / frameworks available for this? Thanks, Mika -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Producing mets.xml for SWORD
Hi Mika, I've just run some tests depositing 100 items in a row from the PHP library, and it seemed to work fine. Indeed, with an earlier version of DSpace we deposited 1/3rd million items into DSpace, with 4 concurrent threads (using a custom Java SWORD load test tool) and it worked fine. http://blog.stuartlewis.com/2009/01/19/dspace-at-a-third-of-a-million-items/ This page has a good description of PermGen, and a JSP page that allows you to watch the memory usage. What container and version are you using? http://www.freshblurbs.com/explaining-java-lang-outofmemoryerror-permgen-space Thanks, Stuart Lewis Digital Services Programmer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -Original Message- From: mikan.d.dspace listmail [mailto:mikan.dsp...@gmail.com] Sent: Monday, 8 June 2009 10:10 p.m. To: Stuart Lewis Cc: Dspace Tech Subject: Re: [Dspace-tech] Producing mets.xml for SWORD Hi Stuart, Actually I've been using Sword PHP library and it seems great. The only thing I've noticed, is that if I run, say 10 deposits in a row, my servlet container hangs and Java gives me the following memory error. Now this makes me wonder if there's some leakage somewhere in DSpace SWORD implementation or in PHP SWord library? HTTP ERROR: 500 PermGen space RequestURI=/neuroportti/handle/0/23 Caused by: java.lang.OutOfMemoryError: PermGen space Any ideas what might be causing this? Thanks, Mika 2009/6/8 Stuart Lewis s.le...@auckland.ac.nz: Hi Mika, I don't know what framework / language / environment you want to use this in, but the SWORD PHP library (http://php.swordapp.org/) contains a METS packager. It works as follows: require('packager_mets_swap.php'); // Create a new package with the root and directory of the input files, and the root and directory of the created package $package = new PackagerMetsSwap($rootin, $dirin, $rootout, $fileout); // Add metadata to the package $package-setType($test_type); $package-setTitle($title); $package-setAbstract($abstract); foreach ($creators as $creator) { $package-addCreator($creator); } // Add a file to the package $package-addFile($filename, $mimetype); // Now deposit the package require(swordappclient.php); $sac = new SWORDAPPClient(); $dr = $sac-deposit($depositurl, $username, $password, $onbehalfof, $filename, $packageformat, $pacakgecontenttype); I've been thinking of writing a web service front end to this, to make a packaging service (POST metadata and files, and it returns a package), or to make a deposit proxy service (POST metadata and files, SWORD deposit target and authentication details, and it will make the package and deposit it). If you think this might be a useful service, get in touch. Thanks, Stuart Lewis Digital Services Programmer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -Original Message- From: mikan.d.dspace listmail [mailto:mikan.dsp...@gmail.com] Sent: Friday, 5 June 2009 9:25 p.m. To: Dspace Tech Subject: [Dspace-tech] Producing mets.xml for SWORD Im hoping to use SWORD in order to deposit items to DSpace. What would be the best way to produce mets-metadata for the items to be submitted? Should I write the entire metadata file myself or is there templates / frameworks available for this? Thanks, Mika -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Producing mets.xml for SWORD
Hi Mika, I don't know what framework / language / environment you want to use this in, but the SWORD PHP library (http://php.swordapp.org/) contains a METS packager. It works as follows: require('packager_mets_swap.php'); // Create a new package with the root and directory of the input files, and the root and directory of the created package $package = new PackagerMetsSwap($rootin, $dirin, $rootout, $fileout); // Add metadata to the package $package-setType($test_type); $package-setTitle($title); $package-setAbstract($abstract); foreach ($creators as $creator) { $package-addCreator($creator); } // Add a file to the package $package-addFile($filename, $mimetype); // Now deposit the package require(swordappclient.php); $sac = new SWORDAPPClient(); $dr = $sac-deposit($depositurl, $username, $password, $onbehalfof, $filename, $packageformat, $pacakgecontenttype); I've been thinking of writing a web service front end to this, to make a packaging service (POST metadata and files, and it returns a package), or to make a deposit proxy service (POST metadata and files, SWORD deposit target and authentication details, and it will make the package and deposit it). If you think this might be a useful service, get in touch. Thanks, Stuart Lewis Digital Services Programmer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -Original Message- From: mikan.d.dspace listmail [mailto:mikan.dsp...@gmail.com] Sent: Friday, 5 June 2009 9:25 p.m. To: Dspace Tech Subject: [Dspace-tech] Producing mets.xml for SWORD Im hoping to use SWORD in order to deposit items to DSpace. What would be the best way to produce mets-metadata for the items to be submitted? Should I write the entire metadata file myself or is there templates / frameworks available for this? Thanks, Mika -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Producing mets.xml for SWORD
Im hoping to use SWORD in order to deposit items to DSpace. What would be the best way to produce mets-metadata for the items to be submitted? Should I write the entire metadata file myself or is there templates / frameworks available for this? Thanks, Mika -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Producing mets.xml for SWORD
The Harvard METS toolkit gives you an convenient (though DOM-like) API for the METS data model, takes care of some of the housekeeping, and it has logic to prevent schema mistakes: http://hul.harvard.edu/mets/ There's also a toolkit that helps you build a whole submission package, including the METS. It ought to work with SWORD too; see: http://wiki.dspace.org/index.php/DSpace_SIP_Toolkit (If you develop any tricks or procedures for using it with SWORD, please add them to that wiki page!) -- Larry On Jun 5, 2009, at 5:25 AM, mikan.d.dspace listmail wrote: Im hoping to use SWORD in order to deposit items to DSpace. What would be the best way to produce mets-metadata for the items to be submitted? Should I write the entire metadata file myself or is there templates / frameworks available for this? Thanks, Mika -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the OpenSource community. Download a copy and enjoy capabilities such as Networking, Storage and Virtualization. Go to: http://p.sf.net/sfu/opensolaris-get ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech