[Dspace-tech] OAI-ORE harvesting
Hi all, Please help me, When DSpace haverting, DSpace convert field *dc.contributor.author* to * dc.creator* How still keep value *dc.contributor.author *field. I don't want to move into *dc.creator* Thanks Nguyen -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
I set up a test box with DSpace 3.0 and the OAI 2.0 add-on. How do I go about implementing your solution (rewriting the METS metadata format XSL stylesheet)? Thank you for your response. Alain Tschanz -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, November 14, 2012 3:28 PM To: Alain Tschanz Cc: dspace-tech Subject: Re: [Dspace-tech] OAI-ORE harvesting On Wed, Nov 14, 2012 at 9:20 PM, Alain Tschanz atsch...@njstatelib.org wrote: Of course, you're right. Your solution is exactly what I need. Are you going to do that with 3.0, 1.8 with the OAI 2.0 addon or 1.8 old oai webapp? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
On Tue, Nov 20, 2012 at 3:19 PM, Alain Tschanz atsch...@njstatelib.org wrote: I set up a test box with DSpace 3.0 and the OAI 2.0 add-on. How do I go about implementing your solution (rewriting the METS metadata format XSL stylesheet)? You can find the documentation here: https://wiki.duraspace.org/display/DSDOC3x/OAI+2.0+Server#OAI2.0Server-AdvancedConfiguration I think what you want is to edit [dspace]/config/crosswalks/oai/metadataFormats/mets.xsl and comment out the whole fileSec section. But you should also verify whether this doesn't make the METS invalid, i.e. not conforming to its schema. Don't forget to run [dspace]/bin/dspace oai clean-cache for your changes to take effect on cached records. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] OAI-ORE harvesting
Hello, Can I prevent another DSpace repository from harvesting metadata and bitstreams? Or put another way, can I limit harvesting of collections to metadata and references to bitstreams only? Alain Tschanz -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
On Wed, Nov 14, 2012 at 7:38 PM, Alain Tschanz atsch...@njstatelib.org wrote: Can I prevent another DSpace repository from harvesting metadata and bitstreams? Or put another way, can I limit harvesting of collections to metadata and references to bitstreams only? Hi Alain, certainly, by removing READ access for the Anonymous to a bitstream, there's no way how you can download it without authenticating. If you want to keep READ Anonymous access though, there's nothing DSpace can do. But you could configure the firewall to block sites that you don't want to harvest you. It's hard to imagine another practical way how you would distinguish between humans and spiders downloading the bitstreams (detecting User Agent string, perhaps, but that can be easily faked). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
Thank you for your quick response. An obvious solution just occurred to me. What if I set up a second, public DSpace instance that mirrors the first private, DSpace instance, but the second DSpace site harvests from the first, private instance only metadata and references to bitstreams and not the bitstreams themselves? Alain -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, November 14, 2012 1:47 PM To: Alain Tschanz Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] OAI-ORE harvesting On Wed, Nov 14, 2012 at 7:38 PM, Alain Tschanz atsch...@njstatelib.org wrote: Can I prevent another DSpace repository from harvesting metadata and bitstreams? Or put another way, can I limit harvesting of collections to metadata and references to bitstreams only? Hi Alain, certainly, by removing READ access for the Anonymous to a bitstream, there's no way how you can download it without authenticating. If you want to keep READ Anonymous access though, there's nothing DSpace can do. But you could configure the firewall to block sites that you don't want to harvest you. It's hard to imagine another practical way how you would distinguish between humans and spiders downloading the bitstreams (detecting User Agent string, perhaps, but that can be easily faked). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
On Wed, Nov 14, 2012 at 7:52 PM, Alain Tschanz atsch...@njstatelib.org wrote: Thank you for your quick response. An obvious solution just occurred to me. What if I set up a second, public DSpace instance that mirrors the first private, DSpace instance, but the second DSpace site harvests from the first, private instance only metadata and references to bitstreams and not the bitstreams themselves? Yes, that's possible. But I don't see what improvement it brings over my second suggestion. Let me put it another way. You need to define who you want to give access (logged in people, anonymous people, robots) to the bitstreams. Only then you can start planning a solution. Can you reply with the details of whom you'd like to have access? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
On Wed, Nov 14, 2012 at 8:07 PM, Alain Tschanz atsch...@njstatelib.org wrote: I want everybody (anonymous users) be able to search, browse and read all documents on DSpace, but I want to prevent institutions such as universities, libraries and search services from downloading the bitstreams of whole collections via the OAI-ORE harvesting function. I would like to limit harvesting to metadata and references to bitstreams only. Is there a way to implement that scenario? In that case setting up two instances would help, assuming one instance would be there for browsing for humans and the other one for harvesting, without bitstreams. So why not simplify it and just change the OAI interface the way it would work in the mirroring instance? It all boils down to defining how you distinguish between a human and a robot. It's surprisingly hard to do it right if you think about it. Let's assume humans are those using the web interface and robots are those using OAI-PMH. Let's define what you expect from the OAI interface. You said you don't want it to show bitstreams, only references. But those references can be followed to get the bitstreams, which might be a problem. But we can just assume that if bitstreams are only available as references, nobody will bother to rewrite the harvesters to follow the references. Here's an example METS file (yes, there may be other formats available via OAI-PMH): http://demo.dspace.org/xmlui/metadata/handle/10673/171/mets.xml Here we basically want to remove the whole fileSec section and add the referencess to metadata. I think this can be done using a crosswalk. It should be easier to do in OAI 2.0 (in DSpace 3.0) by just rewriting the METS metadata format XSL stylesheet than in the old OAI where the crosswalk is a Java class. How does that sound? Did I get any assumptions wrong for your case? P.S. Always CC dspace-tech (Reply All). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
Of course, you're right. Your solution is exactly what I need. Alain -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, November 14, 2012 2:21 PM To: Alain Tschanz Cc: dspace-tech Subject: Re: [Dspace-tech] OAI-ORE harvesting On Wed, Nov 14, 2012 at 8:07 PM, Alain Tschanz atsch...@njstatelib.org wrote: I want everybody (anonymous users) be able to search, browse and read all documents on DSpace, but I want to prevent institutions such as universities, libraries and search services from downloading the bitstreams of whole collections via the OAI-ORE harvesting function. I would like to limit harvesting to metadata and references to bitstreams only. Is there a way to implement that scenario? In that case setting up two instances would help, assuming one instance would be there for browsing for humans and the other one for harvesting, without bitstreams. So why not simplify it and just change the OAI interface the way it would work in the mirroring instance? It all boils down to defining how you distinguish between a human and a robot. It's surprisingly hard to do it right if you think about it. Let's assume humans are those using the web interface and robots are those using OAI-PMH. Let's define what you expect from the OAI interface. You said you don't want it to show bitstreams, only references. But those references can be followed to get the bitstreams, which might be a problem. But we can just assume that if bitstreams are only available as references, nobody will bother to rewrite the harvesters to follow the references. Here's an example METS file (yes, there may be other formats available via OAI-PMH): http://demo.dspace.org/xmlui/metadata/handle/10673/171/mets.xml Here we basically want to remove the whole fileSec section and add the referencess to metadata. I think this can be done using a crosswalk. It should be easier to do in OAI 2.0 (in DSpace 3.0) by just rewriting the METS metadata format XSL stylesheet than in the old OAI where the crosswalk is a Java class. How does that sound? Did I get any assumptions wrong for your case? P.S. Always CC dspace-tech (Reply All). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE harvesting
On Wed, Nov 14, 2012 at 9:20 PM, Alain Tschanz atsch...@njstatelib.org wrote: Of course, you're right. Your solution is exactly what I need. Are you going to do that with 3.0, 1.8 with the OAI 2.0 addon or 1.8 old oai webapp? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] oai-ore
Hi all! Can anyone help me know , how to run OAI-ORE harevester on multiple collections in dspace jspui. Thanks -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] OAI-ORE configuration
Hi all, While I'd still be really interested to hear answers to my original questions (or even to be told they don't make sense), perhaps I should start with what I think is a simpler question: What is considered best practice (and options) for exporting objects (bitstreams and associated metadata) from DSpace for use by other applications? Thanks a lot, Gary GARY BROWNE | Development Programmer Library IT Services | University Library THE UNIVERSITY OF SYDNEY T +61 2 9351 5946 | F +61 2 9036 -Original Message- From: Gary Browne [mailto:gary.bro...@sydney.edu.au] Sent: Monday, 13 September 2010 12:57 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] OAI-ORE configuration Hi, I haven't tried this yet, but after perusing the documentation I have a couple of questions. Assuming I want to harvest a collection from repository A into repository B: i) can repository B accept a subset of repository A's metadata for each item, instead of the whole lot? ii) can repository B be configured for additional metadata field/value pairs to be automatically added to harvested items? iii) I see documentation for the xmlui but not jspui - is it possible in jspui (documentation pointers)? Thanks a lot, Gary GARY BROWNE | Development Programmer Library IT Services | University Library THE UNIVERSITY OF SYDNEY Level 1, Fisher Library F03 | The University of Sydney | NSW | 2006 T +61 2 9351 5946 | F +61 2 9036 E gary.bro...@sydney.edu.au | W http://sydney.edu.au Sent from my plain old desktop computer. CRICOS 00026A This email plus any attachments to it are confidential. Any unauthorised use is strictly prohibited. If you receive this email in error, please delete it and any attachments. Please think of our environment and only print this e-mail if necessary. --- --- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] OAI-ORE configuration
Hi, I haven't tried this yet, but after perusing the documentation I have a couple of questions. Assuming I want to harvest a collection from repository A into repository B: i) can repository B accept a subset of repository A's metadata for each item, instead of the whole lot? ii) can repository B be configured for additional metadata field/value pairs to be automatically added to harvested items? iii) I see documentation for the xmlui but not jspui - is it possible in jspui (documentation pointers)? Thanks a lot, Gary GARY BROWNE | Development Programmer Library IT Services | University Library THE UNIVERSITY OF SYDNEY Level 1, Fisher Library F03 | The University of Sydney | NSW | 2006 T +61 2 9351 5946 | F +61 2 9036 E gary.bro...@sydney.edu.au | W http://sydney.edu.au Sent from my plain old desktop computer. CRICOS 00026A This email plus any attachments to it are confidential. Any unauthorised use is strictly prohibited. If you receive this email in error, please delete it and any attachments. Please think of our environment and only print this e-mail if necessary. -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] [oai-ore] April 4 meeting in Southampton UK for European roll-out of ORE Specifications
Forwarded on behalf of Carl and Herbert: = Apologies for cross-posting A meeting will be held on April 4, 2008 at the University of Southampton, in conjunction with Open Repositories 2008, to roll-out the beta release of the OAI-ORE specifications. This meeting is the European follow-on to a meeting that will be held in the USA on March 3, 2008 at Johns Hopkins University. The OAI-ORE specifications describe a data model to identify and describe aggregations of web resources, and they introduce machine-readable formats to describe these aggregations based on ATOM and RDF/XML. The current, alpha version of the OAI-ORE specifications is at http://www.openarchives.org/ore/0.1/ . Additional details for the OAI-ORE European Open Meeting are available at: - The full press release for this event: http://www.openarchives.org/ore/documents/EUKickoffPressrelease.pdf - The registration site for the event: http://regonline.com/eu-oai-ore Note that registration is required and space is limited. Carl Lagoze and Herbert Van de Sompel ___ Ore-ac mailing list [EMAIL PROTECTED] http://www.openarchives.org/mailman/listinfo/ore-ac - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
