OAI PMH is not delivering continuation tokens
---------------------------------------------
Key: DS-459
URL: http://jira.dspace.org/jira/browse/DS-459
Project: DSpace 1.x
Issue Type: Bug
Reporter: Mark Diggory
Walker, David <[email protected]> Thu, Jan 7, 2010 at 7:36 AM
To: "[email protected]" <[email protected]>
Hi all,
I'm trying to harvest our DSpace repos using the PKP OAI Harvester.
The problem I face right now is that the Harvester is only pulling back just
the first batch of records, instead of all records in the repo. I see this
with all of our repos with more than 100 records.
Just looking at the ListRecord response myself, I don't see a resumption token,
which would explain the behavior of the harvester stopping with this first
batch:
http://sjsu-dspace.calstate.edu/oai/request?verb=ListRecords&metadataPrefix=oai_dc
George Kozak at Cornell reported a similar problem back in October, but not
sure if he or someone else was able to resolve the problem:
http://old.nabble.com/OAI-Harvesting-problem-to25872830.html#a25887911
I'm new to harvesting, so I may have missed something obvious.
--Dave
==================
David Walker
Library Web Services Manager
California State University
http://xerxes.calstate.edu
------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
George Stanley Kozak <[email protected]> Thu, Jan 7, 2010 at 7:46 AM
To: "Walker, David" <[email protected]>, "[email protected]"
<[email protected]>
David:
Yes, I did fix my problem. Stuart Lewis from the Auckland Library told me that
my problem was caused by the 'harvest.includerestricted.oai = false' option in
the dspace.cfg file. I guess there's a bug in 1.5.2 that's fixed in 1.6. All
I did was comment out the line and the harvesting now works fine.
George Kozak
Digital Library Specialist
Division of Library Information Technologies (DLIT)
501 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
[Quoted text hidden]
Walker, David <[email protected]> Thu, Jan 7, 2010 at 10:18 AM
To: George Stanley Kozak <[email protected]>,
"[email protected]" <[email protected]>
That appears to have done the trick. Thanks, George.
--Dave
==================
David Walker
Library Web Services Manager
California State University
http://xerxes.calstate.edu
________________________________________
From: George Stanley Kozak [[email protected]]
Sent: Thursday, January 07, 2010 7:46 AM
To: Walker, David; [email protected]
Subject: RE: No resumption token?
[Quoted text hidden]
Mark Diggory <[email protected]> Thu, Jan 7, 2010 at 11:16 AM
To: "Walker, David" <[email protected]>
Cc: "[email protected]" <[email protected]>
David,
I encountered the same issue when testing the TAMU Harvester against
several DSpace instances... That would pose a some fairly strong
evidence that there is a problem.
Mark
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.dspace.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
_______________________________________________
Dspace-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-devel
