Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
Hi Jodi / Keith, However this request returns error code=badArgument. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiers The 'badArgument' occurs because you need to specify which format you want the metadata in. So the following works: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadata Prefix=oai_dc However This still suffers from the problem of no records being returned when no dates are specified. As you have noticed, if you add a 'from' records are returned. (Not so if you just add a 'to'). What should be happening, is OAICat passes a 'null' for 'to' and 'from' to org.dspace.search.Harvest.java If it receives null values, it should not do any date filtering on the select query. Something must be going wrong here. To debug this, we need to see what queries are being run. Can you: 1) Upgrade your logging output to DEBUG (change 'INFO' to 'DEBUG' in [dspace]/conf/log4j.properties an then restart tomcat). 2) Watch you [dspace]/log/dspace.log file as you call the ListIdentifiers URL which is returning an empty result set. The debug output should show the output that OAICat is passing to Harvest.java, and should show the corresponding query that Harvest.java calls. If you can send these to the list, we can look into the problem further. Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] dsrun data register trouble
Hi Horii, We have a memory problem and we can not register our repository data properly. If somebody knows anything about the similar problem, please let us know. The problem is as follows. During the data registration using dsrun utility, the memory resource is constantly consumed and finally the process stops because of the out of memory.It happens even if the data is only about several thousand. But our collection is up to hundred thousand or mor. We use Dspace Ver1.4. Which dsrun script are you running? What is the full command you use? Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
Hi Mike, On 1/6/07 14:04, Michael White [EMAIL PROTECTED] wrote: Hi, It has just been brought to my attention that an item in our repository that contains an accented character in the filename is not accessible in our repository because the char/url is being mangled when the link to the bitstream is clicked - http://dspace.stir.ac.uk/dspace/handle/1893/50. Does anyone have any suggestions as to the best way to fix this? I've had a few thoughts but also have concerns and definitely don't want to totally mangle my repository!! 2) Add another copy of the bitstream to the item, without the accented char in the filename, using the Add Bitstream functionality and Remove the bitstream that has the dodgy title - not sure though if the Remove function will also fail because of the accented char(?) To me, this seems the best option. The old file should delete cleanly as I suspect (although haven't looked) that it uses its ID rather than its filename to identify it in the delete request. Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
Thanks Stuart, 2) Add another copy of the bitstream to the item, without the accented char in the filename, using the Add Bitstream functionality and Remove the bitstream that has the dodgy title - not sure though if the Remove function will also fail because of the accented char(?) To me, this seems the best option. The old file should delete cleanly as I suspect (although haven't looked) that it uses its ID rather than its filename to identify it in the delete request. I can confirm that this is what I did in the end - I had a play around on my DEV system (with a file with an accented char in the filename) and was able to delete and replace the offending bitstream without problems - the hardest part was working out how to find a copy of the offending file in the asset store! I managed to pick my way through the database and track it down though. Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
On Wed, 2007-06-06 at 07:49 +0100, Stuart Lewis [sdl] wrote: 2) Add another copy of the bitstream to the item, without the accented char in the filename, using the Add Bitstream functionality and Remove the bitstream that has the dodgy title - not sure though if the Remove function will also fail because of the accented char(?) To me, this seems the best option. The old file should delete cleanly as I suspect (although haven't looked) that it uses its ID rather than its filename to identify it in the delete request. I'm still a little perplexed as to why this wasn't working in the first place. Looking at the original error message, it had output '??' in place of the accented character - a sure sign of the UTF-8 encoding not being handled correctly. Although by clicking through the browse lists, it would seem that the UTF-8 encoding option has been correctly set in the Tomcat server.xml (ie., clicking on the author in the browse list works). Assuming that URIEncoding has been set correctly in Tomcat, getPathInfo() *should* return the decoded String - however there is a bug in pre-4.0.4 where it would treat it as US-ASCII. A bit of Googling suggests that Jetty might be similarly afflicted. So, questions: First, to Michael: 1) Is http://dspace.stir.ac.uk running Tomcat? a) If so, what version? b) If not, what is it running? 2) Can it be confirmed absolutely that the URIEncoding option is set correctly in Tomcat's server.xml? And to all: 3) Do we need to consider doing a manual UTF-8 decoding inside the servlet to cope with these issues? 4) Should we simply avoid the getPathInfo() issue and make it a parameter (ie. /bitstream?file=xxx.pdf) 5) Should we include the bitstream id as part of the url, so that we can match that instead of the filename (although the name would still be included as a hint to the browser) G - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
Not really. The badArgument is valid when you don't specify a metadataPrefix, and the noRecordsMatch error is valid when there are no records that match the date range specified. If you simply include a from timestamp, eg: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadataPrefix=oai_dcfrom=2001-01-01T00:00:00Z then it works. I don't think there is anything wrong with the harvesting code per se, it just looks like it is incorrectly interpreting a from date when you don't specify one. Although according to the oaicat.properties below, the earliestDatestamp is set to 2001-01-01T00:00:00Z - exactly what I'm passing in the above url, and which works! G On Tue, 2007-06-05 at 22:37 -0400, Jodi Schneider wrote: Forwarding this back out to the list for better answers to Keith's questions. http://sourceforge.net/tracker/index.php?func=detailaid=1688523group_id=19984atid=319984 mentions the TimeStamp function of *Oracle*. Is the bug also applicable to Postgres? http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-04-01until=2007-05-15metadataPrefix=oai_dc works beautifully. However this request returns error code=badArgument. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiers Can anyone tell Keith how to fix this? Is upgrade to 1.4.2 the answer? Or...? -Jodi PS-Keith, what happens if you change granularity? i.e. in oaicat.properties change AbstractCatalog.granularity=-MM-DDThh:mm:ssZ to AbstractCatalog.granularity=-MM-DD -- Forwarded message -- From: Keith Jones [EMAIL PROTECTED] Date: Jun 5, 2007 3:41 PM Subject: Re: [Dspace-tech] Problem with Data Provider Validation To: Jodi Schneider [EMAIL PROTECTED] Hi Jodi, Thanks for the help. At my institution we are using Postgres, would this have any effect on the date granularity? Are you saying that the harvester will not work, unless you are at version 1.4.2? I've been able to get subsets if the listidentifiers working, atleast it will work when I put in a from date but will not work if no date is specified. I'm still getting the following error: Code=noRecordsMatch, Description=The combination of the values of the from, until, set, and metadataPrefix arguments results in an empty list. With the http request of: http://dspace.udel.edu:8080/dspace-oai/request, verb=ListIdentifiers, metadataPrefix=oai_dc But I can get results with the following http request http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-04-01metadataPrefix=oai_dc Thanks Keith -- Forwarded message -- From: Jodi Schneider [EMAIL PROTECTED] Date: Jun 5, 2007 9:19 AM Subject: [Dspace-tech] Problem with Data Provider Validation To: Dspace Tech dspace-tech@lists.sourceforge.net Keith, It looks like your repository is still having this problem. I think you will need to upgrade to 1.4.2 or change timestamp granularity. It looks like 1.4.2 fixed a bug regarding OAI timestamps: The oracleTimeStampFunction did not correctly account for 20 character length timestamps (-MM-DDTHH:mm:ssZ), incorrectly treating them as '-MM-DDTHH:mm:ss.FFZ'. http://sourceforge.net/tracker/index.php?func=detailaid=1688523group_id=19984atid=319984 --- I compared the file you mention to my default oaicat.properties and it looks like one block is duplicated. I wouldn't expect this to harm anything. AbstractCatalog.oaiCatalogClassName=org.dspace.app.oai.DSpaceOAICatalog AbstractCatalog.recordFactoryClassName=org.dspace.app.oai.DSpaceRecordFactory AbstractCatalog.secondsToLive=3600 AbstractCatalog.granularity=-MM-DDThh:mm:ssZ Best luck, and apologies it took so long to figure this out! -Jodi Portable Citations for DSpace On 5/29/07, Keith Jones [EMAIL PROTECTED] wrote: I did not chnage anything in the oaicat.properties. Here is my properties file: ### # REMEMBER: ONLY UPDATE THE VERSION IN dspace/config/templates # AND THEN RUN dspace/bin/install-configs! # DO NOT EDIT THE 'LIVE' VERSION! ### # OAICat Configuration file - see OAICat documentation for details # Text surrounded by two '@' symbols is replaced with the corresponding # property from dspace.cfg. For example: # # http://dspace.udel.edu:8080/dspace # # would be replaced with the dspace.url property in dspace.cfg. # When /dspace/bin/install-configs is run, this file will be installed in the # location specified by the property: config.template.oaicat.properties
[Dspace-tech] RE : dsrun data register troubl e
Hi DSpace commiters and advanced tech users, would it be helpful for large scale import and repositories to do some Item.decache() calls during the process? I'm very concerned about the fact that each time an instance of org.dspace.content.Item is created, it seems to be automatically put in the Context cache. I've done a search about the decache() method calls and it seems to be used only by MediaFilterManager and DSIndexer. It could be a problem too for the DSpace web interface : does it means that every time we access an Item, it creates an instance of this object and puts it in the cache, and to be never removed as long as the user's session is still alive? Could someone confirms if that is actually the case? If it is, we should maybe check if the decache() method could be used more often. It would certainly help large repositories having items with a lot of bitstreams... De: [EMAIL PROTECTED] de la part de Date: mer. 2007-06-06 07:58 À: dspace-tech@lists.sourceforge.net Objet : Re: [Dspace-tech] dsrun data register trouble Dear Lewis, We have a memory problem and we can not register our repository data properly. If somebody knows anything about the similar problem, please let us know. The problem is as follows. During the data registration using dsrun utility, the memory resource is constantly consumed and finally the process stops because of the out of memory.It happens even if the data is only about several thousand. But our collection is up to hundred thousand or mor. We use Dspace Ver1.4. Which dsrun script are you running? What is the full command you use? We executed like this; ?/usr/local/dspace/bin/dsrun org.dspace.app.itemimport --add [EMAIL PROTECTED] --collection=26 --source=/home/porta/install/070410/akita_d/xml_kyoudo --map=/home/porta/install/070410/mapfile/mpf_akitad01 With regards. --- Mitsuhiko Horii [EMAIL PROTECTED] - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] RE : dsrun data register trouble
On Wed, Jun 06, 2007 at 08:45:58AM -0400, Tellier, Stephane wrote: It could be a problem too for the DSpace web interface : does it means that every time we access an Item, it creates an instance of this object and puts it in the cache, and to be never removed as long as the user's session is still alive? Could someone confirms if that is actually the case? Not really, no. It will be cached for the lifetime of the Context object into which it was cached (I think). Contexts are usually created on a per-request basis, so the cache is burned pretty frequently. Naturally, this isn't the case for the indexing and media filters which is probably why that's the only code that uses decache(). If it is, we should maybe check if the decache() method could be used more often. It would certainly help large repositories having items with a lot of bitstreams... I actually disagree with this statement (in the general case). In terms of performance, it is much better to cache as much as possible (provided that the information is accessed multiple times). Reaching into the data layer every time we access an object will get expensive very quickly, so we need to reconcile the two to achieve satisfactory performance. The work I am doing on DAOs separates the in-memory objects from the storage layer entirely (as well as introducing light-weight proxy objects), which should make DSpace smarter about what is cached in memory as well. Once this prototype stabilises (soon) I will be doing some simple performance checks to see how this new mechanism compares to the current method. The new layer of indirection I have introduced will itself introduce a performance penalty, but should more than make up for that by being clever (it will also present a much nicer API to code against). cheers, Jim -- James Rutherford | Hewlett-Packard Limited registered Office: Research Engineer | Cain Road, HP Labs | Bracknell, Bristol, UK | Berks +44 117 312 7066 | RG12 1HN. [EMAIL PROTECTED] | Registered No: 690597 England The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error, you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated you should consider this message and attachments as HP CONFIDENTIAL. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
Hi Graham, 1) Is http://dspace.stir.ac.uk running Tomcat? Yes. a) If so, what version? 4.1.31 2) Can it be confirmed absolutely that the URIEncoding option is set correctly in Tomcat's server.xml? Hmm, I took a look and it didn't in fact, appear to be defined at all in server.xml, so I added it - not an expert so can't guarantee that is set correctly! Connector className=org.apache.ajp.tomcat4.Ajp13Connector port=8009 minProcessors=5 maxProcessors=75 acceptCount=10 debug=0 address=127.0.0.1 URIEncoding=UTF-8 / Anyway, restarted Tomcat and then did an upload of a dummy file with an accented char in the filename (on my DEV system) - unfortunately it still doesn't work. On the Simple Item View page (https://dspace3.stir.ac.uk/dspace/handle/123456789/89), the URL appears as: https://dspace3.stir.ac.uk/dspace/bitstream/123456789/89/1/Roberto%20Ros %c3%a0%20dummy.pdf - but when this URL is accessed, DSpace returns an Invalid Identifier error: The identifier 123456789/89/1/Roberto Ros?? dummy.pdf does not correspond to a valid Bitstream in the Repository. As I say, I can't guarantee that everything is set correctly, but accented chars appear to work in most other places as you say . . . . I hope that helps. Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] RE : Error: search/segments n ot found
Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. You may find you have to restart your tomcat container and possibly run dsrun org.dspace.search.DSIndexer -c to rebuild the whole index from scratch once. I see a write.lock file present in the search dir, if your not running index_all or modifying an item in the UI, this lock is stale and you should remove it. -Mark On Jun 6, 2007, at 8:10 AM, Tellier, Stephane wrote: DSpace 1.4.2 comes with a bug fix about the index locking. This fix was done so that it could be possible to make a reindexing and media-filtering while tomcat and DSpace web app are still running. It implies that the /search directory in DSpace doesn't contains a single file named segments anymore, but instead, many files. The SRW module for DSpace suffers from this change to. I would think that Manakin will have to consider that change too. De: [EMAIL PROTECTED] de la part de Mika Stenberg Date: mer. 2007-06-06 06:45 À: For those interested in or working on an XML based interface for DSpace.; 'dspace-tech@lists.sourceforge.net' Objet : [Dspace-tech] Error: search/segments not found Just upgraded from Dspace 1.4.1 to 1.4.2 and from Manakin 1.0 to 1.1. After running index-all and filter-media I get the following error when trying to execute any search from Manakin or Dspace: Internal Server Error Message: null Description: No details available. Sender: org.dspace.app.xmlui.DSpaceCocoonServlet Source: Cocoon Servlet Request URI search cause /usr/local/dspace/search/segments (No such file or directory) request-uri /dspace/search Indeed there is no file called segments on dspace/search, only these: segments.gen _3anv.cfs _3ar3.fdt _3ar3.tis _39ho.cfs segments_4kz6 _3aog.cfs _3ar3.fdx _3a54.cfs _39nj.cfs write.lock _3apm.cfs _3ar3.fnm _32ne.cfs _39te.cfs _3aaz.cfs _3ap1.cfs _3ar3.frq _34a1.cfs _39z9.cfs _3agu.cfs _3aqs.cfs _3ar3.nrm _35wo.cfs _395y.cfs _3amp.cfs _3aq7.cfs _3ar3.prx _37jb.cfs _3ana.cfs _3ar3.cfs _3ar3.tii _39bt.cfs Any ideas whats wrong? -Mika -- --- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- --- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ~ Mark R. Diggory - DSpace Systems Manager MIT Libraries, Systems and Technology Services Massachusetts Institute of Technology - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] RE : RE : Error: search/ segments not found
Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. I'm not sure if I'm understanding correctly here, but does it means that if for example we have the actual source code of SRW and DSpace 1.4.2, we just have to recompile and all should work? I actually don't have the source code of SRW so I'm not sure how SRW would used the segments in the /search dir, but I believed that some little changes was necessary in the Manakin and SRW projects... De: Mark Diggory [mailto:[EMAIL PROTECTED] Date: mer. 2007-06-06 09:45 À: Tellier, Stephane Cc: Mika Stenberg; For those interested in or working on an XML based interface for DSpace.; dspace-tech@lists.sourceforge.net Objet : Re: [Dspace-tech] RE : Error: search/segments not found Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. You may find you have to restart your tomcat container and possibly run dsrun org.dspace.search.DSIndexer -c to rebuild the whole index from scratch once. I see a write.lock file present in the search dir, if your not running index_all or modifying an item in the UI, this lock is stale and you should remove it. -Mark On Jun 6, 2007, at 8:10 AM, Tellier, Stephane wrote: DSpace 1.4.2 comes with a bug fix about the index locking. This fix was done so that it could be possible to make a reindexing and media-filtering while tomcat and DSpace web app are still running. It implies that the /search directory in DSpace doesn't contains a single file named segments anymore, but instead, many files. The SRW module for DSpace suffers from this change to. I would think that Manakin will have to consider that change too. De: [EMAIL PROTECTED] de la part de Mika Stenberg Date: mer. 2007-06-06 06:45 À: For those interested in or working on an XML based interface for DSpace.; 'dspace-tech@lists.sourceforge.net' Objet : [Dspace-tech] Error: search/segments not found Just upgraded from Dspace 1.4.1 to 1.4.2 and from Manakin 1.0 to 1.1. After running index-all and filter-media I get the following error when trying to execute any search from Manakin or Dspace: Internal Server Error Message: null Description: No details available. Sender: org.dspace.app.xmlui.DSpaceCocoonServlet Source: Cocoon Servlet Request URI search cause /usr/local/dspace/search/segments (No such file or directory) request-uri /dspace/search Indeed there is no file called segments on dspace/search, only these: segments.gen _3anv.cfs _3ar3.fdt _3ar3.tis _39ho.cfs segments_4kz6 _3aog.cfs _3ar3.fdx _3a54.cfs _39nj.cfs write.lock _3apm.cfs _3ar3.fnm _32ne.cfs _39te.cfs _3aaz.cfs _3ap1.cfs _3ar3.frq _34a1.cfs _39z9.cfs _3agu.cfs _3aqs.cfs _3ar3.nrm _35wo.cfs _395y.cfs _3amp.cfs _3aq7.cfs _3ar3.prx _37jb.cfs _3ana.cfs _3ar3.cfs _3ar3.tii _39bt.cfs Any ideas whats wrong? -Mika - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ~ Mark R. Diggory - DSpace Systems Manager MIT Libraries, Systems and Technology Services Massachusetts Institute of Technology - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list
Re: [Dspace-tech] RE : RE : Error: search/ segments not found
Or you can just copy the new DSpace and Lucene jars from the DSpace/WEB-INF/lib directory to the SRW/WEB-INF/lib directory and be done. There are no code changes in SRW. But, while we're on the topic, my CVS repository has been down for a couple of weeks now and was in the middle of being restructured. I'll send a note (Soon!) to the list when I'm back up. Ralph From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Mark Diggory Sent: Wednesday, June 06, 2007 11:17 AM To: Tellier, Stephane Cc: dspace-tech@lists.sourceforge.net; For those interested in or working on an XML based interface for DSpace.; Mika Stenberg Subject: Re: [Dspace-tech] RE : RE : Error: search/segments not found Yes, you need to recompile both the SRW and Manakin webapps so that they contain the update DSpace code and dependency jars. Manakin is fairly clearly explained in its source distro, SRW as well. I suspect SRW just hasn't been tested against 1.4.2 at this time. (I am in the process of testing it). You can get the full distro of SRW here: http://www.oclc.org/research/software/srw/default.htm download link: http://purl.oclc.org/NET/OPENSRC/downloads/srw/SRW.zip -Mark On Jun 6, 2007, at 10:45 AM, Tellier, Stephane wrote: Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. I'm not sure if I'm understanding correctly here, but does it means that if for example we have the actual source code of SRW and DSpace 1.4.2, we just have to recompile and all should work? I actually don't have the source code of SRW so I'm not sure how SRW would used the segments in the /search dir, but I believed that some little changes was necessary in the Manakin and SRW projects... De: Mark Diggory [mailto:[EMAIL PROTECTED] Date: mer. 2007-06-06 09:45 À: Tellier, Stephane Cc: Mika Stenberg; For those interested in or working on an XML based interface for DSpace.; dspace-tech@lists.sourceforge.net Objet : Re: [Dspace-tech] RE : Error: search/segments not found Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. You may find you have to restart your tomcat container and possibly run dsrun org.dspace.search.DSIndexer -c to rebuild the whole index from scratch once. I see a write.lock file present in the search dir, if your not running index_all or modifying an item in the UI, this lock is stale and you should remove it. -Mark On Jun 6, 2007, at 8:10 AM, Tellier, Stephane wrote: DSpace 1.4.2 comes with a bug fix about the index locking. This fix was done so that it could be possible to make a reindexing and media-filtering while tomcat and DSpace web app are still running. It implies that the /search directory in DSpace doesn't contains a single file named segments anymore, but instead, many files. The SRW module for DSpace suffers from this change to. I would think that Manakin will have to consider that change too. De: [EMAIL PROTECTED] de la part de Mika Stenberg Date: mer. 2007-06-06 06:45 À: For those interested in or working on an XML based interface for DSpace.; 'dspace-tech@lists.sourceforge.net' Objet : [Dspace-tech] Error: search/segments not found Just upgraded from Dspace 1.4.1 to 1.4.2 and from Manakin 1.0 to 1.1. After running index-all and filter-media I get the following error when trying to execute any search from Manakin or Dspace: Internal Server Error Message: null Description: No details available. Sender: org.dspace.app.xmlui.DSpaceCocoonServlet Source: Cocoon Servlet Request URI search cause /usr/local/dspace/search/segments (No such file or directory) request-uri /dspace/search Indeed there is no file called segments on dspace/search, only these: segments.gen _3anv.cfs _3ar3.fdt _3ar3.tis _39ho.cfs segments_4kz6 _3aog.cfs _3ar3.fdx _3a54.cfs _39nj.cfs write.lock _3apm.cfs _3ar3.fnm _32ne.cfs _39te.cfs _3aaz.cfs _3ap1.cfs _3ar3.frq _34a1.cfs _39z9.cfs _3agu.cfs _3aqs.cfs _3ar3.nrm _35wo.cfs _395y.cfs _3amp.cfs _3aq7.cfs _3ar3.prx _37jb.cfs _3ana.cfs _3ar3.cfs _3ar3.tii _39bt.cfs Any ideas whats wrong? -Mika - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2
Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
If there is no date range specified, all records with the specified metadataPrefix must be returned by protocol section 2.7.1: http://www.openarchives.org/OAI/openarchivesprotocol.html#SelectiveHarvestingandDatestamps Harvesting is restricted to the range specified by the from and untilarguments, extending back to the earliest datestamp if from is omitted, and forward to the most recent datestamp if until is omitted. -Jodi On 6/6/07, Graham Triggs [EMAIL PROTECTED] wrote: Not really. The badArgument is valid when you don't specify a metadataPrefix, and the noRecordsMatch error is valid when there are no records that match the date range specified. If you simply include a from timestamp, eg: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadataPrefix=oai_dcfrom=2001-01-01T00:00:00Z then it works. I don't think there is anything wrong with the harvesting code per se, it just looks like it is incorrectly interpreting a from date when you don't specify one. Although according to the oaicat.properties below, the earliestDatestamp is set to 2001-01-01T00:00:00Z - exactly what I'm passing in the above url, and which works! G On Tue, 2007-06-05 at 22:37 -0400, Jodi Schneider wrote: Forwarding this back out to the list for better answers to Keith's questions. http://sourceforge.net/tracker/index.php?func=detailaid=1688523group_id=19984atid=319984 mentions the TimeStamp function of *Oracle*. Is the bug also applicable to Postgres? http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-04-01until=2007-05-15metadataPrefix=oai_dc works beautifully. However this request returns error code=badArgument. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiers Can anyone tell Keith how to fix this? Is upgrade to 1.4.2 the answer? Or...? -Jodi PS-Keith, what happens if you change granularity? i.e. in oaicat.properties change AbstractCatalog.granularity=-MM-DDThh:mm:ssZ to AbstractCatalog.granularity=-MM-DD -- Forwarded message -- From: Keith Jones [EMAIL PROTECTED] Date: Jun 5, 2007 3:41 PM Subject: Re: [Dspace-tech] Problem with Data Provider Validation To: Jodi Schneider [EMAIL PROTECTED] Hi Jodi, Thanks for the help. At my institution we are using Postgres, would this have any effect on the date granularity? Are you saying that the harvester will not work, unless you are at version 1.4.2? I've been able to get subsets if the listidentifiers working, atleast it will work when I put in a from date but will not work if no date is specified. I'm still getting the following error: Code=noRecordsMatch, Description=The combination of the values of the from, until, set, and metadataPrefix arguments results in an empty list. With the http request of: http://dspace.udel.edu:8080/dspace-oai/request, verb=ListIdentifiers, metadataPrefix=oai_dc But I can get results with the following http request http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-04-01metadataPrefix=oai_dc Thanks Keith -- Forwarded message -- From: Jodi Schneider [EMAIL PROTECTED] Date: Jun 5, 2007 9:19 AM Subject: [Dspace-tech] Problem with Data Provider Validation To: Dspace Tech dspace-tech@lists.sourceforge.net Keith, It looks like your repository is still having this problem. I think you will need to upgrade to 1.4.2 or change timestamp granularity. It looks like 1.4.2 fixed a bug regarding OAI timestamps: The oracleTimeStampFunction did not correctly account for 20 character length timestamps (-MM-DDTHH:mm:ssZ), incorrectly treating them as '-MM-DDTHH:mm:ss.FFZ'. http://sourceforge.net/tracker/index.php?func=detailaid=1688523group_id=19984atid=319984 --- I compared the file you mention to my default oaicat.properties and it looks like one block is duplicated. I wouldn't expect this to harm anything. AbstractCatalog.oaiCatalogClassName=org.dspace.app.oai.DSpaceOAICatalog AbstractCatalog.recordFactoryClassName=org.dspace.app.oai.DSpaceRecordFactory AbstractCatalog.secondsToLive=3600 AbstractCatalog.granularity=-MM-DDThh:mm:ssZ Best luck, and apologies it took so long to figure this out! -Jodi Portable Citations for DSpace On 5/29/07, Keith Jones [EMAIL PROTECTED] wrote: I did not chnage anything in the oaicat.properties. Here is my properties file: ### # REMEMBER: ONLY UPDATE THE VERSION IN dspace/config/templates # AND THEN RUN dspace/bin/install-configs! # DO NOT EDIT THE 'LIVE' VERSION! ### # OAICat Configuration file - see OAICat documentation for details # Text surrounded by two '@' symbols is replaced with the corresponding # property from dspace.cfg. For example:
[Dspace-tech] RE : RE : RE : Error : search/segments not found
Thanks guys for the explanations and sorry for the confusion I've made about this. I effectively forgot that the DSpace jars are included in the SRW war distribution (d'oh!) De: LeVan,Ralph [mailto:[EMAIL PROTECTED] Date: mer. 2007-06-06 11:32 À: Mark Diggory; Tellier, Stephane Cc: dspace-tech@lists.sourceforge.net; For those interested in or working on an XML based interface for DSpace.; Mika Stenberg Objet : RE: [Dspace-tech] RE : RE : Error: search/segments not found Or you can just copy the new DSpace and Lucene jars from the DSpace/WEB-INF/lib directory to the SRW/WEB-INF/lib directory and be done. There are no code changes in SRW. But, while we're on the topic, my CVS repository has been down for a couple of weeks now and was in the middle of being restructured. I'll send a note (Soon!) to the list when I'm back up. Ralph From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Mark Diggory Sent: Wednesday, June 06, 2007 11:17 AM To: Tellier, Stephane Cc: dspace-tech@lists.sourceforge.net; For those interested in or working on an XML based interface for DSpace.; Mika Stenberg Subject: Re: [Dspace-tech] RE : RE : Error: search/segments not found Yes, you need to recompile both the SRW and Manakin webapps so that they contain the update DSpace code and dependency jars. Manakin is fairly clearly explained in its source distro, SRW as well. I suspect SRW just hasn't been tested against 1.4.2 at this time. (I am in the process of testing it). You can get the full distro of SRW here: http://www.oclc.org/research/software/srw/default.htm download link: http://purl.oclc.org/NET/OPENSRC/downloads/srw/SRW.zip -Mark On Jun 6, 2007, at 10:45 AM, Tellier, Stephane wrote: Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. I'm not sure if I'm understanding correctly here, but does it means that if for example we have the actual source code of SRW and DSpace 1.4.2, we just have to recompile and all should work? I actually don't have the source code of SRW so I'm not sure how SRW would used the segments in the /search dir, but I believed that some little changes was necessary in the Manakin and SRW projects... De: Mark Diggory [mailto:[EMAIL PROTECTED] Date: mer. 2007-06-06 09:45 À: Tellier, Stephane Cc: Mika Stenberg; For those interested in or working on an XML based interface for DSpace.; dspace-tech@lists.sourceforge.net Objet : Re: [Dspace-tech] RE : Error: search/segments not found Manakin and SRW should be compiled off of DSpace 1.4.2 directly and so should contain the new classes. You may find you have to restart your tomcat container and possibly run dsrun org.dspace.search.DSIndexer -c to rebuild the whole index from scratch once. I see a write.lock file present in the search dir, if your not running index_all or modifying an item in the UI, this lock is stale and you should remove it. -Mark On Jun 6, 2007, at 8:10 AM, Tellier, Stephane wrote: DSpace 1.4.2 comes with a bug fix about the index locking. This fix was done so that it could be possible to make a reindexing and media-filtering while tomcat and DSpace web app are still running. It implies that the /search directory in DSpace doesn't contains a single file named segments anymore, but instead, many files. The SRW module for DSpace suffers from this change to. I would think that Manakin will have to consider that change too. De: [EMAIL PROTECTED] de la part de Mika Stenberg Date: mer. 2007-06-06 06:45 À: For those interested in or working on an XML based interface for DSpace.; 'dspace-tech@lists.sourceforge.net' Objet : [Dspace-tech] Error: search/segments not found Just upgraded from Dspace 1.4.1 to 1.4.2 and from Manakin 1.0 to 1.1. After running index-all and filter-media I get the following error when trying to execute any search from Manakin or Dspace: Internal Server Error Message: null Description: No details available. Sender: org.dspace.app.xmlui.DSpaceCocoonServlet Source: Cocoon Servlet Request URI search cause /usr/local/dspace/search/segments (No such file or directory) request-uri /dspace/search Indeed there is no file called segments on dspace/search, only these: segments.gen _3anv.cfs _3ar3.fdt _3ar3.tis _39ho.cfs segments_4kz6 _3aog.cfs _3ar3.fdx _3a54.cfs _39nj.cfs write.lock _3apm.cfs _3ar3.fnm _32ne.cfs _39te.cfs _3aaz.cfs _3ap1.cfs _3ar3.frq _34a1.cfs _39z9.cfs _3agu.cfs _3aqs.cfs _3ar3.nrm _35wo.cfs _395y.cfs _3amp.cfs _3aq7.cfs _3ar3.prx _37jb.cfs _3ana.cfs _3ar3.cfs _3ar3.tii _39bt.cfs Any ideas whats wrong? -Mika
[Dspace-tech] Arabic in an Abstract
Hi... One of our the contributors to our DSpace site would like to have Arabic interspersed in the English of the Abstract. Currently they have this on a personal website with the Arabic being displayed via an embedded GIF. Can I do this with the Abstract display? It appears to me that the Abstract display is simply plain-text. *** George Kozak Coordinator Web Development and Management Digital Media Group 501 Olin Library Cornell University 607-255-8924 *** [EMAIL PROTECTED] - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
Thanks for the additional input. I turned on debug and here is what output I am getting in the log file. 2007-06-06 14:47:48,393 INFO org.dspace.app.oai.DSpaceOAICatalog @ anonymous:no _context:oai_request:verb=listIdentifiers,from=0001-01-01T00:00:00Z,until=-1 2-31T23:59:59Z,set=null,metadataPrefix=oai_dc 2007-06-06 14:47:49,008 DEBUG org.dspace.search.Harvest @ anonymous::harvest SQL :SELECT handle.handle, handle.resource_id, item.withdrawn, item.last_modified FR OM handle, item WHERE handle.resource_type_id=2 AND handle.resource_id=item.item _id AND item.last_modified = ? AND item.last_modified = ? ORDER BY handle.r esource_id 2007-06-06 14:47:49,009 DEBUG org.dspace.storage.rdbms.DatabaseManager @ Running query SELECT handle.handle, handle.resource_id, item.withdrawn, item.last_modi fied FROM handle, item WHERE handle.resource_type_id=2 AND handle.resource_id=it em.item_id AND item.last_modified = ? AND item.last_modified = ? ORDER BY h andle.resource_id 2007-06-06 14:47:49,782 INFO org.dspace.app.oai.DSpaceOAICatalog @ anonymous:no _context:oai_error:no_items_match On Wed, 6 Jun 2007, Stuart Lewis [sdl] wrote: Hi Jodi / Keith, However this request returns error code=badArgument. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiers The 'badArgument' occurs because you need to specify which format you want the metadata in. So the following works: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadata Prefix=oai_dc However This still suffers from the problem of no records being returned when no dates are specified. As you have noticed, if you add a 'from' records are returned. (Not so if you just add a 'to'). What should be happening, is OAICat passes a 'null' for 'to' and 'from' to org.dspace.search.Harvest.java If it receives null values, it should not do any date filtering on the select query. Something must be going wrong here. To debug this, we need to see what queries are being run. Can you: 1) Upgrade your logging output to DEBUG (change 'INFO' to 'DEBUG' in [dspace]/conf/log4j.properties an then restart tomcat). 2) Watch you [dspace]/log/dspace.log file as you call the ListIdentifiers URL which is returning an empty result set. The debug output should show the output that OAICat is passing to Harvest.java, and should show the corresponding query that Harvest.java calls. If you can send these to the list, we can look into the problem further. Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
Hi Graham, I in agreement that the code is working as specified. My problem occured when I tried to register my Dspace instance with the official Open Archives registry. The registry send a listIdentifiers request with no from date specified. As such my dspace instance has failed to pass the registration test. I'm trying to determine if this is a configuration problem, or could there be bad data that is effecting the data pull. On Wed, 6 Jun 2007, Graham Triggs wrote: Not really. The badArgument is valid when you don't specify a metadataPrefix, and the noRecordsMatch error is valid when there are no records that match the date range specified. If you simply include a from timestamp, eg: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadataPrefix=oai_dcfrom=2001-01-01T00:00:00Z then it works. I don't think there is anything wrong with the harvesting code per se, it just looks like it is incorrectly interpreting a from date when you don't specify one. Although according to the oaicat.properties below, the earliestDatestamp is set to 2001-01-01T00:00:00Z - exactly what I'm passing in the above url, and which works! G On Tue, 2007-06-05 at 22:37 -0400, Jodi Schneider wrote: Forwarding this back out to the list for better answers to Keith's questions. http://sourceforge.net/tracker/index.php?func=detailaid=1688523group_id=19984atid=319984 mentions the TimeStamp function of *Oracle*. Is the bug also applicable to Postgres? http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-04-01until=2007-05-15metadataPrefix=oai_dc works beautifully. However this request returns error code=badArgument. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiers Can anyone tell Keith how to fix this? Is upgrade to 1.4.2 the answer? Or...? -Jodi PS-Keith, what happens if you change granularity? i.e. in oaicat.properties change AbstractCatalog.granularity=-MM-DDThh:mm:ssZ to AbstractCatalog.granularity=-MM-DD -- Forwarded message -- From: Keith Jones [EMAIL PROTECTED] Date: Jun 5, 2007 3:41 PM Subject: Re: [Dspace-tech] Problem with Data Provider Validation To: Jodi Schneider [EMAIL PROTECTED] Hi Jodi, Thanks for the help. At my institution we are using Postgres, would this have any effect on the date granularity? Are you saying that the harvester will not work, unless you are at version 1.4.2? I've been able to get subsets if the listidentifiers working, atleast it will work when I put in a from date but will not work if no date is specified. I'm still getting the following error: Code=noRecordsMatch, Description=The combination of the values of the from, until, set, and metadataPrefix arguments results in an empty list. With the http request of: http://dspace.udel.edu:8080/dspace-oai/request, verb=ListIdentifiers, metadataPrefix=oai_dc But I can get results with the following http request http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-04-01metadataPrefix=oai_dc Thanks Keith -- Forwarded message -- From: Jodi Schneider [EMAIL PROTECTED] Date: Jun 5, 2007 9:19 AM Subject: [Dspace-tech] Problem with Data Provider Validation To: Dspace Tech dspace-tech@lists.sourceforge.net Keith, It looks like your repository is still having this problem. I think you will need to upgrade to 1.4.2 or change timestamp granularity. It looks like 1.4.2 fixed a bug regarding OAI timestamps: The oracleTimeStampFunction did not correctly account for 20 character length timestamps (-MM-DDTHH:mm:ssZ), incorrectly treating them as '-MM-DDTHH:mm:ss.FFZ'. http://sourceforge.net/tracker/index.php?func=detailaid=1688523group_id=19984atid=319984 --- I compared the file you mention to my default oaicat.properties and it looks like one block is duplicated. I wouldn't expect this to harm anything. AbstractCatalog.oaiCatalogClassName=org.dspace.app.oai.DSpaceOAICatalog AbstractCatalog.recordFactoryClassName=org.dspace.app.oai.DSpaceRecordFactory AbstractCatalog.secondsToLive=3600 AbstractCatalog.granularity=-MM-DDThh:mm:ssZ Best luck, and apologies it took so long to figure this out! -Jodi Portable Citations for DSpace On 5/29/07, Keith Jones [EMAIL PROTECTED] wrote: I did not chnage anything in the oaicat.properties. Here is my properties file: ### # REMEMBER: ONLY UPDATE THE VERSION IN dspace/config/templates # AND THEN RUN dspace/bin/install-configs! # DO NOT EDIT THE 'LIVE' VERSION! ### # OAICat Configuration file - see OAICat documentation for details # Text surrounded by two '@' symbols is replaced with the corresponding # property from dspace.cfg. For example: # # http://dspace.udel.edu:8080/dspace
Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
On Wed, 6 Jun 2007, Jodi Schneider wrote: PS-Keith, what happens if you change granularity? i.e. in oaicat.properties change AbstractCatalog.granularity=-MM-DDThh:mm:ssZ to AbstractCatalog.granularity=-MM-DD Hi Jodi, I did make the change suggested above, but the result was the same. Thanks for all the help you have been providing. Am I correct in understanding that your Dspace instance is not exhibiting the same problem? Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: Problem with Data Provider Validation
Hi Keith, Any chance you could install this patch, and try again: http://sourceforge.net/tracker/index.php?func=detailaid=1659868group_id=19 984atid=319984 The patch gives better database debugging, as it replaces the '?' in the log file with the actual values given. We can then see the actual queries being run, and you can try them by hand to see what is being returned. Thanks, Stuart _ Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ On 6/6/07 20:20, Keith Jones [EMAIL PROTECTED] wrote: Thanks for the additional input. I turned on debug and here is what output I am getting in the log file. 2007-06-06 14:47:48,393 INFO org.dspace.app.oai.DSpaceOAICatalog @ anonymous:no _context:oai_request:verb=listIdentifiers,from=0001-01-01T00:00:00Z,until= -1 2-31T23:59:59Z,set=null,metadataPrefix=oai_dc 2007-06-06 14:47:49,008 DEBUG org.dspace.search.Harvest @ anonymous::harvest SQL :SELECT handle.handle, handle.resource_id, item.withdrawn, item.last_modified FR OM handle, item WHERE handle.resource_type_id=2 AND handle.resource_id=item.item _id AND item.last_modified = ? AND item.last_modified = ? ORDER BY handle.r esource_id 2007-06-06 14:47:49,009 DEBUG org.dspace.storage.rdbms.DatabaseManager @ Running query SELECT handle.handle, handle.resource_id, item.withdrawn, item.last_modi fied FROM handle, item WHERE handle.resource_type_id=2 AND handle.resource_id=it em.item_id AND item.last_modified = ? AND item.last_modified = ? ORDER BY h andle.resource_id 2007-06-06 14:47:49,782 INFO org.dspace.app.oai.DSpaceOAICatalog @ anonymous:no _context:oai_error:no_items_match On Wed, 6 Jun 2007, Stuart Lewis [sdl] wrote: Hi Jodi / Keith, However this request returns error code=badArgument. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiers The 'badArgument' occurs because you need to specify which format you want the metadata in. So the following works: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadata Prefix=oai_dc However This still suffers from the problem of no records being returned when no dates are specified. As you have noticed, if you add a 'from' records are returned. (Not so if you just add a 'to'). What should be happening, is OAICat passes a 'null' for 'to' and 'from' to org.dspace.search.Harvest.java If it receives null values, it should not do any date filtering on the select query. Something must be going wrong here. To debug this, we need to see what queries are being run. Can you: 1) Upgrade your logging output to DEBUG (change 'INFO' to 'DEBUG' in [dspace]/conf/log4j.properties an then restart tomcat). 2) Watch you [dspace]/log/dspace.log file as you call the ListIdentifiers URL which is returning an empty result set. The debug output should show the output that OAICat is passing to Harvest.java, and should show the corresponding query that Harvest.java calls. If you can send these to the list, we can look into the problem further. Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Servlet exception when sending mail
Hi Jason, It sounds like tomcat might be suffering from a clash of jar files proving email handling, and is using the GNU mail.jar rather than the one provided with DSpace. Might be worth looking around and seeing if there is another one sitting around which might be being used instead. Thanks, Stuart _ Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ On 6/6/07 19:13, Jason Nugent [EMAIL PROTECTED] wrote: Hi folks, Something one of my users noticed today. Our DSpace instance (latest version) is throwing an exception when ever a servlet tries to send mail. In this case, the exception was generated when someone tried to reset a forgotten password, but it happens in all email cases. My mail server is set to localhost, and I can send mail from the box just fine with the mail and sendmail commands. The full stack trace is: Jun 6, 2007 3:08:37 PM org.apache.catalina.core.StandardWrapperValve invoke SEVERE: Servlet.service() for servlet forgot threw exception java.lang.ClassCastException: gnu.mail.handler.TextPlain at javax.activation.MailcapCommandMap.getDataContentHandler(MailcapCommandMap.jav a:596) at javax.activation.MailcapCommandMap.createDataContentHandler(MailcapCommandMap. java:550) at javax.activation.DataHandler.getDataContentHandler(DataHandler.java:611) at javax.activation.DataHandler.writeTo(DataHandler.java:315) at javax.mail.internet.MimeUtility.getEncoding(MimeUtility.java:248) at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1268) at javax.mail.internet.MimeMessage.updateHeaders(MimeMessage.java:2012) at javax.mail.internet.MimeMessage.saveChanges(MimeMessage.java:1980) at javax.mail.Transport.send(Transport.java:97) at org.dspace.core.Email.send(Email.java:330) at org.dspace.eperson.AccountManager.sendEmail(AccountManager.java:294) at org.dspace.eperson.AccountManager.sendInfo(AccountManager.java:254) at org.dspace.eperson.AccountManager.sendForgotPasswordInfo(AccountManager.java:1 19) at org.dspace.app.webui.servlet.RegisterServlet.processEnterEmail(RegisterServlet .java:406) at org.dspace.app.webui.servlet.RegisterServlet.doDSPost(RegisterServlet.java:209 ) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:1 47) at org.dspace.app.webui.servlet.DSpaceServlet.doPost(DSpaceServlet.java:105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFi lterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChai n.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java :210) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java :174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:1 08) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:870) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processCon nection(Http11BaseProtocol.java:665) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: 528) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWork erThread.java:81) Ideas appreciated. Thanks, Jason - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] New users not seeing items in task pool
If a new e-person is created after items have been submitted to the workflow, then the items don't display in their list of Tasks in the Pool. The older workflow items only display if they are accepted by another e-person and returned to the task pool. Does anybody know how to fix this problem? Thanks, Donna Barber Applications Support Librarian Central Library University of Canterbury Te Whare Wananga o Waitaha Christchurch, New Zealand ph: +64 3 3642987 ext 8601 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Metadata import from Excel into DSpace archive
Thanks Majx for letting me know that the program for metadata generation runs smoothly in your environment. Just wondering whether DSpace group has any plan to integrate this functionality into the upcoming version of DSpace Regards, Jayan From: majx [mailto:[EMAIL PROTECTED] Sent: Thursday, June 07, 2007 8:43 AM To: Jayan Chirayath Kurian Subject: Re: RE: [Dspace-tech] Metadata import from Excel into DSpace archive(revised program) Hi! Jayan, Thank you for your help and attention. I do as your instruction, and get the metadata archive folder generated in DSpace format. I think it will be better that the function of import data be integrated into the UI when the new edition of Dspace1.5 published. But I don't know if the Dspace group has the plan. Thanks again for your warmly help. majx 2007-06-07 - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
