[Dspace-tech] Postgres optimizations
Im hoping to get some hints for postgres performance optimization. Our DSpace (1.4.1) has started to run really slow after the number of items exceeded 40 000 (mainly metadata, few full texts only). I tried increasing work_memory and max_fsm_pages in postgres.conf but with little help. Im also running regular vacuum and reindex for the db. Any help would be appreaciated, -Mika - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughts please
On Fri, May 25, 2007 at 03:39:12PM -0500, Brad Teale wrote: How do you determine which PI system generates a PId (base it on collection, community)? What if one PI system fails (URL unreachable, temporarily down) and it is needed to resolve the PId? Could it be possible to create a loop of PIds that resolve to different PI systems while moving through the PI system stack? Something to note is that I don't anticipate objects normally having more than one identifier. While the prototype allows this, it will still be the case that objects are only assigned one identifier (according to configuration -- the details of which are still undecided) but now we are able to associate multiople identifiers to objects (the stack is there to define what we understand), and resolve them all to the correct place. 3) Including special characters in the URL string doesn't seem like a good idea. While they are valid characters, it does take extra processing to encode/decode them from layer to layer. Why not just leave the URL alone or change /handle to something like /uri, /id, or /pid? Why encode the PI system into the URI? As I mention on the wiki, my current idea is to have URLs of the form: http://dspace.me.ac.uk/uri/hdl:1234/56 which will resolve to the object with Handle 1234/56, etc. If the object also has a DOI with value 7890/12 then the following URL would point to the object as well: http://dspace.me.ac.uk/uri/doi:7890/12 It is necessary to include the hdl: and doi: parts so we can distinguish between different persistent identifier mechanisms. The values allowed for the persistent identifier are dependent on the mechanism we are dealing with, and as far as possible this will be kept simple. As far as having a default PI system out of the box for Dspace, I would recommend using a local identifier schema which used the existing URLs. Include the Handle PI system in the release as a configurable option, but not turned on by default. This would remove the fake handle being assigned to all objects and clean up the default URLs out of the box. I've already experimented with a null identifier that can be used to resolve to objects locally. For example, in my prototype, the following url would resolve to the Item with internal id 4: http://dspace.me.ac.uk/uri/dsi:2/4 I'm still not convinced that this is a good idea, but it seems useful and it makes accessing individual bitstreams a little more predictable and consistent with the other objects. cheers, Jim -- James Rutherford | Hewlett-Packard Limited registered Office: Research Engineer | Cain Road, HP Labs | Bracknell, Bristol, UK | Berks +44 117 312 7066 | RG12 1HN. [EMAIL PROTECTED] | Registered No: 690597 England The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error, you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated you should consider this message and attachments as HP CONFIDENTIAL. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
On Tue, 2007-05-29 at 10:44 +0100, James Rutherford wrote: 3) Including special characters in the URL string doesn't seem like a good idea. While they are valid characters, it does take extra processing to encode/decode them from layer to layer. As I mention on the wiki, my current idea is to have URLs of the form: http://dspace.me.ac.uk/uri/hdl:1234/56 which will resolve to the object with Handle 1234/56, etc. If the object also has a DOI with value 7890/12 then the following URL would point to the object as well: http://dspace.me.ac.uk/uri/doi:7890/12 It is necessary to include the hdl: and doi: parts so we can distinguish between different persistent identifier mechanisms. The values allowed for the persistent identifier are dependent on the mechanism we are dealing with, and as far as possible this will be kept simple. Whilst it is necessary to identify the persistent id scheme, that doesn't mean that using a colon as part of the identifier is necessary or desirable. Colons - or other 'unusual' characters - will end up causing problems. In fact, I don't even see that there is a reason to include 'uri' in the url. Why not just support the existing: http://dspace.me.ac.uk/handle/1234/56 for handles, and: http://dspace.me.ac.uk/doi/7890/12 for DOIs, etc.? G This e-mail is confidential and should not be used by anyone who is not the original intended recipient. BioMed Central Limited does not accept liability for any statements made which are clearly the sender's own and not expressly made on behalf of BioMed Central Limited. No contracts may be concluded on behalf of BioMed Central Limited by means of e-mail communication. BioMed Central Limited Registered in England and Wales with registered number 3680030 Registered Office Middlesex House, 34-42 Cleveland Street, London W1T 4LB - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
On Tue, May 29, 2007 at 11:12:13AM +0100, Graham Triggs wrote: On Tue, 2007-05-29 at 10:44 +0100, James Rutherford wrote: 3) Including special characters in the URL string doesn't seem like a good idea. While they are valid characters, it does take extra processing to encode/decode them from layer to layer. As I mention on the wiki, my current idea is to have URLs of the form: http://dspace.me.ac.uk/uri/hdl:1234/56 which will resolve to the object with Handle 1234/56, etc. If the object also has a DOI with value 7890/12 then the following URL would point to the object as well: http://dspace.me.ac.uk/uri/doi:7890/12 It is necessary to include the hdl: and doi: parts so we can distinguish between different persistent identifier mechanisms. The values allowed for the persistent identifier are dependent on the mechanism we are dealing with, and as far as possible this will be kept simple. Whilst it is necessary to identify the persistent id scheme, that doesn't mean that using a colon as part of the identifier is necessary or desirable. Colons - or other 'unusual' characters - will end up causing problems. I don't see what's so unusual or undesirable about colons. The reasoning behind doing it this way was so that the value after /uri/ is the canonical form of the identifier. In fact, I don't even see that there is a reason to include 'uri' in the url. Why not just support the existing: http://dspace.me.ac.uk/handle/1234/56 for handles, and: http://dspace.me.ac.uk/doi/7890/12 for DOIs, etc.? This is certainly an option. Jim -- James Rutherford | Hewlett-Packard Limited registered Office: Research Engineer | Cain Road, HP Labs | Bracknell, Bristol, UK | Berks +44 117 312 7066 | RG12 1HN. [EMAIL PROTECTED] | Registered No: 690597 England The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error, you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated you should consider this message and attachments as HP CONFIDENTIAL. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
On Tue, 2007-05-29 at 11:43 +0100, James Rutherford wrote: I don't see what's so unusual or undesirable about colons. The reasoning behind doing it this way was so that the value after /uri/ is the canonical form of the identifier. The colon is a reserved character, and in this example would have to be encoded to be strictly valid according to the specifications - which would then mean it isn't the canonical form. Not encoding the colon will have the potential to cause problems with proxies, firewalls, etc. G This email has been scanned by Postini. For more information please visit http://www.postini.com - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
On Tue, May 29, 2007 at 11:56:58AM +0100, Graham Triggs wrote: On Tue, 2007-05-29 at 11:43 +0100, James Rutherford wrote: I don't see what's so unusual or undesirable about colons. The reasoning behind doing it this way was so that the value after /uri/ is the canonical form of the identifier. The colon is a reserved character, and in this example would have to be encoded to be strictly valid according to the specifications - which would then mean it isn't the canonical form. Well if we're going to be strict, we should escape the value of the handle 1234/56 as 1234%2F56. Since DSpace already breaks this rule, I didn't deem including a colon as such a great crime ;) Of course, it would be better if we could use an identifier scheme that didn't require escaped characters, but most will at least have a / to separate prefix from suffix. If we're going to be strict, I think I'd favour the following form: http://dspace.me.ac.uk/uri/hdl%3A1234%2F56 or maybe http://dspace.me.ac.uk/uri/hdl/1234%2F56 Jim -- James Rutherford | Hewlett-Packard Limited registered Office: Research Engineer | Cain Road, HP Labs | Bracknell, Bristol, UK | Berks +44 117 312 7066 | RG12 1HN. [EMAIL PROTECTED] | Registered No: 690597 England The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error, you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated you should consider this message and attachments as HP CONFIDENTIAL. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
Hey Folks, PI resolvers come in all shapes and sizes, What all your talking about implementing is proxy/resolution. I would highly recommend NOT conflating the PI resolution mechanism (and why do we even have to have one) with the url path with which a Community, Collection, Item or Bitstream is referenced under in DSpace. What this means is that you do not have a url on with you have to worry about the identifier being properly escaped. You also only have to be concerned with resolving one path to the Item for any PI system. I.E. hdl:1234/5 -- http://dspace.me.ac.uk/item/ABCD and also doi:6789/0 -- http://dspace.me.ac.uk/item/ABCD Don't conflate local and global identification. Cheers, Mark Diggory On May 29, 2007, at 7:52 AM, James Rutherford wrote: On Tue, May 29, 2007 at 11:56:58AM +0100, Graham Triggs wrote: On Tue, 2007-05-29 at 11:43 +0100, James Rutherford wrote: I don't see what's so unusual or undesirable about colons. The reasoning behind doing it this way was so that the value after /uri/ is the canonical form of the identifier. The colon is a reserved character, and in this example would have to be encoded to be strictly valid according to the specifications - which would then mean it isn't the canonical form. Well if we're going to be strict, we should escape the value of the handle 1234/56 as 1234%2F56. Since DSpace already breaks this rule, I didn't deem including a colon as such a great crime ;) Of course, it would be better if we could use an identifier scheme that didn't require escaped characters, but most will at least have a / to separate prefix from suffix. If we're going to be strict, I think I'd favour the following form: http://dspace.me.ac.uk/uri/hdl%3A1234%2F56 or maybe http://dspace.me.ac.uk/uri/hdl/1234%2F56 Jim -- James Rutherford | Hewlett-Packard Limited registered Office: Research Engineer | Cain Road, HP Labs | Bracknell, Bristol, UK | Berks +44 117 312 7066 | RG12 1HN. [EMAIL PROTECTED] | Registered No: 690597 England The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error, you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated you should consider this message and attachments as HP CONFIDENTIAL. -- --- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ~ Mark R. Diggory - DSpace Systems Manager MIT Libraries, Systems and Technology Services Massachusetts Institute of Technology - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
On Tue, 2007-05-29 at 12:52 +0100, James Rutherford wrote: Well if we're going to be strict, we should escape the value of the handle 1234/56 as 1234%2F56. Since DSpace already breaks this rule, I didn't deem including a colon as such a great crime ;) Fair point, and you are probably right. But there is strict and there is strict... and it isn't entirely clear that the handle should be treated as a complete unit rather than the separation of prefix and suffix - globally, that's how they need to be referred to, but then we're discussing local urls here ;-) Yes an unescaped slash isn't going to do anything harmful. An unescaped colon in the middle of the url could easily trigger url parsing bugs and security problems. G This email has been scanned by Postini. For more information please visit http://www.postini.com - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Persistent identifiers in DSpace -- thoughtsplease
On Tue, May 29, 2007 at 08:21:47AM -0400, Mark Diggory wrote: PI resolvers come in all shapes and sizes, What all your talking about implementing is proxy/resolution. I would highly recommend NOT conflating the PI resolution mechanism (and why do we even have to have one) with the url path with which a Community, Collection, Item or Bitstream is referenced under in DSpace. What this means is that you do not have a url on with you have to worry about the identifier being properly escaped. You also only have to be concerned with resolving one path to the Item for any PI system. I.E. hdl:1234/5 -- http://dspace.me.ac.uk/item/ABCD and also doi:6789/0 -- http://dspace.me.ac.uk/item/ABCD OK, this is fine, but we'll need to define the form that we want for the URL. If we don't use the canonical form of persistent identifiers for this, then we'll need to use another identifier that is unique across the site (presumably, something based on the database id of the object). Using UUIDs (as suggested earlier) would *work*, but would produce horrid URLs. cheers, Jim -- James Rutherford | Hewlett-Packard Limited registered Office: Research Engineer | Cain Road, HP Labs | Bracknell, Bristol, UK | Berks +44 117 312 7066 | RG12 1HN. [EMAIL PROTECTED] | Registered No: 690597 England The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error, you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated you should consider this message and attachments as HP CONFIDENTIAL. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Claudia, Yes, I used both sites and both are reporting and error in the XML returned. The VlaidateSite failed on the return of the ?verb=Identify call. And the explorer site returned and error for all the test. On Tue, 29 May 2007, Claudia Jürgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
I initial tried using both tools. Seems like I've made progress, and have passed the first 2 test but now the test has failed on the following: request?verb=ListIdentifiersmetadataPrefix=oai_dc On Tue, 29 May 2007, Claudia J?rgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Keith, Can we see the repository, to see what errors it gives us? Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ On 29/5/07 16:20, Keith Jones [EMAIL PROTECTED] wrote: Hi Claudia, Yes, I used both sites and both are reporting and error in the XML returned. The VlaidateSite failed on the return of the ?verb=Identify call. And the explorer site returned and error for all the test. On Tue, 29 May 2007, Claudia Jürgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Stuart, Thanks for the help. Currently my initial problem originated because I did not specify the correct base url. Since correcting that problem the repository is not pass the ListIdentifiers test. The base url is: http://dspace.udel.edu:8080/dspace-oai/request On Tue, 29 May 2007, Stuart Lewis [sdl] wrote: Hi Keith, Can we see the repository, to see what errors it gives us? Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ On 29/5/07 16:20, Keith Jones [EMAIL PROTECTED] wrote: Hi Claudia, Yes, I used both sites and both are reporting and error in the XML returned. The VlaidateSite failed on the return of the ?verb=Identify call. And the explorer site returned and error for all the test. On Tue, 29 May 2007, Claudia Jürgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Keith, Thanks for the help. Currently my initial problem originated because I did not specify the correct base url. Since correcting that problem the repository is not pass the ListIdentifiers test. The base url is: http://dspace.udel.edu:8080/dspace-oai/request Weird! http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersmetadata Prefix=oai_dc suggests that you have no records, but your repository has plenty! It is talking to your database OK: http://dspace.udel.edu:8080/dspace-oai/request?verb=ListSets Do your log files ([dspace]/log/) show anything? If you turn logging up to DEBUG, they might show something, and will show the calls being made to the database. Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Keith, Seems to be some date problem as http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2000-05-02until=2007-05-02metadataPrefix=oai_dc adding the optional arguments for from and until works. So there must be something with the implicit from earlist date until today for this request if no date range is given. Claudia Keith Jones schrieb: I initial tried using both tools. Seems like I've made progress, and have passed the first 2 test but now the test has failed on the following: request?verb=ListIdentifiersmetadataPrefix=oai_dc On Tue, 29 May 2007, Claudia J�rgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Keith, this error occurs if the date argument is wrong e.g. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-05-02until=2006-05-02metadataPrefix=oai_dc having from until did you change any basic settings, e.g. oaicat.properties Claudia Keith Jones schrieb: Hi Stuart, Thanks for the help. Currently my initial problem originated because I did not specify the correct base url. Since correcting that problem the repository is not pass the ListIdentifiers test. The base url is: http://dspace.udel.edu:8080/dspace-oai/request On Tue, 29 May 2007, Stuart Lewis [sdl] wrote: Hi Keith, Can we see the repository, to see what errors it gives us? Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ On 29/5/07 16:20, Keith Jones [EMAIL PROTECTED] wrote: Hi Claudia, Yes, I used both sites and both are reporting and error in the XML returned. The VlaidateSite failed on the return of the ?verb=Identify call. And the explorer site returned and error for all the test. On Tue, 29 May 2007, Claudia Jürgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
Hi Keith, what does your dspace log files say? Search for verb=listIdentifiers This should be verb=listIdentifiers,from=0001-01-01T00:00:00Z,until=-12 -31T23:59:59Z,set=null,metadataPrefix=oai_dc if no date range was given Claudia Keith Jones schrieb: I initial tried using both tools. Seems like I've made progress, and have passed the first 2 test but now the test has failed on the following: request?verb=ListIdentifiersmetadataPrefix=oai_dc On Tue, 29 May 2007, Claudia J�rgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Data Provider Validation
I did not chnage anything in the oaicat.properties. Here is my properties file: ### # REMEMBER: ONLY UPDATE THE VERSION IN dspace/config/templates # AND THEN RUN dspace/bin/install-configs! # DO NOT EDIT THE 'LIVE' VERSION! ### # OAICat Configuration file - see OAICat documentation for details # Text surrounded by two '@' symbols is replaced with the corresponding # property from dspace.cfg. For example: # # http://dspace.udel.edu:8080/dspace # # would be replaced with the dspace.url property in dspace.cfg. # When /dspace/bin/install-configs is run, this file will be installed in the # location specified by the property: config.template.oaicat.properties AbstractCatalog.oaiCatalogClassName=org.dspace.app.oai.DSpaceOAICatalog AbstractCatalog.recordFactoryClassName=org.dspace.app.oai.DSpaceRecordFactory AbstractCatalog.secondsToLive=3600 AbstractCatalog.granularity=-MM-DDThh:mm:ssZ AbstractCatalog.oaiCatalogClassName=org.dspace.app.oai.DSpaceOAICatalog AbstractCatalog.recordFactoryClassName=org.dspace.app.oai.DSpaceRecordFactory AbstractCatalog.secondsToLive=3600 AbstractCatalog.granularity=-MM-DDThh:mm:ssZ # Custom Identify response values Identify.repositoryName=DSpace at UD [EMAIL PROTECTED] Identify.earliestDatestamp=2001-01-01T00:00:00Z Identify.deletedRecord=persistent # List the supported metadataPrefixes along with the class that performs the ass ociated crosswalk #Crosswalks.didl=org.dspace.app.oai.DIDLCrosswalk #Crosswalks.mets=org.dspace.app.oai.METSCrosswalk Crosswalks.oai_dc=org.dspace.app.oai.OAIDCCrosswalk # OAI crosswalks that use crosswalk plugins. The # metadataPrefixes must match the name of the plugin # for interface org.dspace.content.crosswalk.DisseminationCrosswalk # Crosswalks.mods=org.dspace.app.oai.PluginCrosswalk # Crosswalks.mets=org.dspace.app.oai.PluginCrosswalk # Crosswalks.qdc=org.dspace.app.oai.PluginCrosswalk On Tue, 29 May 2007, Claudia Jürgen wrote: Hi Keith, this error occurs if the date argument is wrong e.g. http://dspace.udel.edu:8080/dspace-oai/request?verb=ListIdentifiersfrom=2007-05-02until=2006-05-02metadataPrefix=oai_dc having from until did you change any basic settings, e.g. oaicat.properties Claudia Keith Jones schrieb: Hi Stuart, Thanks for the help. Currently my initial problem originated because I did not specify the correct base url. Since correcting that problem the repository is not pass the ListIdentifiers test. The base url is: http://dspace.udel.edu:8080/dspace-oai/request On Tue, 29 May 2007, Stuart Lewis [sdl] wrote: Hi Keith, Can we see the repository, to see what errors it gives us? Thanks, Stuart _ Datblygydd Cymwysiadau'r WeWeb Applications Developer Gwasanaethau Gwybodaeth Information Services Prifysgol Cymru Aberystwyth University of Wales Aberystwyth E-bost / E-mail: [EMAIL PROTECTED] Ffon / Tel: (01970) 622860 _ On 29/5/07 16:20, Keith Jones [EMAIL PROTECTED] wrote: Hi Claudia, Yes, I used both sites and both are reporting and error in the XML returned. The VlaidateSite failed on the return of the ?verb=Identify call. And the explorer site returned and error for all the test. On Tue, 29 May 2007, Claudia Jürgen wrote: Hi Keith, did you use the OAI Validation tool: http://www.openarchives.org/Register/ValidateSite or the repository explorer http://re.cs.uct.ac.za/ ? Claudia Keith Jones schrieb: Hello, We are running DSpace version 1.4.1, and we want to register our repository as a OAI data provider. I went to register but am unable to because of the following error: Malformed response: mismatched tag at line 11, column 62, byte 1114 We are sending back malformed XML when requests are being made. Any help with this would be appreciated. Thanks Keith - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net
[Dspace-tech] psql restoring a dump
I'm attempting to revisit this nasty process. I'm testing again to see if I can ever get this to work to have a suitable way for a migration path for new versions of Postgresql. I was able to backup my data using: pg_dump -Fc dspace /dspace/backup Then I recreated the database, per Postgresql's instruction for a new database (as if it was a new installation) Then following the instructions: psql dspace /dspace/backup I get the following errors: ERROR: syntax error at or near PGDMP at character 1 ERROR: syntax error at or near AS at character 5 ERROR: syntax error at or near at character 1 ERROR: syntax error at or near at character 1 ---Ad nausem Then garbage characters. Facts regarding this procedure: User logged in as Dspace (My assumption is user Dspace is able to perform the backup) Postgres version: 7.4.6 for testing. Any postgres guru's out there that want to give me a hand in this? I would really like to master this, since snapshots, while good, do not let you have a migration path. TIA, Jeffrey A. Trimble Systems Librarian Youngstown State University Youngstown, OH [EMAIL PROTECTED] (330) 941-2483 http://digital.maag.ysu.edu http://www.maag.ysu.edu http://jupiter.ysu.edu - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] psql restoring a dump
On Tue, May 29, 2007 at 02:06:04PM -0400, Jeffrey Trimble wrote: I'm attempting to revisit this nasty process. I'm testing again to see if I can ever get this to work to have a suitable way for a migration path for new versions of Postgresql. I was able to backup my data using: pg_dump -Fc dspace /dspace/backup This produces a custom archive dump, suitable for input into pg_restore. Then I recreated the database, per Postgresql's instruction for a new database (as if it was a new installation) Then following the instructions: psql dspace /dspace/backup For this to work, /dspace/backup would need to be the output of 'pg_dump -Fp'. You should be able to restore this dump using something like 'pg_restore -d dspace /dspace/backup'. 'man pg_restore' and read carefully to see what other options you may need. In particular read about how pg_restore handles ownership of database objects. Please take my PG suggestions only with a grain of salt. I don't do this stuff often enough to really learn it. FWIW here's a sample from crontab on one of my production DSpace hosts, showing how I do the nightly database dump: 00 02 * * * /usr/bin/pg_dump -Ft -U tomcat -b dspace | gzip -9 /opt/dspace/db.tar.gz (A system backup job comes along later and copies the dump to tape.) -- Mark H. Wood, Lead System Programmer [EMAIL PROTECTED] Typically when a software vendor says that a product is intuitive he means the exact opposite. pgpxChsuACnPT.pgp Description: PGP signature - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Need Sample for LNI
I'm trying to get up an running on LNI, but can't seem to get the syntax for PUT just right (I keep getting either 400 or 500 http errors). Is there anybody out there who can send me a syntax sample along with a sample package? I'm working with the LNISmokeTest class. The smoke test has a method doPut() which ought to be a viable example. Is that what you're using? It takes the Handle of a collection which you have write access too. The Handle should be a string like 123456789/241; the sample code uses the Lookup operation to get its LNI resource URI. Check that the packager value names a PackgeIngester plugin configured in dspace.cfg. It may help to crank up the log level to DEBUG and look at the server logs. -- Larry - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Import : Fatal error UTF-1
Hi I am using Foxpro 6.0 to write the .xml files for importing. The importer (Dspace 1.3.2 on FC 3.0) gives a fatal error for special characters (e.g ° ð ö alpha , beta etc. ) in dublin_core file I have tried file converters from ANSI to UTF-8 but no use the importer fumbles. Is there any other way / utility to overcome this problem. Tushar Sangamnerkar TIRC Pune - You snooze, you lose. Get messages ASAP with AutoCheck in the all-new Yahoo! Mail Beta. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
