Re: [Dspace-tech] Adding metadata automatically to a user submitted item
In Dspace 1.5.1, when you create a new collection, in the Describe step you check a box that says, New submissions will have some metadata already filled out with defaults. Another screen will display that will allow you to enter Default Item Metadata. Whenever a new submission is started in this collection, it will have the metadata you entered already filled out. Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Tim Ribaric [mailto:triba...@brocku.ca] Sent: Thursday, July 15, 2010 4:03 PM To: DSpace Tech(dspace-tech@lists.sourceforge.net) Subject: [Dspace-tech] Adding metadata automatically to a user submitted item Hello List, Does anyone know how (if possible) to configure a self submission in DSpace to pre-populate certain fields all hidden from the user? For example if I have a user submitting a Thesis is there any way I can fix dc.type to equal Thesis in such a way that the user doesn't need to pick it from a dropdown, since they are getting a customized submit form anyway. Basically I want to set some dc values at time of submission in a way that is transparent to the user? Thanks, Tim + |Tim Ribaric |Digital Services Librarian | Brock University -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] java.lang.outOfMemory error trying to run index-init
Thanks for your time Richard! Sue From: Richard Rodgers [mailto:rrodg...@mit.edu] Sent: Wednesday, June 23, 2010 10:40 AM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net; Smail, James W. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: Re: [Dspace-tech] java.lang.outOfMemory error trying to run index-init Hi Sue: Yes, I saw the post, and thanks for these numbers - I just wanted to make sure there wasn't some issue of scale that was 'hidden' under the raw item count (e.g that your articles were 10 times bigger on avg). And now the indexing time is at least roughly proportional. I haven't studied the behavior of those parameters, so have no specific advice at the moment - but I'll keep your values in mind when I look next at indexing code... Thanks, Richard On Jun 21, 2010, at 9:44 PM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: Hi Richard, I don't know if you saw my subsequent post today, but I ended up changing two dspace.cfg parameters and it sped up index-init considerably - it only took a day and a half this time. I'm a bit worried about the impact it's had on our full-text searching. Since we had a large repository, I had our search.max-clauses set at 200,000 and I changed it to 4096 which is twice the default. I also changed search.maxfieldlength from -1 (unlimited) to 10,000 for the same reason. What do you think? See our numbers below. Thanks a bunch, Sue From: Richard Rodgers [mailto:rrodg...@mit.edu] Sent: Monday, June 21, 2010 1:50 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net; William L Hays Subject: Re: [Dspace-tech] java.lang.outOfMemory error trying to run index-init Hi Sue: I don't have any immediate help, but I'm struck by how long the indexing job is taking. I had a comparison done with one of our DSpace 1.6 repositories which is about half the size of yours (71,481 items), and is mostly text-based content (which I think yours is also?) On not particularly fast hardware, a complete re-index took about 5 hours - not 5 days. There may be some subtle limit in the code based on size - so to get started, I did a 'profile' of our repo with respect to full-text content (which I am assuming accounts for most of the indexing time - but I could be wrong). Here is the 'profile' and the queries we used to get it. I'd be interested to see what your repo looks like using the same metrics. [Sue T.] Our numbers in blue to the right of yours: count of items 71,481[Sue T.] 140,337 count of bitstreams in text extract bundles (TEXT): 89,993[Sue T.] 134,215 sum of all file sizes in text extract bundles:7,695,414,829[Sue T.] 12,804,764,306 average size of text extract bitstream: 85,511[Sue T.] 95,405 Queries used: select count(bs.bitstream_id) from bundle b, bundle2bitstream b2b, bitstream bs where b2b.bundle_id = b.bundle_id and b2b.bitstream_id = bs.bitstream_id and b.namehttp://b.name/ = 'TEXT' select sum(bs.size_bytes) from bundle b, bundle2bitstream b2b, bitstream bs where b2b.bundle_id = b.bundle_id and b2b.bitstream_id = bs.bitstream_id and b.namehttp://b.name/ = 'TEXT' Thanks, Richard On Jun 19, 2010, at 7:50 PM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: We have a large repository, currently with 140,376 Items. Due to user complaints about search results, we recently turned off stemming in our DSpace 1.5.1 search by commenting out the following line in DSAnalyzer.java: result = new PorterStemFilter(result); Of course then we had to run index-init to rebuild the search indexes and we've been having problems getting the job to finish. Due to the size of our repository, index-init takes about 5 or 6 days to complete and now it's failed twice due to the following error: An unexpected error has been detected by Java Runtime Environment: # # java.lang.OutOfMemoryError: requested 655360 bytes for GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space? # # Internal Error (allocation.inline.hpp:42), pid=23486, tid=5 # Error: GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp # # Java VM: Java HotSpot(TM) Server VM (10.0-b19 mixed mode solaris-sparc) # An error report file with more information is saved as: # /dspace/hs_err_pid23486.log # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # Abort - core dumped Can someone please help us with this? This most recent time index-init failed was 4½ days into the index rebuild - after indexing 104,082 out of 140,376 items and now it looks like if we want an accurate
Re: [Dspace-tech] java.lang.outOfMemory error trying to run index-init
I ended up changing some DSpace config parameters and re-running index-init and this time it completed successfully, and in less than half the time it took to run it before. I'm a bit worried about the impact of changing these parameters and would like some feedback on this. Here are the changes I made to dspace.cfg (we are running version 1.5.1): search.max-clauses: The default is 2048. The documentation says, Higher values of search.max-clauses will enable prefix searches to work on large repositories. Since we have a large repository, and we want it to be completely full-text searchable, I had ours set at 200,000. I now have ours set at 4096. I'm not exactly sure what the impact of this change is though. search.maxfieldlength: The default is 1. The documentation says, Maximum number of terms indexed for a single field in Lucene. Default is 10,000 words - often not enough for full-text indexing. If you change this, you'll need to re-index for the change to take effect on previously added items. -1 = unlimited (Integer.MAX_VALUE). Again, since we have a large repository, and we want it to be completely full-text searchable, I had ours set at -1 (unlimited). I now have it set back at the default - 1. After I made these changes, I re-ran index-init and, instead of taking 5-6 days to complete, it completed in about a day and a half. It also did NOT get that memory error (below) it got the last 2 times I tried to run it with the old search.max-clauses and search.maxfieldlength settings we were using. Here are our other search parameters in dspace.cfg: search.operator:We have ours set at OR. search.index.?: # Fields to Index for Search # # DC metadata elements.qualifiers to be indexed for search # format: - search.index.[number] = [search field]:element.qualifier # - * used as wildcard ### changing these will change your search results, ### ### but will NOT automatically change your search displays ### search.index.1 = author:dc.contributor.author search.index.2 = corpauthor:dc.contributor.corpAuthor search.index.3 = corpauthor:dc.contributor.authorAffiliation search.index.4 = title:dc.title search.index.5 = titlecontrolkey:dc.identifier.titleControlKey search.index.6 = accessionnumber:dc.identifier.accessionNumber search.index.7 = reportnumber:dc.identifier.reportNumber search.index.8 = subjectkeyword:dc.subject.keywords webui.browse.index.?: webui.browse.index.1 = dateissued:item:dateissued:desc webui.browse.index.2 = author:metadata:dc.contributor.author:text webui.browse.index.3 = title:item:title webui.browse.index.4 = subject:metadata:dc.subject.keywords:text webui.browse.index.5 = dateaccessioned:item:dateaccessioned:desc webui.browse.index.6 = corpauthor:metadata:dc.contributor.corpAuthor:text Since the changes I made resulted in index-init completing much quicker than before, and it seems to have gotten rid of the Memory/Out of Swap space error, I'm wondering what we lost, if anything, in our search results or if this should even be a concern for us. Any suggestions/advise would be appreciated! Thanks, Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Saturday, June 19, 2010 7:51 PM To: dspace-tech@lists.sourceforge.net Cc: Kimbrough, Glenn W. (LARC-B7)[NCI]; Warren, Douglas Lewis (LARC-B7)[NCI]; Smail, James W. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: [Dspace-tech] java.lang.outOfMemory error trying to run index-init We have a large repository, currently with 140,376 Items. Due to user complaints about search results, we recently turned off stemming in our DSpace 1.5.1 search by commenting out the following line in DSAnalyzer.java: result = new PorterStemFilter(result); Of course then we had to run index-init to rebuild the search indexes and we've been having problems getting the job to finish. Due to the size of our repository, index-init takes about 5 or 6 days to complete and now it's failed twice due to the following error: An unexpected error has been detected by Java Runtime Environment: # # java.lang.OutOfMemoryError: requested 655360 bytes for GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space? # # Internal Error (allocation.inline.hpp:42), pid=23486, tid=5 # Error: GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp # # Java VM: Java HotSpot(TM) Server VM (10.0-b19 mixed mode solaris-sparc) # An error report file with more information is saved as: # /dspace/hs_err_pid23486.log # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # Abort - core dumped Can someone please help us with this? This most recent time index-init failed was 4½ days into the index rebuild - after indexing 104,082 out of 140,376 items and now it looks like if we want an accurate
[Dspace-tech] Adding another dspace.log file to DSpace 1.5.1?
We have Google crawling our DSpace site daily and it really fills up our DSpace .log files. We would like to implement a second dspace.log file (google.log?) in DSpace 1.5.1 and would like to know if this is an easy thing to accomplish. Has anyone done this? Also we'd like to know where to tell DSpace to allow more than the current 500 versions of our rolling DSpace .log files? Thanks in advance, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image001.gif-- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] java.lang.outOfMemory error trying to run index-init
Hi Richard, I don't know if you saw my subsequent post today, but I ended up changing two dspace.cfg parameters and it sped up index-init considerably - it only took a day and a half this time. I'm a bit worried about the impact it's had on our full-text searching. Since we had a large repository, I had our search.max-clauses set at 200,000 and I changed it to 4096 which is twice the default. I also changed search.maxfieldlength from -1 (unlimited) to 10,000 for the same reason. What do you think? See our numbers below. Thanks a bunch, Sue From: Richard Rodgers [mailto:rrodg...@mit.edu] Sent: Monday, June 21, 2010 1:50 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net; William L Hays Subject: Re: [Dspace-tech] java.lang.outOfMemory error trying to run index-init Hi Sue: I don't have any immediate help, but I'm struck by how long the indexing job is taking. I had a comparison done with one of our DSpace 1.6 repositories which is about half the size of yours (71,481 items), and is mostly text-based content (which I think yours is also?) On not particularly fast hardware, a complete re-index took about 5 hours - not 5 days. There may be some subtle limit in the code based on size - so to get started, I did a 'profile' of our repo with respect to full-text content (which I am assuming accounts for most of the indexing time - but I could be wrong). Here is the 'profile' and the queries we used to get it. I'd be interested to see what your repo looks like using the same metrics. [Sue T.] Our numbers in blue to the right of yours: count of items 71,481[Sue T.] 140,337 count of bitstreams in text extract bundles (TEXT): 89,993[Sue T.] 134,215 sum of all file sizes in text extract bundles:7,695,414,829[Sue T.] 12,804,764,306 average size of text extract bitstream: 85,511[Sue T.] 95,405 Queries used: select count(bs.bitstream_id) from bundle b, bundle2bitstream b2b, bitstream bs where b2b.bundle_id = b.bundle_id and b2b.bitstream_id = bs.bitstream_id and b.namehttp://b.name/ = 'TEXT' select sum(bs.size_bytes) from bundle b, bundle2bitstream b2b, bitstream bs where b2b.bundle_id = b.bundle_id and b2b.bitstream_id = bs.bitstream_id and b.namehttp://b.name/ = 'TEXT' Thanks, Richard On Jun 19, 2010, at 7:50 PM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: We have a large repository, currently with 140,376 Items. Due to user complaints about search results, we recently turned off stemming in our DSpace 1.5.1 search by commenting out the following line in DSAnalyzer.java: result = new PorterStemFilter(result); Of course then we had to run index-init to rebuild the search indexes and we've been having problems getting the job to finish. Due to the size of our repository, index-init takes about 5 or 6 days to complete and now it's failed twice due to the following error: An unexpected error has been detected by Java Runtime Environment: # # java.lang.OutOfMemoryError: requested 655360 bytes for GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space? # # Internal Error (allocation.inline.hpp:42), pid=23486, tid=5 # Error: GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp # # Java VM: Java HotSpot(TM) Server VM (10.0-b19 mixed mode solaris-sparc) # An error report file with more information is saved as: # /dspace/hs_err_pid23486.log # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # Abort - core dumped Can someone please help us with this? This most recent time index-init failed was 4½ days into the index rebuild - after indexing 104,082 out of 140,376 items and now it looks like if we want an accurate and complete index, we're going to have to start all over again with the rebuild and there's no guarantee it will finish successfully. Any help would be much appreciated! I'm attaching the core dump and a copy of our DSRUN to this email. Thanks in advance, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov hs_err_pid23486.logATT1.cATT2.c -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech
[Dspace-tech] java.lang.outOfMemory error trying to run index-init
We have a large repository, currently with 140,376 Items. Due to user complaints about search results, we recently turned off stemming in our DSpace 1.5.1 search by commenting out the following line in DSAnalyzer.java: result = new PorterStemFilter(result); Of course then we had to run index-init to rebuild the search indexes and we've been having problems getting the job to finish. Due to the size of our repository, index-init takes about 5 or 6 days to complete and now it's failed twice due to the following error: An unexpected error has been detected by Java Runtime Environment: # # java.lang.OutOfMemoryError: requested 655360 bytes for GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space? # # Internal Error (allocation.inline.hpp:42), pid=23486, tid=5 # Error: GrET in /BUILD_AREA/jdk6_04/hotspot/src/share/vm/utilities/growableArray.cpp # # Java VM: Java HotSpot(TM) Server VM (10.0-b19 mixed mode solaris-sparc) # An error report file with more information is saved as: # /dspace/hs_err_pid23486.log # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # Abort - core dumped Can someone please help us with this? This most recent time index-init failed was 4½ days into the index rebuild - after indexing 104,082 out of 140,376 items and now it looks like if we want an accurate and complete index, we're going to have to start all over again with the rebuild and there's no guarantee it will finish successfully. Any help would be much appreciated! I'm attaching the core dump and a copy of our DSRUN to this email. Thanks in advance, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image001.gif hs_err_pid23486.log Description: hs_err_pid23486.log -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] mixing metadata
Can you have mixed metadata from different schemas in a single DSpace item? From: Keith Michael Pickett [mailto:kmpic...@uno.edu] Sent: Tuesday, June 08, 2010 9:08 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] mixing metadata Yes, you can apply a different metadata schema by starting a new one on the metadata registry. You'll probably still need to have a Dublin Core.xml file in addition to your custom metadata file. We did that with just a title field in the Dublin Core.xml file. That's all you'll need. Keith M. Pickett, MLIS Digital Initiatives Librarian Biology Subject Specialist Chair, LOUISiana Digital Library Committee Earl K. Long Library, Room 319 University of New Orleans 2000 Lakeshore Drive New Orleans, LA 70148 (504) 280-3273 http://library.uno.edu/aboutus/staff/keith.cfm -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Multiple large files loaded onto one record - issues with the sort and open
Hi Renata, See my comments below: Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Renata Dyer [mailto:rd...@hcourt.gov.au] Sent: Thursday, June 03, 2010 8:02 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Multiple large files loaded onto one record - issues with the sort and open I am currently working on the digitisation project. Some of the scanned files are very big; the file itself can even go up to several hundred pages in hard copy and in order to make it smaller when scanned I saved it in few 'smaller' pdf files. Those smaller files have in between 6 up to even 20 MB. Then I had to add those files to one record only. This means I ended up with a record that can have up to 8 files attached - some of the files up to 20 megabytes. The problems I have with this solutions are; a. The sort for these files can get messed up - for example: 154.v2 shows before 154.v1. b. When the size is bigger than 5 MB, instead of just opening a pdf in the web browser; the window pops up alerting you to either save or open the file. This does not happen for smaller files. [Sue T.] There is a configuration parameter in dspace.cfg that controls how large files can be and still be opened inline instead of downloaded. In DSpace 1.5.1, do a search on Content Inline Disposition Threshold. There are separate settings for JSPUI and XMLUI as follows: Content Inline Disposition Threshold # Set the max size of a bitstream that can be served inline # Use -1 to force all bitstream to be served inline # The 'webui.*' setting is for the JSPUI, and # the 'xmlui.*' setting is for the XMLUI #webui.content_disposition_threshold = 8388608 #xmlui.content_disposition_threshold = 8388608 webui.content_disposition_threshold = -1 xmlui.content_disposition_threshold = -1 As you can see, we have both of ours set to -1. Is this a known problem? Do you have the same situation? How can I re-sort? How can I skip the pop-up window unless this is the browser configuration issue. Any ideas to go around this are welcome. Thanks, Renata Dyer Manager, Systems and Electronic Services High Court of Australia Libraryhttp://www.hcourt.gov.au/library.html Canberra, ACT 2604 ph: 02 6270 6916 -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Dspace Items Missing / index-update error
If you're trying to find Context.java, in 1.5.1 it's at: /dspace-1.5.1-src-release/dspace-api/src/main/java/org/dspace/core/Context.java From: bryce ray [mailto:bryceray1...@gmail.com] Sent: Friday, June 04, 2010 1:59 PM To: Mark Diggory; dietz...@osu.edu; Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Dspace Items Missing / index-update error I tried running both index-init and index-update and both give the same error.. I've used both of these command line tools before and it has always worked fine. I'm using version dspace-1.5.2-release, I tried the fix Peter suggested. However, I can't find the file he specified. It does not appear to be in that folder, so I'm stuck for the time being. On Fri, Jun 4, 2010 at 12:03 PM, Mark Diggory mdigg...@atmire.commailto:mdigg...@atmire.com wrote: Did you try rebuilding the search/browse indexes from scratch with the commandline tool? [dspace]/bin/index-init Mark It looks like your running 1.5.2, this code is changed in 1.6.+ In 1.5.2 it does: String caller = stackTrace[3].getClassName(); -- thats likely where this error comes from. You can't guarantee you can access position three. In 1.6.+ it does: String caller = stackTrace[stackTrace.length - 1].getClassName(); -- which will avoid ArrayIndexOOB errors dspace-api/src/main/java/org/dspace/core/Context.java line 220 /** * Turn Off the Authorisation System for this context and store this change * in a history for future use. */ public void turnOffAuthorisationSystem() { authStateChangeHistory.push(ignoreAuth); if (log.isDebugEnabled()) { Thread currThread = Thread.currentThread(); StackTraceElement[] stackTrace = currThread.getStackTrace(); String caller = stackTrace[3].getClassName(); authStateClassCallHistory.push(caller); } ignoreAuth = true; } On Jun 3, 2010, at 9:41 AM, bryce ray wrote: All of a sudden it seems the documents stored in my dspace installation are gone. However, they only seem to be partially gone: * When I view the list of communities it still displays the correct number of articles (i.e. 4 items) * When I click on a community to view the collections it displays the correct number of articles * When I view the collection detail page it still says the correct number of articles at the top of the page. But when I click to view a list of the items in the collection I get the message: No Entries in Index There are no entries in the index for Collection My Collection. I've browsed through the asset store and everything appears to be there. I've tried logging in as an admin and the items are still not viewable. Why all of a sudden can I not view the items in my collections? Reading through the error displayed above I tried recreating the index but I ran into this error message: # ./index-update Creating browse index Exception in thread main java.lang.ArrayIndexOutOfBoundsException: 3 at org.dspace.core.Context.turnOffAuthorisationSystem(Context.java:220) at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:617) Creating search index Could this be the cause of the problem? if so, what exactly is wrong and how do I fix it? Thanks for your help. -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Mark R. Diggory Head of U.S. Operations - @mire http://www.atmire.com - Institutional Repository Solutions http://www.togather.eu - Before getting together, get t...@ther -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Problem with video streaming in DSpace 1.5.1
Hi, I've been working on testing video streaming in one of our DSpace instances today and found this solution posted by Stewart Lewis: http://blog.stuartlewis.com/2009/05/27/easy-pseudo-video-streaming-for-dspace-repositories/ I've followed all the instructions, but the video does not play. There is a big white space on the screen above the metadata where it looks like the video is trying to play...the .jsp does contain the correct javascript on the page, the test video was found on YouTube and converted on http://keepvid.com, it was uploaded after the mime type was defined in the b-f-registry and I don't know what else to try. Stewart or anyone - do you have any ideas what my problem might be? There is nothing in the dspace.log or server.log that might indicate what the problem is - it just doesn't play. Thanks a bunch, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image001.gif-- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Adding E-person to workflow AFTER item submission
Someone correct me if I'm wrong, but I seem to recall that this is the way DSpace was designed to work - basically that ALLOW access for a new Eperson is *not* retroactive to Items that were previously in the repository. I believe you can correct this situation by using the Advanced/Item Wildcard Policy Admin Tool under Authorization on the Admin menu. Here you can assign authorization/access using a combination of 4 parameters: 1. Collection 2. Content type [cid:image001.png@01CAFB3D.5C7811B0] 3. Group 4. Action [cid:image002.png@01CAFB3D.5C7811B0] Hope this helps! Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Matthew Zimmerman [mailto:matthew.zimmer...@utsouthwestern.edu] Sent: Friday, May 21, 2010 2:55 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Adding E-person to workflow AFTER item submission I notice that if I add an E-Person to a workflow step of a collection AFTER an item has been submitted, he won't be able to see that item, but will be able to see any items submitted after he was added. Is there anyway to retroactively have an E-Person have access to items in a workflow submitted AFTER he was added? I batch imported about 500 items into a collection but have a new staff member I would like to have edit and approve them. Thanks Matthew Zimmerman Manager Digital Services and Technology Planning UT Southwestern Medical Center Library Tel: 214-648-4873 matthew.zimmer...@utsouthwestern.edumailto:matthew.zimmer...@utsouthwestern.edu www.utsouthwestern.edu/libraryhttp://www.utsouthwestern.edu/library inline: image001.pnginline: image002.png-- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 1.6.1 pre-release is available for, testing
Mark, Are you saying that we shouldn't skip a release, for instance if we are running version 1.5.1, we should first upgrade to 1.5.2 or can we go straight from 1.5.1 to 1.6? Thanks, Sue From: mdigg...@atmire.com [mailto:mdigg...@atmire.com] Sent: Saturday, May 22, 2010 4:39 PM To: Tonny Hjelmberg Laursen Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace 1.6.1 pre-release is available for, testing Tonny, The release process is dependent on our staged release process being synchronized with the Maven Central Repository. This used to be every 3 to 4 hrs. now it seems to be less frequent (a day or more). We will announce when the release is completely published. I would highly recommend doing a staging upgrade initially when upgrading from 1.5.x to 1.6.1, there are significant changes in the code and configuration, it is a best practice to stage major version upgrades. Mark On May 22, 2010, at 10:10 AM, Tonny Hjelmberg Laursen wrote: Is the final release of 1.6.1 ready for download? Im going to update one of the production servers to 1.6.1 (running 1.5.2) on monday and I would prefer 1.6.1 instead of 1.6. Tonny Date: Tue, 18 May 2010 10:25:32 +1200 From: Kim Shepherdk...@waikato.ac.nzmailto:k...@waikato.ac.nz Subject: [Dspace-tech] DSpace 1.6.1 pre-release is available for testing To:dspace-gene...@lists.sourceforge.netmailto:dspace-gene...@lists.sourceforge.net Cc:dspace-tech@lists.sourceforge.net, dspace-de...@lists.sourceforge.netmailto:dspace-de...@lists.sourceforge.net Message-ID: 12154bd7a5a6d84f9e96aaa8899e83840148c...@ex1.its.waikato.ac.nz Content-Type: text/plain;charset=utf-8 Hi all, As you may be aware, DSpace 1.6.1 will be released shortly and this week is our final stage of testing. The folks at DuraSpace have just upgradedhttp://demo.dspace.org to the pre-release version of 1.6.1, so it's now online and available for testing. DSpace 1.6.1 is a bug-fix only release which resolves over 30 bugs/issues in our 1.6.0 release. More info on the 1.6.1 release can be found on our 1.6.1 Release Notes page: http://wiki.dspace.org/confluence/display/DSPACE/DSpace+Release+1.6.1+Notes Feel free to try things out -- if this is your first time trying DSpace 1.6, there are a number of new features which were introduced in 1.6.0 (see the 1.6.0 Release notes: http://wiki.dspace.org/confluence/display/DSPACE/DSpace+Release+1.6.0+Notes You'd also be doing the community a huge favour by reporting any problems you encounter while trying things out! If you notice any features that don't work properly, an unexpected change in behaviour, or anything else you think could be a bug, please don?t hesitate to emaildspace-de...@lists.sourceforge.net or create an issue inhttp://jira.dspace.org DSpace 1.6.1 XML (Manakin) interface:http://demo.dspace.org/xmlui DSpace 1.6.1 JSP (Traditional) interface:http://demo.dspace.org/jspui Cheers, Kim (DSpace 1.6.1 Release Coordinator) ForwardedMessage.eml-- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Mark R. Diggory Head of U.S. Operations - @mire http://www.atmire.com - Institutional Repository Solutions http://www.togather.eu - Before getting together, get t...@ther -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with write.lock file in /dspace/search - DSpace 1.5.1
I was able to correct the problem of the email not being sent out whenever a lock situation occurred by adding this type of line to every place in DSIndexer.java where an error was being logged to dspace.log: emailException(e) {where e is an Exception object/variable} There were actually 9 places where I inserted this line, and while some of them really were overkill (there were a couple of places in the program that had comments to the effect that that section of code should never be executed) I added it in for consistency anyway. The good news is that I recreated the error and I did get the error email this time. Perhaps this should be included in a future release? Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, May 20, 2010 5:30 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem with write.lock file in /dspace/search - DSpace 1.5.1 Hello, I updated a Collection description in one of our DSpace instances, a few times this morning. Each time I noticed that it took awhile for the update to complete. I finally looked in the log and saw errors referring to write.lock in /dspace/search. I looked in the /dspace/search directory and was surprised to find a write.lock file in the directory, but I was shocked to see that the search indexes had not been updated since March 29th! Long story short, somehow a failed transaction left a lock file in the search directory on March 29th and then every time after that someone performed a transaction that attempted to update the search indexes, the application waited 30 seconds (explanation later) and then an error occurred. So basically my repository's search indexes have been inaccurate since March 29th. That's easy to fix by running index-update.The problem is that I just sort of found the issue by accident while looking at something else in the dspace.log and was never notified about the errors. I looked at DSIndexer.java and saw that in the documentation at the top of the program it says: It will attempt to attain a lock on the index in the event that an update is requested and will wait a maximum of 30 seconds (a worst case scenario) to attain the lock before giving up and logging the failure to log4j and to the DSpace administrator email account. My question is this: Why wasn't an email sent out when the lock errors occurred? It looks as if the program was successfully writing to the log, but for some reason it didn't send out the emails. Is this an oversight, an issue that's been corrected in a subsequent version, or a problem specific to our installation? I feel like if I had received the email(s) back in March, I could have corrected it then. Below is the error output from the dspace.log. If any has any ideas, please let me know. Thanks! Best regards, Sue 2010-05-20 11:32:36,815 INFO org.dspace.app.webui.servlet.CommunityListServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_community_list: 2010-05-20 11:32:41,404 INFO org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_collection:collection_id=91 2010-05-20 11:32:41,404 INFO org.dspace.browse.BrowseEngine @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:browse_mini: 2010-05-20 11:38:03,321 INFO org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_community:community_id=34 2010-05-20 11:38:03,325 INFO org.dspace.browse.BrowseEngine @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:browse_mini: 2010-05-20 11:38:03,417 INFO org.dspace.app.webui.servlet.RetrieveServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_bitstream:bitstream_id=652731 2010-05-20 11:41:43,673 INFO org.dspace.content.Collection @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:update_collection:collection_id=91 2010-05-20 11:42:13,731 ERROR org.dspace.search.DSIndexer @ Lock obtain timed out: SimpleFSLock@/export/home/dspace/search/write.lock org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: SimpleFSLock@/export/home/dspace/search/write.lock at org.apache.lucene.store.Lock.obtain(Lock.java:85) at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:691) at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:452) at org.dspace.search.DSIndexer.openIndex(DSIndexer.java:805) at org.dspace.search.DSIndexer.writeDocument(DSIndexer.java:877) at org.dspace.search.DSIndexer.buildDocument(DSIndexer.java:943
Re: [Dspace-tech] Problem with write.lock file in /dspace/search in DSpace 1.5.1
I was able to correct this problem by inserting the following line in 9 different places in DSIndexer.java: emailException(e) {where e is an Exception object/variable} What I did was insert this line every place where an error occurred and was logged to dspace.log, but the exception was not emailed. So basically I found every place in the program where there was a line like this... log.error(e.getMessage(), e); ...that wasn't followed by the emailExeption(e) statement, and I inserted it there. Granted, some of this was probably overkill since there were areas of the program that had a comment saying This code will never be executed, but it makes the compiler happy... :). The good news is that I recreated the problem and I did receive the error email this time. Perhaps this fix should be included in the next release?? Thanks, Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, May 20, 2010 5:30 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem with write.lock file in /dspace/search - DSpace 1.5.1 Hello, I updated a Collection description in one of our DSpace instances, a few times this morning. Each time I noticed that it took awhile for the update to complete. I finally looked in the log and saw errors referring to write.lock in /dspace/search. I looked in the /dspace/search directory and was surprised to find a write.lock file in the directory, but I was shocked to see that the search indexes had not been updated since March 29th! Long story short, somehow a failed transaction left a lock file in the search directory on March 29th and then every time after that someone performed a transaction that attempted to update the search indexes, the application waited 30 seconds (explanation later) and then an error occurred. So basically my repository's search indexes have been inaccurate since March 29th. That's easy to fix by running index-update.The problem is that I just sort of found the issue by accident while looking at something else in the dspace.log and was never notified about the errors. I looked at DSIndexer.java and saw that in the documentation at the top of the program it says: It will attempt to attain a lock on the index in the event that an update is requested and will wait a maximum of 30 seconds (a worst case scenario) to attain the lock before giving up and logging the failure to log4j and to the DSpace administrator email account. My question is this: Why wasn't an email sent out when the lock errors occurred? It looks as if the program was successfully writing to the log, but for some reason it didn't send out the emails. Is this an oversight, an issue that's been corrected in a subsequent version, or a problem specific to our installation? I feel like if I had received the email(s) back in March, I could have corrected it then. Below is the error output from the dspace.log. If any has any ideas, please let me know. Thanks! Best regards, Sue 2010-05-20 11:32:36,815 INFO org.dspace.app.webui.servlet.CommunityListServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_community_list: 2010-05-20 11:32:41,404 INFO org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_collection:collection_id=91 2010-05-20 11:32:41,404 INFO org.dspace.browse.BrowseEngine @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:browse_mini: 2010-05-20 11:38:03,321 INFO org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_community:community_id=34 2010-05-20 11:38:03,325 INFO org.dspace.browse.BrowseEngine @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:browse_mini: 2010-05-20 11:38:03,417 INFO org.dspace.app.webui.servlet.RetrieveServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_bitstream:bitstream_id=652731 2010-05-20 11:41:43,673 INFO org.dspace.content.Collection @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:update_collection:collection_id=91 2010-05-20 11:42:13,731 ERROR org.dspace.search.DSIndexer @ Lock obtain timed out: SimpleFSLock@/export/home/dspace/search/write.lock org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: SimpleFSLock@/export/home/dspace/search/write.lock at org.apache.lucene.store.Lock.obtain(Lock.java:85) at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:691) at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:452) at org.dspace.search.DSIndexer.openIndex(DSIndexer.java:805
[Dspace-tech] Problem with write.lock file in /dspace/search - DSpace 1.5.1
Hello, I updated a Collection description in one of our DSpace instances, a few times this morning. Each time I noticed that it took awhile for the update to complete. I finally looked in the log and saw errors referring to write.lock in /dspace/search. I looked in the /dspace/search directory and was surprised to find a write.lock file in the directory, but I was shocked to see that the search indexes had not been updated since March 29th! Long story short, somehow a failed transaction left a lock file in the search directory on March 29th and then every time after that someone performed a transaction that attempted to update the search indexes, the application waited 30 seconds (explanation later) and then an error occurred. So basically my repository's search indexes have been inaccurate since March 29th. That's easy to fix by running index-update.The problem is that I just sort of found the issue by accident while looking at something else in the dspace.log and was never notified about the errors. I looked at DSIndexer.java and saw that in the documentation at the top of the program it says: It will attempt to attain a lock on the index in the event that an update is requested and will wait a maximum of 30 seconds (a worst case scenario) to attain the lock before giving up and logging the failure to log4j and to the DSpace administrator email account. My question is this: Why wasn't an email sent out when the lock errors occurred? It looks as if the program was successfully writing to the log, but for some reason it didn't send out the emails. Is this an oversight, an issue that's been corrected in a subsequent version, or a problem specific to our installation? I feel like if I had received the email(s) back in March, I could have corrected it then. Below is the error output from the dspace.log. If any has any ideas, please let me know. Thanks! Best regards, Sue 2010-05-20 11:32:36,815 INFO org.dspace.app.webui.servlet.CommunityListServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_community_list: 2010-05-20 11:32:41,404 INFO org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_collection:collection_id=91 2010-05-20 11:32:41,404 INFO org.dspace.browse.BrowseEngine @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:browse_mini: 2010-05-20 11:38:03,321 INFO org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_community:community_id=34 2010-05-20 11:38:03,325 INFO org.dspace.browse.BrowseEngine @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:browse_mini: 2010-05-20 11:38:03,417 INFO org.dspace.app.webui.servlet.RetrieveServlet @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:view_bitstream:bitstream_id=652731 2010-05-20 11:41:43,673 INFO org.dspace.content.Collection @ susan.m.thorn...@nasa.gov:session_id=AB9292929292929292929293939AFAFA:ip_addr=111.222.333.444:update_collection:collection_id=91 2010-05-20 11:42:13,731 ERROR org.dspace.search.DSIndexer @ Lock obtain timed out: SimpleFSLock@/export/home/dspace/search/write.lock org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: SimpleFSLock@/export/home/dspace/search/write.lock at org.apache.lucene.store.Lock.obtain(Lock.java:85) at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:691) at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:452) at org.dspace.search.DSIndexer.openIndex(DSIndexer.java:805) at org.dspace.search.DSIndexer.writeDocument(DSIndexer.java:877) at org.dspace.search.DSIndexer.buildDocument(DSIndexer.java:943) at org.dspace.search.DSIndexer.indexContent(DSIndexer.java:328) at org.dspace.search.SearchConsumer.end(SearchConsumer.java:207) at org.dspace.event.BasicDispatcher.dispatch(BasicDispatcher.java:171) at org.dspace.core.Context.commit(Context.java:384) at org.dspace.core.Context.complete(Context.java:350) at org.dspace.app.webui.servlet.admin.EditCommunitiesServlet.processConfirmEditCollection(EditCommunitiesServlet.java:693) at org.dspace.app.webui.servlet.admin.EditCommunitiesServlet.doDSPost(EditCommunitiesServlet.java:267) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:147) at org.dspace.app.webui.servlet.DSpaceServlet.doPost(DSpaceServlet.java:105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:816) at javax.servlet.http.HttpServlet.service(HttpServlet.java:917) at
Re: [Dspace-tech] Email notifications for internal server errors in newer versions
No, it didn't go away. You should get an email when an internal error occurs. Have you checked your server to make sure your emails are being released? We had a situation recently where that happened. Also, have you checked the dspace.log file(s) for any error messages that may be occurring when your application attempts to send an email out? Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Damian Marinaccio [mailto:dxm...@rit.edu] Sent: Thursday, May 20, 2010 12:55 PM To: Dspace-Tech Subject: [Dspace-tech] Email notifications for internal server errors in newer versions Ever since moving to 1.5 (and subsequently 1.6) I no longer receive emails when dspace throws an internal error. My address is still configured in the dspace.cfg. Did this feature go away or do I need to do something to enable this? -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] How does the bitstream_format_id get set in a DSpace 1.5.1 import?
I just noticed in one of our DSpace instances that all of the rows in the bitstream table have column bitstream_format_id set to 1 - Unknown. All the documents are either .pdf files or their equivalent .pdf.txt files (from filter-media). The strange thing is that all the .pdf files are in ORIGINAL bundles and all the .pdf.txt files are in TEXT bundles. What is the proper way to set the value of bitstream_format_id during an import? Is it a field you have to include in the Contents file? Or is it supposed to be set programmatically in DSpace? I guess I can write a query to update the bitstream_format_id based on the document names, i.e., .pdf files are bitstream_format_id = 3 and .pdf.txt files should be 5. Thanks in advance, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image001.gif-- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How does the bitstream_format_id get set in a DSpace 1.5.1 import?
Tim, Thanks for your comments. Your mention of the format registry made me think of something. I remembered being unclear about which tables I had to load explicitly, for some reason, when I was implementing the two newest instances. I just looked and the fileextension table is EMPTY in those two instances! This of course would be problematic, now wouldn't it?! :) I'm not sure where in the implementation procedures this is done, but for some reason I missed it. I'll just unload the fileextension table from one of the good instances and copy it into the two empty ones. Thanks to all who replied to my question. I'm pretty knowledgeable when it comes to DSpace, but I love having this list of folks to depend on when I'm stumped on something. Sue -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, May 06, 2010 1:20 PM To: dspace-tech@lists.sourceforge.net; Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: Re: [Dspace-tech] How does the bitstream_format_id get set in a DSpace 1.5.1 import? Sue, A few comments inline... On 5/6/2010 11:44 AM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: I just noticed in one of our DSpace instances that _all_ of the rows in the bitstream table have column bitstream_format_id set to 1 - Unknown. All the documents are either .pdf files or their equivalent .pdf.txt files (from filter-media). The strange thing is that all the .pdf files are in ORIGINAL bundles and all the .pdf.txt files are in TEXT bundles. The ORIGINAL bundle always contains the original files (as they were uploaded in DSpace). The TEXT bundle always includes text-extraction files which are auto-generated by the filter-media script. More info on Bundle usage can be found in the DSpace Data Model descriptions: http://www.dspace.org/1_6_0Documentation/ch02.html#docbook-functional.html-data_model What is the proper way to set the value of bitstream_format_id during an import? Is it a field you have to include in the Contents file? Or is it supposed to be set programmatically in DSpace? I guess I can write a query to update the bitstream_format_id based on the document names, i.e., .pdf files are bitstream_format_id = 3 and .pdf.txt files should be 5. DSpace will attempt to recognize File Formats automatically on upload/ingest. It does so in a very rudimentary way, by essentially checking the file extension. If the uploaded file's extension matches a known extension in DSpace's Bitstream Format Registry, than DSpace will assume that file is of that known format. So, each of your .pdf files should have been auto-recognized as PDF format, assuming your Bitstream Format Registry has an entry for .pdf (it should, as this is a default entry -- the only way it wouldn't is if you specifically removed it, or your Format Registry was not initialized properly to begin with). I'm at a loss for why this doesn't seem to be working in your DSpace installation (as I've never seen this before). Is there any custom submission/ingest code that code be affecting this? Are you ingesting this content via a UI (XMLUI or JSPUI) or is it all ingested via commandline (either way, DSpace should be recognizing the formats properly -- but it could help narrow down the problem)? - Tim -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Media filtering problem - filtering was unsuccessful
We had the same problems and finally replaced the use of PDFBox to filter .pdf files with XPDF2Text. Our only documents that won't filter now are truly corrupt files. Plus XPDF2Text is 10 times as fast as PDFBox. Take a look at this: http://jira.dspace.org/jira/browse/DS-183;jsessionid=3F4B680EC315609CF41443721BB9C6F6?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel Hope this helps! Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.gov From: White, Andrew [andrew.wh...@lincoln.ac.nz] Sent: Friday, April 30, 2010 12:24 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Media filtering problem - filtering was unsuccessful We are experiencing problems with media filtering of PDF files added in our thesis digitisation project. A number of the files (perhaps 10%) will not filter, the command window just pauses for up to 15 minutes or so, then displays: SKIPPED: bitstream 5698 (item: 10182/1780) because filtering was unsuccessful No other error message or clue is given. I can see no common feature of the PDFs that won't filter - they can be bw only or some colour, different PDF versions. Yes, they are all quite large files (10MB or larger), but not all files of this size are failing in this way. I find that if I split the file into parts and re-upload, they will then filter OK. Has anyone else experienced this and do you have a solution? Andrew White Information Technology Librarian George Forbes Memorial Library PO Box 64 Lincoln University Lincoln 7647 Christchurch, New Zealand p +64 3 321 8542 | f +64 3 325 2944 e andrew.wh...@lincoln.ac.nzmailto:andrew.wh...@lincoln.ac.nz | w library.lincoln.ac.nzhttp://library.lincoln.ac.nz/ Lincoln University, Te Whare Wanaka o Aoraki New Zealand's Specialist Land Based University The contents of this e-mail (including any attachments) may be confidential and/or subject to copyright. Any unauthorised use, distribution, or copying of the contents is expressly prohibited. If you have received this e-mail in error, please advise the sender by return e-mail or telephone and then delete this e-mail together with all attachments from your system. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] DSpace 2.0 projected release date?
Hi, Can anyone tell me what the status of DSpace 2.0 is? I poked around a bit, but didn't see anything about a projected release date. Is there one? Are there solid plans for a DSpace 1.6.1 or any release versions between 1.6.x and 2.0? Thanks, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image001.gif-- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace 2.0 projected release date?
Thanks Peter. That’s just what I needed! Best regards, Sue From: pdiet...@gmail.com [mailto:pdiet...@gmail.com] On Behalf Of Peter Dietz Sent: Tuesday, April 27, 2010 12:51 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace 2.0 projected release date? I'm not sure dates are settled but: * 1.6.1 is slated for ~6 months after 1.6.0 released (somewhere in the June/July area of this year perhaps) {Kim Shepherd lead} * 1.7.0 is slated for ~12 months after 1.6.0. released (December 2010) And 2.0 is does not have a release scheduled yet from what I'm aware of, but we'd like to get DSpace into a predictable release habit so that development cycles can be performed fully, and that upgrades are easier to plan. You can find some of the discussion in the developers meeting IRC: http://www.duraspace.org/irclogs/index.php?date=2010-04-07 Peter Dietz Systems Developer/Engineer Ohio State University Libraries On Tue, Apr 27, 2010 at 11:17 AM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi, Can anyone tell me what the status of DSpace 2.0 is? I poked around a bit, but didn’t see anything about a projected release date. Is there one? Are there solid plans for a DSpace 1.6.1 or any release versions between 1.6.x and 2.0? Thanks, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems Developer, Application Database Administrator ConITS Contract ~ NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 ~ Mobile: (757) 506-9903 ~ Fax: (757) 224-4001 email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech inline: image001.gif-- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Updating several collection authorizations policies in one step.
There is an option on the Administrator menu called Authorization. The first 3 items displayed after clicking on this allow you to maintain authorization policies for Communities, Collections, and Items, and the 4th option allows you to do wildcard additions to and clearing of authorization policies for types of content contained in a collection (Items and Bitstreams). Hope this helps. Best regards, Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems ~ Developer, Application Database Administrator ConITS Contract NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: ManuMohedano [mailto:manumohed...@usal.es] Sent: Monday, April 19, 2010 9:59 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Updating several collection authorizations policies in one step. Hi all. Does anybody know if it is possible to update the authorizations of several collections or communities in one step? I can only make it selecting them one by one... Thanks in advance. Regards. Manu. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] log4j causing slowness for DSpace
Hi Jason, I've gotten this error before when implementing a new instance of DSpace or upgrading to a new version. I remember spending quite a bit of time troubleshooting the problem too, and I still really don't understand how what I did got it to work, but it's something you can try. I edited /dspace/config/log4j.xml and basically replaced symbolic variable ${log.dir} with the hard-coded location of our dspace.log file as follows: Original log4j.xml: !DOCTYPE log4j:configuration SYSTEM log4j.dtd log4j:configuration !-- Standard DSpace file logger -- appender name=FILE class=org.apache.log4j.RollingFileAppender param name=File value=${log.dir}/dspace.log / . . . New log4j.xml: !DOCTYPE log4j:configuration SYSTEM log4j.dtd log4j:configuration !-- Standard DSpace file logger -- appender name=FILE class=org.apache.log4j.RollingFileAppender param name=File value=/exp/hm/dspace/log/dspace.log / . . . Some things to keep in mind: Our current DSpace version: 1.5.1 Our WebServer: Sun Webserver7 Our config. parameters in dspace.cfg: dspace.dir = /dspace log.init.config= ${dspace.dir}/config/log4j.xml log.dir= ${dspace.dir}/log Like I said, the solution really doesn't make sense to me, but it worked, so I thought you might try it! Has anyone else had this problem? Once I made this change and restarted the web server, the problem disappeared. Hope this helps! Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems ~ Developer, Application Database Administrator ConITS Contract NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -Original Message- From: Jason Fowler [mailto:jfow...@sbts.edu] Sent: Monday, April 05, 2010 4:51 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] log4j causing slowness for DSpace I've been beating my brains in over this issue, and I have tried every possible solution I can find. I've recently migrated to 1.6.0, and since making the change, problems with log4j occur at startup. This makes my Dspace startup take ten minutes. I've narrowed down the problem (I think) to being an issue with log4j. I just appended a date stamp to my catalina.out file while I restarted. I have output it below. The first thing that shows up after the stamp is log4j errors. After churning for 10 minutes, everything works fine, even logging, solr, etc. Does anyone have any idea what might be causing this problem? If so, many, many thanks in advance. Mon Apr 5 15:29:51 CDT 2010 log4j:WARN No appenders could be found for logger (org.apache.catalina.startup.Embedded). log4j:WARN Please initialize the log4j system properly. log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax). log4j:WARN Please initialize the log4j system properly. INFO: Loading provided config file: /mnt/storage/dspace/config/dspace.cfg INFO: Using dspace provided log configuration (log.init.config) INFO: Loading: /mnt/storage/dspace/config/log4j.properties Loading catalog: file:/usr/local/apache-tomcat-5.5.26/work/Catalina/localhost/xmlui/cocoon_xml_resolver_entities/catalog log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax). log4j:WARN Please initialize the log4j system properly. INFO: Loading provided config file: /mnt/storage/dspace/config/dspace.cfg INFO: Using dspace provided log configuration (log.init.config) INFO: Loading: /mnt/storage/dspace/config/log4j.properties - Loading provided config file: /mnt/storage/dspace/config/dspace.cfg - Using dspace provided log configuration (log.init.config) - Loading: /mnt/storage/dspace/config/log4j.properties log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax). log4j:WARN Please initialize the log4j system properly. INFO: Loading provided config file: /mnt/storage/dspace/config/dspace.cfg INFO: Using dspace provided log configuration (log.init.config) INFO: Loading: /mnt/storage/dspace/config/log4j.properties log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax). log4j:WARN Please initialize the log4j system properly. INFO: Loading provided config file: /mnt/storage/dspace/config/dspace.cfg INFO: Using dspace provided log configuration (log.init.config) INFO: Loading: /mnt/storage/dspace/config/log4j.properties Loading catalog:
Re: [Dspace-tech] Multiple Instances of Dspace on one server
We are successfully running 2 separate instances of DSpace 1.5.1 on the same server. Our configuration is something like this: Instance 1: Instance 2: dspace.dir /dspace /dspace-2 dspace-source.dir /dspace-1.5.1-src-release /dspace-1.5.1-src-release-2 dspace.url http://dspace.nasa.govhttp://dspace.nasa.gov/ http://dspace-2.nasa.govhttp://dspace-2.nasa.gov/ db.url jdbc:postgresql://127.0.0.1:5432/dspace jdbc:postgresql://127.0.0.1:5432/dspace-2 db.usernamedspace dspace-2 One thing that we did to minimize the chances of getting the two instances mixed up when we're making changes to one or the other was to prohibit both the unix user id and postgreSQL login roles for each instance from having any type of access to the other. Hope this helps. Sue Sue Walker-Thornton NASA Langley Research Center Integrated Library Systems ~ Developer, Application Database Administrator ConITS Contract NCI Information Systems, Inc. 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -Original Message- From: Mark Diggory [mailto:mdigg...@atmire.com] Sent: Saturday, April 03, 2010 8:21 PM To: bryce ray Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Multiple Instances of Dspace on one server I would check your in each installation directory: [dspace.install.dir]/webapps/xmlui/WEB-INF/xmlui.xconf [dspace.install.dir]/config/xmlui.xconf I would also check that your configured dspace.cfg setting in the webapplication points at the correct install: [dspace.install.dir]/webapps/xmlui/WEB-INF/web.xml Mark On Sat, Apr 3, 2010 at 4:52 PM, bryce ray bryceray1...@gmail.com wrote: I currently have a seperate database setup for the second instance (and defined in the dspace.cfg file). The problem actually has to do with more than just mirrored data. The two websites have slightly different teplates, and the second instance is using the same template as the first when it should be using its own. I think it may also have something to do with mod_jk, apache, or tomcat. On Sat, Apr 3, 2010 at 5:59 PM, Mark Diggory mdigg...@atmire.com wrote: you need to setup a different database in your postgres cluster for the second instance or it will use the same database as the first see the database configuration section of your dspace.cfg in your second instance for issues. The following instructions are ancient and relatively inaccurate, but will give you some ideas... http://wiki.dspace.org/index.php/MultipleDspaceOneServer Cheers, Mark On Sat, Apr 3, 2010 at 1:51 PM, bryce ray bryceray1...@gmail.com wrote: I'm attempting to install two instances of dspace on my server. I've run into one problem which I can't seem to fix. I created the second instance of dspace from scratch by downloading the release install, packaging, installing, and configuring. I believe I have everything setup correctly but when I visit the second instance of dspace on the web it is an exact mirror image of the first instance. I've double checked all my settings in dspace.cfg and everything points to the correct url and directory path for the new instance. Anyone else experience this problem? dSpace 1.6 centos apache/tomcat using mod_jk to redirect from port 8080 to 80. Let me know if you need any more information. Unfortunately, I can now release a url to the website as it would violate my confidentiality agreement. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Mark R. Diggory Head of U.S. Operations - @mire http://www.atmire.com - Institutional Repository Solutions http://www.togather.eu - Before getting together, get t...@ther -- Mark R. Diggory Head of U.S. Operations - @mire http://www.atmire.com - Institutional Repository Solutions http://www.togather.eu - Before getting together, get t...@ther -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed
[Dspace-tech] How to assign authorization policy(s) that allow a user to replace a document for an Item in DSpace 1.5.1
Hi, I need to know how to correctly define authorization policies that will allow a User in DSpace 1.5.1 to replace a document for an Item? I've studied the documentation for authorization and it doesn't really say. Here's the scenario: A User has previously added an Item to the repository and the Item contains 1 .pdf document. Subsequent to this, the author submits an updated version of the document and the User wants to replace the original document. In other words, the User wants to delete the original document and add/upload the corrected document. I have had a hard time figuring out the correct way to do this. The User who was trying to do this kept getting authorization (Add on Bundle) errors despite the fact that she was a member of both the Collection_Admin and Collection_Submitters group. It doesn't seem like any of the questions that are asked when originally defining the Collection, correctly set up this authorization; neither does adding the User to the Collection_Admin group, since the User ultimately needs Add and Remove access at the Bundle level. The Advanced Item/Wildcard Policy tool doesn't work here either as you can only grant access at the Item or Bitstream level, NOT Bundle. Can someone help me out with this? Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Problem with authorization created during Submission process in DSpace 1.5.1
Hi, We are in the process of implementing a new secure DSpace instance where the default access has to be no-access for anonymous users. During the Define Collection process, despite the fact that I am NOT checking the box that says New items should be publicly readable, the following authorization is being added at the Collection level for a new Collection: [cid:image002.jpg@01CAC121.92558480] Maybe this is ok and maybe I'm unclear on the difference between READ access to a Collection and DEFAULT-ITEM-READ access to a Collection. If the only access I have to a Collection is READ access, exactly what can I do and see in that Collection? Thanks and Best regards, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image002.jpg-- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with authorization created during Submission process in DSpace 1.5.1
Great! Thanks Graham! Sue From: Graham Triggs [mailto:grahamtri...@gmail.com] Sent: Thursday, March 11, 2010 2:57 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: DSpace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with authorization created during Submission process in DSpace 1.5.1 Hi Sue, Don't worry, the READ policy on the COLLECTION has no effect on the access of the items. In fact, it doesn't really have any effect on the access of the Collection home page/browse itself, either :( For accessing items, what you need to be concerned with is the DEFAULT_ITEM_READ and DEFAULT_BITSTREAM_READ - those are the policies that Items and Bitstreams inherit when they are installed (accepted) into the repository - and it is only the policies defined on each Item or Bitstream individually (which are created from the default) that determine access when someone tries to view or download the item / bitstream. Regards, G On 11 March 2010 18:48, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi, We are in the process of implementing a new secure DSpace instance where the default access has to be no-access for anonymous users. During the Define Collection process, despite the fact that I am NOT checking the box that says New items should be publicly readable, the following authorization is being added at the Collection level for a new Collection: [cid:image001.jpg@01CAC138.58D2A690] Maybe this is ok and maybe I'm unclear on the difference between READ access to a Collection and DEFAULT-ITEM-READ access to a Collection. If the only access I have to a Collection is READ access, exactly what can I do and see in that Collection? Thanks and Best regards, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech inline: image001.jpg-- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Refworks on Dspace
Hello, Can you give a brief description of what the patch does? Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.gov -Original Message- From: Ricardo Borillo [mailto:bori...@gmail.com] Sent: Thursday, March 04, 2010 6:05 AM To: Carlos Palop Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Refworks on Dspace Hi Carlos, We use DSpace 1.5.1 and we have easily adapted an existing RefWorks patch for DSpace 1.4.1. Take a look at the attached document. Hope it helps :) --- Salut, Ricardo Borillo Domenech http://xml-utils.com On Thu, Mar 4, 2010 at 11:49, Carlos Palop cpa...@gmail.com wrote: Hi all! Anyone could help me? I want to implement Refworks on Dspace 1.5.2, Any Ideas? Thanks -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Internal system error
Hi, Looks like maybe the application is requiring that a title be entered, and that the title is null...? Hope this helps, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: shali Kallumpuram [mailto:vidyaserverad...@gmail.com] Sent: Thursday, March 04, 2010 2:07 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Internal system error Dear all. i have updated the my dspace 1.5.2 to 1.6 , but after that i cant able to submit new items to Dspace Error : 1 . in jspui it shows internal system error in xmlui after filling first page and click on next it shows , 2 . java.sql.SQLException: bad_dublin_core schema=dc, title null anybody please help me. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] batch import not loading itmes
Try routing the output from ItemImport to a file and checking the file contents after the job ends. (see below) Hope this helps, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Topete, Sergio (CIV) [mailto:stop...@nps.edu] Sent: Wednesday, March 03, 2010 1:32 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] FW: batch import not loading itmes I been running the following command but I get an empty mapfile and nothing gets uploaded. Any help will be appreciated. /usr/local/dspace/bin]$ ./dsrun org.dspace.app.itemimport.ItemImport --add --eperson=stop...@nps.edu --collection=123456789/74 --source=/home/dspace/temp/batchloadtest/ --mapfile=20100302A[Sue T.] /home/dspace/temp/20100302A.out Destination collections: Owning Collection: Captstone Adding items from directory: /home/dspace/temp/batchloadtest Generating mapfile: 20100302A Serigo -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Dspace database connection error
Hi, I tried replying to your email yesterday, but it bounced saying the email address was invalid? Anyway, you need to edit your pg_hba.conf file in your postgresql installation and entering a line that allows (trust) your ip address direct access to the database via PGAdminIII. Here is a snippet of our pg_hba.conf file: # TYPE DATABASEUSERCIDR-ADDRESS METHOD # local is for Unix domain socket connections only local all all trust # IPv4 local connections: host all all 127.0.0.1/32 trust # IPv6 local connections: host all all ::1/128 trust # Jeff, Sue, anyone else who needs direct access to the database host all all 123.123.123.12/32 trust host all all 123.123.123.26/32 trust . . . You'll need to add a line that looks like this: Host dspace dspace 192.168.1.24 trust After you save the file, you'll need to do a server configuration reload by executing: ./your_postgres_installation_directory/bin/pg_ctl reload Hope this helps, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems ~ Developer/DBA 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Alpesh Sarvaiya [mailto:alpesh.sarva...@pyther.com] Sent: Wednesday, March 03, 2010 2:09 AM To: DSpace-tech@lists.sourceforge.net Subject: [Dspace-tech] Dspace database connection error Hello Sir, I have install postgreSQL 8.4 server in windowXP on IP 192.168.1.24 with port 9500 and trying to access the database dspace that is created in postgreSQL 7.4 install on debian linux on host 192.168.1.32 with port 5432. So problem is that when I start the pgadminIII from window xp and click on File--Add Server.. It shows the dialog box to connect with database that is created on linux as I told above. I have entered the following entry in the field plz see enry.jpg that is attached with email. And gives the following error Access to database denied The server doesn't grant access to the database: the server reports FATAL: no pg_hba.conf entry for host 192.168.1.24, user dspace, database dspace, SSL off To access a database on a PostgreSQL server, you first have to grant primary access to the server for your client (Host Based Authentication). PostgreSQL will check the pg_hba.conf file if a pattern that matches your client address / username / database is present and enabled before any SQL GRANT access control lists are evaluated. The initial settings in pg_hba.conf are quite restrictive, in order to avoid unwanted security holes caused by unreviewed but mandatory system settings. You'll probably want to add something like host all all 192.168.0.0/24http://192.168.0.0/24 md5 This example grants MD5 encrypted password access to all databases to all users on the private network 192.168.0.0/24http://192.168.0.0/24. You can use the pg_hba.conf editor that is built into pgAdmin III to edit the pg_hba.conf configuration file. After changing pg_hba.conf, you need to trigger a server configuration reload using pg_ctl or by stopping and restarting the server process. Thank You in advance, Alpesh -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: error in ant fresh_install in Dspace installation
Sounds like you need to correct your db.password configuration for the dspace database, in dspace.cfg. # Database username and password db.username = dspace db.password = yourpassword Hope this helps! Sue From: SANDEEP BHAVSAR [mailto:sandeep.bhav...@gmail.com] Sent: Saturday, February 27, 2010 1:43 AM To: Alpesh Sarvaiya Cc: DSpace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Fwd: error in ant fresh_install in Dspace installation Dear Alpesh [java] org.postgresql.util.PSQLException: FATAL: password authentication fa iled for user dspace Please ensure that password given for postgresql is same as mention in dspace.cfg file. On Sat, Feb 27, 2010 at 11:21 AM, Alpesh Sarvaiya alpesh.sarva...@pyther.commailto:alpesh.sarva...@pyther.com wrote: - Hello Sir, I am alpesh sarvaiya. I want to install the dspace in debian linux. But when I am execute ant fresh_install it gives the following error. I think the problem is related to [java] org.postgresql.util.PSQLException: FATAL: password authentication failed for user dspace . This line you can see below with bold format. r...@debian:~/dspace-1.5.2-src-release/dspace/target/dspace-1.5.2-build.dir# ant fresh_install Buildfile: build.xml init_installation: init_configs: [copy] Copying 1 file to /root/Dspace/config setup_database: [java] 2010-02-26 23:50:56,686 INFO org.dspace.core.ConfigurationManager @ Loading system provided config property (-Ddspace.configuration): config/dspace.cfg [java] 2010-02-26 23:50:56,691 INFO org.dspace.core.ConfigurationManager @ Using default log4j provided log configuration,if uninitended, check your dspace.cfg for (log.init.config) [java] 2010-02-26 23:50:56,691 INFO org.dspace.storage.rdbms.InitializeDatabase @ Initializing Database [java] 2010-02-26 23:50:56,750 FATAL org.dspace.storage.rdbms.InitializeDatabase @ Caught exception: [java] org.postgresql.util.PSQLException: FATAL: password authentication failed for user dspace [java] at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:275) [java] at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:94) [java] at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:65) [java] at org.postgresql.jdbc2.AbstractJdbc2Connection.init(AbstractJdbc2Connection.java:116) [java] at org.postgresql.jdbc3.AbstractJdbc3Connection.init(AbstractJdbc3Connection.java:30) [java] at org.postgresql.jdbc3.Jdbc3Connection.init(Jdbc3Connection.java:24) [java] at org.postgresql.Driver.makeConnection(Driver.java:369) [java] at org.postgresql.Driver.connect(Driver.java:245) [java] at java.sql.DriverManager.getConnection(DriverManager.java:582) [java] at java.sql.DriverManager.getConnection(DriverManager.java:185) [java] at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:65) [java] at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:294) [java] at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:974) [java] at org.apache.commons.dbcp.PoolingDriver.connect(PoolingDriver.java:176) [java] at java.sql.DriverManager.getConnection(DriverManager.java:582) [java] at java.sql.DriverManager.getConnection(DriverManager.java:207) [java] at org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:550) [java] at org.dspace.storage.rdbms.DatabaseManager.loadSql(DatabaseManager.java:923) [java] at org.dspace.storage.rdbms.InitializeDatabase.main(InitializeDatabase.java:100) BUILD FAILED /root/dspace-1.5.2-src-release/dspace/target/dspace-1.5.2-build.dir/build.xml:585: Java returned: 1 Total time: 0 seconds Please help me sir. Thank you sir, in advance. Alpesh -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Thanks and Regards Sandeep Bhavsar Librarian Dr.V.N.Bedekar Institute of Management Studies Thane(W) 400601 MUMBAI. INDIA @@ email: sandeep.bhav...@gmail.commailto:sandeep.bhav...@gmail.com Mob : 9987049099 elibrary :http://www.vpmthane.org/im/elib/main.htm @@
Re: [Dspace-tech] Sloooow submission process in DSpace 1.5.1
Hi, I was finally able to significantly speed up our online item ingest process by suppressing the Index pruning on every Item update. After setting the .log level to DEBUG and tracing the process though, I noticed it was doing a LOT of updates. This is where it was really slowing down the ingest. This has been an outstanding problem of ours for a long time now and our Users are very happy to not have this slow response time anymore, especially when they click I grant the license. Sue From: Graham Triggs [mailto:grahamtri...@gmail.com] Sent: Tuesday, February 23, 2010 2:11 PM To: Simon Brown Cc: dspace-tech@lists.sourceforge.net Tech Subject: Re: [Dspace-tech] Slw submission process in DSpace 1.5.1 Hi Simon, On 23 February 2010 17:47, Simon Brown st...@cam.ac.ukmailto:st...@cam.ac.uk wrote: Sorry to stick my oar in here, but... Oars are always welcome. I don't think this is the case. I'm sure it was the intention, but from what we've been able to determine, each DescribeStep for in- progress items calls InProgressSubmission.update() which for both workflow and non-workflow items calls Item.update(), which will fire a MODIFY_METADATA event for that item. The BrowseConsumer will process that event whether the item is installed or not. We determined this after an increasing number of user complaints about the submission process slowing down and added an isArchived() check to our BrowseConsumer, which made the submissions process noticeably snappier. Yes, that probably is happening at a BrowseConsumer level (the event mechanism / BrowseConsumer was added after this browse code was committed, I'm not 100% sure of the circumstances of it's use). However, the BrowseConsumer calls indexItem(), which has the explicit check in it: if (item.isArchived() || item.isWithdrawn()) { indexItem(new ItemMetadataProxy(item)); // Ensure that we remove any invalid entries pruneIndexes(); } So, the indexing / pruneIndexing won't happen if the item is not in either 'archive' or 'withdrawn' state - and it shouldn't be in either whilst it is still in the workspace / workflow. Whilst it passes through the browse indexer, it shouldn't be doing anything that is expensive (or gets more expensive with repository size), before installItem() is called. AFAIK, the BrowseConsumer shouldn't have just an isArchived() check, as that would prevent indexes being updated correctly when an item is withdrawn. But it could replicate the if (isArchived() || isWithdrawn()) check, and doing it in the BrowseConsumer would avoid some overhead that is incurred when IndexBrowse is created. G -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ClassNotFoundException
Hi Anita, Make sure you have environment variables $JAVA_HOME, $PATH, and $CLASSPATH set correctly. Hope this helps! Sue From: Anita P [mailto:digla...@gmail.com] Sent: Friday, February 26, 2010 1:05 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] ClassNotFoundException Hello All, I am a newbie and have installed DSpace. I get the Exception in thread main java.lang.NoClassDefFoundError: for anything i try to do. As an example I was executing hte filter-media ./filter-media Applying Media Filters Exception in thread main java.lang.NoClassDefFoundError: org/dspace/app/mediafilter/MediaFilterManager Caused by: java.lang.ClassNotFoundException: org.dspace.app.mediafilter.MediaFilterManager at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) Could not find the main class: org.dspace.app.mediafilter.MediaFilterManager. Program will exit. Next ./index-init Creating browse index Exception in thread main java.lang.NoClassDefFoundError: org/dspace/browse/IndexBrowse Caused by: java.lang.ClassNotFoundException: org.dspace.browse.IndexBrowse at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) Could not find the main class: org.dspace.browse.IndexBrowse. Program will exit. Exception in thread main java.lang.NoClassDefFoundError: org/dspace/browse/ItemCounter Caused by: java.lang.ClassNotFoundException: org.dspace.browse.ItemCounter at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) Could not find the main class: org.dspace.browse.ItemCounter. Program will exit. Creating search index Exception in thread main java.lang.NoClassDefFoundError: org/dspace/search/DSIndexer Caused by: java.lang.ClassNotFoundException: org.dspace.search.DSIndexer at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) Could not find the main class: org.dspace.search.DSIndexer. Program will exit. So no matter what I do the java.lang.NoClassDefFoundError occurs so I think I am doing something fundamentally wrong. Any ideas where I could be going wrong. I am not sure if this is a very general questiona dn if you need further information to help me out. Thanks in advance. Anita -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Upgrading from DSpace 1.4.2 to DSpace 1.5.2
Hi, Do you have your log level set to DEBUG? If so, try putting it back to INFO. It looks like it's failing in the turnOffAuthorisationSystem method when it's trying to write to the log. Hopefully by putting your log level to INFO will prevent that code from being executed and will let you successfully build your browse indices. public void turnOffAuthorisationSystem() { authStateChangeHistory.push(ignoreAuth); if (log.isDebugEnabled()) { Thread currThread = Thread.currentThread(); StackTraceElement[] stackTrace = currThread.getStackTrace(); String caller = stackTrace[3].getClassName(); authStateClassCallHistory.push(caller); } ignoreAuth = true; } Hope this helps, Sue From: Rajshekhar Pandey [mailto:rajshek...@webinito.com] Sent: Saturday, February 06, 2010 7:14 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Upgrading from DSpace 1.4.2 to DSpace 1.5.2 Hello to all, I am trying to upgrade the Dspace system 1.4.2 to 1.5.2. from http://www.dspace.org/1_5_2Documentation/ch04.html#N10E1F. While performing step no 15 I got error of ArrayIndexOutOfBoundException as C:\dspace\bindsrun org.dspace.browse.IndexBrowse -f -r Using DSpace installation in: C:\dspace Exception in thread main java.lang.ArrayIndexOutOfBoundsException: 3 at org.dspace.core.Context.turnOffAuthorisationSystem(Context.java:220) at org.dspace.browse.IndexBrowse.main(IndexBrowse.java:617) Also, th local dspace instance in running I can submit the items but cannot browse to any item or collection. There are only 34 tables in my database and all bi_* tables are not present. How can I come out of this? -- Regards, Rajshekhar Pandey Jr. Software Engineer Webinito Networks. -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Shifting of dspace from one server to server
Hi Mohit, We've done quite a bit of this in the past few months and have found that the easiest way to move/copy a dspace instance from one machine to the other is: 1. Copy/ftp both your /dspace and /dspace-source directories to the new server. 2. Verify that all your software is installed on the new server: * JAVA * ANT * PostgreSQL * Maven (for later versions) * Web server * Anything else you'll need 3. Modify your dspace.cfg file settings for the new server. 4. Assemble and compile your application. 5. Deploy your web application. Keep in mind this is just an overview of the steps required. Follow the detailed installation instructions for your version. Hope this helps. Sue From: MOHIT SHARMA [mailto:mohit7...@gmail.com] Sent: Tuesday, February 09, 2010 2:54 PM To: dspace-tech@lists.sourceforge.net Cc: Dr Sanjay Kataria Subject: [Dspace-tech] Shifting of dspace from one server to server hi , I have fully developed Dspace working on one computer ( treated as server for local network ), now i want to move that setup of dspace from one server to another . My dspace version is 1.3.2 and i dnt want to update the dspace unless its is required . I have tried to google but couldnt get anything . Please help me its urgent . Thank you With regards Mohit Sharma Student, JIIT College ,Noida,India +91-9312340032 -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Sloooow submission process in DSpace 1.5.1
Hello, We have been noticing recently that, as our repository grows in size (we currently have approx. 125,000 Items and adding more each week), our online submission process is getting slower and slower and slower. It's gotten so bad that, even if I'm only trying to add more authors to an Item by clicking the Add more button: [cid:image003.jpg@01CAA5C7.FD9229D0] It is taking a really long time (just now it took approximately 20 seconds) for the application to respond with the subsequent screen: [cid:image004.jpg@01CAA5C7.FD9229D0] To make things worse, once the customer clicks on the I grant the license button, the application hangs not just for seconds, but for minutes (I saw one case of 11 minutes recently). Our customers are getting very frustrated with this. Has anyone else had this problem or does anyone have an idea of where DSpace might be getting bogged-down. I looked at the INFO messages in the dspace.log file and there seems to be a whole lot of update_item lines in there while not much seems to be happening on the screen, but I didn't look at the programs in detail. Any help would certainly be appreciated. Best regards, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image003.jpginline: image004.jpg-- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Collection Administrators
Hi Richard, This is straight from the (DSpace 1.5.x) documentation, although I'm not sure it answers your question: i. Collection Administrators can: 1. edit Collection description 2. edit Submitters to a Collection 3. map other Items into a Collection 4. edit Item metadata in a Collection 5. withdraw Items from a Collection ii. Collection Administrators can't: 1. edit Authorization Policies at the Collection, Item, or Bitstream Levels 2. edit the Workflow (change Workflow steps) 3. edit Groups 4. delete a Collection Cheers, Sue From: Jizba, Richard [mailto:richardji...@creighton.edu] Sent: Tuesday, January 19, 2010 1:33 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Collection Administrators Hello, We are running 1.5.2 using Manakin. I have set up a collection and created a group. I have assigned two people to the group and also assigned the group the collection administration role. The two users in the collection administrator group can do what I would expect, except for the following: They cannot delete or upload bitstreams on an existing item in the collection. Is this by design or should they be able to do this? If they should be able to do it, how do I fix it so that it works for all existing items and any items that will be added later to that collection? Richard Jizba -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Display order of authors doesn't match submission order
Hi Mark, Yes, it is column place in table metadatavalue that controls the order of things like lists of authors, however I don't know exactly where/when place is populated when new records are submitted to DSpace. On a related note, we have long wanted to change the display of contributor.* in the short Item listing. For example, here is how our short listings appear where there are several contributor.author and corresponding contributor.organization metadata values in the record: Author: Smith, John Stiller, Ben Tilson, Joe Author Affiliation: NASA Langley Research Center Kennedy Space Center Case Western Reserve Univ We would like ours to look like this: Author(s): Smith, John NASA Langley Research Center Stiller, BenKennedy Space Center Tilson, JoeCase Western Reserve Univ Has anyone else done something like this? Thanks, Sue Walker-Thornton NASA Langley Research Center 757-224-4074 susan.m.thorn...@nasa.gov From: Mark Diggory [mailto:mdigg...@atmire.com] Sent: Wednesday, January 13, 2010 11:39 PM To: Gary Browne Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Display order of authors doesn't match submission order Gary, On Wed, Jan 13, 2010 at 3:32 PM, Gary Browne gary.bro...@sydney.edu.aumailto:gary.bro...@sydney.edu.au wrote: Hi all, I'm running dspace 1.5.2. After submitting an item, the author listing is not preserved in the same order as the submission order. Is there some configuration in dspace.cfg which applies to this? I note that there is the jira issue DS-153 but I'm not clear whether this applies to 1.5.2. If so, are there instructions somewhere about applying patches to DSpace? I found this: http://wiki.dspace.org/index.php/ApplyingPatches but it doesn't actually describe the technical process. Quick, dirty solution. Take the following patched version of the file http://dspace.svn.sourceforge.net/viewvc/dspace/branches/dspace-1_5_x/dspace-api/src/main/java/org/dspace/submit/step/DescribeStep.java?revision=3394pathrev=3394 and place it in one of three possible locations: If using the full source distribution, you can replace the contents of the class directly... [dspace-src]/dspace-api/src/main/java/org/dspace/submit/step/DescribeStep.java or if using either distribution you cna choose one of the two following locations: if using jspui [dspace-src]/dspace/modules/jspui/src/main/java/org/dspace/submit/step/DescribeStep.java or if using xmlui [dspace-src]/dspace/modules/xmlui/src/main/java/org/dspace/submit/step/DescribeStep.java The later two place the class only within the webapplication you are building. While the first option will put the class into all webapplications and the lib directory used for the commandline functionality. ... Furthermore, I am running another (unpatched) 1.5.2 instance of dspace which doesn't suffer from this problem - how can that be? Without reviewing the code, I recall the order of the authors is actually driven off the order of database records within the metadatavalue table in database. (someone correct me if I'm in error). Thus differences in behavior may actually be an artifact of the database behavior. Or perhaps your running the 1.5.x branch from svn which has this patch applied? Unfortunately, this is an area where flat old DC records and conversely DSpace do not have particularly strong support. I suspect that capturing the priority of authors could possibly best be held in textual form within an additional field such as dc.identifier.bibliographicCitation field as an unambiguous original citation for the resource. I was reading... http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg05213.html Which might make things look ok in the UI, but I wonder if its of any benefit in other parts of DSpace like crosswalks or oai. Relying on the order of XML fields for semantic detail about which is the first, second, third,... author is going to be both impossible to validate and preserve across disparate technologies/systems... See the Dublin Core usage guide, section 3... http://dublincore.org/documents/usageguide/ Each Dublin Core element is optional and repeatable, and there is no defined order of elements. The ordering of multiple occurrences of the same element (e.g., Creator) may have a significance intended by the provider, but ordering is not guaranteed to be preserved in every user environment. Ordering or sequencing may be syntax dependent; for instance, RDF/XML supports ordering, but HTML does not. Best attempt to preserve this ordering detail in some field such as I've recommended with dc.identifier.bibliographicCitation, even though the usage here is
Re: [Dspace-tech] Can you have different metadata field labels for the same metadata field, in different collections?
Hi Jeff, I just got back to this and I still can't get it to work. Here's what I'm trying to do: 1. If DSpace is displaying the short-listing for Collection 1, use webui.itemdisplay.default to determine which fields will display and what the field labels will be. 2. If DSpace is displaying the short-listing for Collection 2, use webui.itemdisplay.collection2 parameters to determine which fields will display and what the field labels will be. Here are my parameters from dspace.cfg: webui.itemdisplay.default = dc.title, dc.title.alternative, dc.contributor.*, dc.contributor.corpAuthor webui.itemdisplay.collection2 = dc.title, dc.title.alternative, dc.contributor.*, dc.contributor.corpAuthor # Specify which strategy use for select the style for an item plugin.single.org.dspace.app.webui.util.StyleSelection = \ org.dspace.app.webui.util.CollectionStyleSelection #org.dspace.app.webui.util.MetadataStyleSelection webui.itemdisplay.collection1.collections = 2121/32806 metadata.dc.contributor.corpAuthor = Corporate Author Here's where I am confused. What is the syntax for specifying the label (in Messages.properties) for dc.contributor.corpAuthor in collection1? I've tried all of the following and no luck: collection1.dc.contributor.corpAuthor = Organization/Contract collection1.metadata.dc.contributor.corpAuthor = Organization/Contract metadata.collection1.dc.contributor.corpAuthor = Organization/Contract Thanks, Sue Re: [Dspace-tech] Can you have different metadata field labels for the same metadata field, in different collections? Jeffrey Trimble Thu, 05 Nov 2009 11:18:30 -0800 Susan, This isn't really documented very clearly or well. I had to pull an old configuration file back from 1.3.2 days to look at this. Now, my assumption is that it is still valid, but it will only affect the JSPUI interface. Manakin controls the XMLUI interface and that is not done through the dspace config. (And I'm not a big Manakin user) You look for webui.itemdisplay.default line. Then you create a new one, say webui.itemdisplay.fancy= [all of the fields you want] Add webui.itemdisplay.fancy.collections = [handle of the collection]. As you see I have a key named fancy which I might throw in ALL the DC to display. Then the next line tells JSPUI what collections will have that display. Hope this helps. Jeffrey Trimble System LIbrarian William F. Maag Library Youngstown State University 330.941.2483 (Office) jtrim...@cc.ysu.edu http://www.maag.ysu.edu http://digital.maag.ysu.edu I must not fear. Fear is the mind-killer. I will permit it to pass over me and through me... --Litany against fear On Nov 5, 2009, at 12:07 PM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: Does anyone know whether it's possible in DSpace 1.5.1 to have different labels for the same metadata field, depending upon what collection you're in? For instance, if I'm displaying an Item in Collection A, I want the label for contributor.author to be Author, but in Collection B, I want the label for contributor.author to be Contributor. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.gov Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Can you have different metadata field labels for the same metadata field, in different collections?
Sorry - I made a typo - all the references to collection1 in my dspace.cfg parameters should say collection2. Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Wednesday, January 13, 2010 1:13 PM To: dspace-tech@lists.sourceforge.net Cc: jtrim...@cc.ysu.edu Subject: Re: [Dspace-tech] Can you have different metadata field labels for the same metadata field, in different collections? Hi Jeff, I just got back to this and I still can't get it to work. Here's what I'm trying to do: 1. If DSpace is displaying the short-listing for Collection 1, use webui.itemdisplay.default to determine which fields will display and what the field labels will be. 2. If DSpace is displaying the short-listing for Collection 2, use webui.itemdisplay.collection2 parameters to determine which fields will display and what the field labels will be. Here are my parameters from dspace.cfg: webui.itemdisplay.default = dc.title, dc.title.alternative, dc.contributor.*, dc.contributor.corpAuthor webui.itemdisplay.collection2 = dc.title, dc.title.alternative, dc.contributor.*, dc.contributor.corpAuthor # Specify which strategy use for select the style for an item plugin.single.org.dspace.app.webui.util.StyleSelection = \ org.dspace.app.webui.util.CollectionStyleSelection #org.dspace.app.webui.util.MetadataStyleSelection webui.itemdisplay.collection1.collections = 2121/32806 metadata.dc.contributor.corpAuthor = Corporate Author Here's where I am confused. What is the syntax for specifying the label (in Messages.properties) for dc.contributor.corpAuthor in collection1? I've tried all of the following and no luck: collection1.dc.contributor.corpAuthor = Organization/Contract collection1.metadata.dc.contributor.corpAuthor = Organization/Contract metadata.collection1.dc.contributor.corpAuthor = Organization/Contract Thanks, Sue Re: [Dspace-tech] Can you have different metadata field labels for the same metadata field, in different collections? Jeffrey Trimble Thu, 05 Nov 2009 11:18:30 -0800 Susan, This isn't really documented very clearly or well. I had to pull an old configuration file back from 1.3.2 days to look at this. Now, my assumption is that it is still valid, but it will only affect the JSPUI interface. Manakin controls the XMLUI interface and that is not done through the dspace config. (And I'm not a big Manakin user) You look for webui.itemdisplay.default line. Then you create a new one, say webui.itemdisplay.fancy= [all of the fields you want] Add webui.itemdisplay.fancy.collections = [handle of the collection]. As you see I have a key named fancy which I might throw in ALL the DC to display. Then the next line tells JSPUI what collections will have that display. Hope this helps. Jeffrey Trimble System LIbrarian William F. Maag Library Youngstown State University 330.941.2483 (Office) jtrim...@cc.ysu.edu http://www.maag.ysu.edu http://digital.maag.ysu.edu I must not fear. Fear is the mind-killer. I will permit it to pass over me and through me... --Litany against fear On Nov 5, 2009, at 12:07 PM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: Does anyone know whether it's possible in DSpace 1.5.1 to have different labels for the same metadata field, depending upon what collection you're in? For instance, if I'm displaying an Item in Collection A, I want the label for contributor.author to be Author, but in Collection B, I want the label for contributor.author to be Contributor. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.gov Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with authorization error display in DSpace 1.5.1 - SOLVED
I just wanted to let everyone know that I finally solved this problem by commenting out the following line in /error/authorize.jsp: %@ page isErrorPage=true % I also had to do it in the other error JSPs in order for them to be correctly displayed when the corresponding error occurred (invalid-id, integrity, 404, etc). This is actually great because it corrects the display of an Internal Server Error when a User types or clicks on a bad link for a handle. Now the correct error message displays, indicating: Invalid Identifier The identifier 2122/35e8e8e does not correspond to a valid Object.. Now I'm wondering if other folks have had this problem and, if so, should this be considered a bug and be corrected in a future release? Thanks, Sue Walker-Thornton NASA Langley Research Center, Hampton, VA 23666 757-224-4074 From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Tuesday, January 05, 2010 12:50 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem with authorization error display in DSpace 1.5.1 In a DSpace instance where we have some secure collections that are only viewable by certain epersongroups, we are not getting the correct message when a User clicks on an item they do *not* have access to. Instead of getting the authorize.jsp screen, we are getting the internal.jsp screen where the standard server error message displays. I've tracked this down and here's what I've found: 1. In org.dspace.app.webui.util.JSPManager.showAuthorizeError, the line that says response.setStatus(HttpServletResponse.SC_FORBIDDEN); correctly sets the response status code to 403 (Forbidden). 2. org.dspace.app.webui.util.JSPManager.showJSP is then executed with parameters (request, response, /error/authorize.jsp) 3. request.getRequestDispatcher(jsp).forward(request, response); is then executed. 4. org.apache.jsp.error.authorize.jsp then gets a java.lang.NullPointerException error on this line: response.setStatus(((Integer)request.getAttribute(javax.servlet.error.status_code)).intValue()); It appears that when the code in line 4 gets executed, javax.servlet.error.status_code is null and that's why it's getting a java.lang.NullPointerException error, so I'm not sure where the status code 403 is being lost. The strange thing is that we have another DSpace instance where the auth. error displays just fine. In this instance, we have the same DSpace version installed (1.5.1), however there is a different Java version on this machine: java version 1.6.0_07 Java(TM) SE Runtime Environment (build 1.6.0_07-b06) Java HotSpot(TM) Server VM (build 10.0-b23, mixed mode) The version of Java on the machine where we're having the problem is: java version 1.5.0_18 Java(TM) Platform, Standard Edition for Business (build 1.5.0_18-b02) Java HotSpot(TM) Server VM (build 1.5.0_18-b02, mixed mode) Is it possible that the difference in the Java versions is causing our problem? I'm thinking maybe this is the answer because when I look at org.apache.jsp.error.authorize.jsp.java on each machine, they are very different. I saw somewhere too that if no authorization response code is passed in, a general error message will display (can't remember where I saw that). I know this is a lot of detail, but I sure would appreciate any help if anyone has the time. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Problem with authorization error display in DSpace 1.5.1
In a DSpace instance where we have some secure collections that are only viewable by certain epersongroups, we are not getting the correct message when a User clicks on an item they do *not* have access to. Instead of getting the authorize.jsp screen, we are getting the internal.jsp screen where the standard server error message displays. I've tracked this down and here's what I've found: 1. In org.dspace.app.webui.util.JSPManager.showAuthorizeError, the line that says response.setStatus(HttpServletResponse.SC_FORBIDDEN); correctly sets the response status code to 403 (Forbidden). 2. org.dspace.app.webui.util.JSPManager.showJSP is then executed with parameters (request, response, /error/authorize.jsp) 3. request.getRequestDispatcher(jsp).forward(request, response); is then executed. 4. org.apache.jsp.error.authorize.jsp then gets a java.lang.NullPointerException error on this line: response.setStatus(((Integer)request.getAttribute(javax.servlet.error.status_code)).intValue()); It appears that when the code in line 4 gets executed, javax.servlet.error.status_code is null and that's why it's getting a java.lang.NullPointerException error, so I'm not sure where the status code 403 is being lost. The strange thing is that we have another DSpace instance where the auth. error displays just fine. In this instance, we have the same DSpace version installed (1.5.1), however there is a different Java version on this machine: java version 1.6.0_07 Java(TM) SE Runtime Environment (build 1.6.0_07-b06) Java HotSpot(TM) Server VM (build 10.0-b23, mixed mode) The version of Java on the machine where we're having the problem is: java version 1.5.0_18 Java(TM) Platform, Standard Edition for Business (build 1.5.0_18-b02) Java HotSpot(TM) Server VM (build 1.5.0_18-b02, mixed mode) Is it possible that the difference in the Java versions is causing our problem? I'm thinking maybe this is the answer because when I look at org.apache.jsp.error.authorize.jsp.java on each machine, they are very different. I saw somewhere too that if no authorization response code is passed in, a general error message will display (can't remember where I saw that). I know this is a lot of detail, but I sure would appreciate any help if anyone has the time. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Asset store cleanup failing
Yes, that was exactly how we corrected ours! I never figured out where the bad data came from, but once I cleaned it up we've never had a problem with it since. I don't think you've broken anything either as I don't think the primary_bitstream column is used in DSpace anymore? Oh, and we do have cleanup in our cron table to run nightly. Sue From: younga3...@gmail.com [mailto:younga3...@gmail.com] On Behalf Of Anjanette Young Sent: Friday, December 04, 2009 1:30 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Asset store cleanup failing Susan, Thank you for responding. Yes it was the same error. The logs in production were too noisy and not set to debug, so I did not have a good log of the error. Once I figured out the how to remove the red-herring error (different # of assetstores on dev) on a partial copy of production on our development server, the referential integrity violation error became apparent. Error: ERROR: primary_bitstream_id_fk referential integrity violation - key in bitstream still referenced from bundle The SQL I used to find the problem bitstreams: SELECT bitstream.bitstream_id, bitstream.deleted, bundle.bundle_id FROM bitstream JOIN bundle ON bundle.primary_bitstream_id = bitstream.bitstream_id WHERE bundle.primary_bitstream_id 0 AND bitstream.deleted = true; Then updated those primary_bitstream_id's to NULL. Hope I have not broken anything. That this problem is occurring in 1.5.2 is probably evidence of our lack of repository hygiene: we ought to add bin/cleanup to cron. We don't delete items out of the repository very often, so it was probably not added before. Thank you, Anjanette On Fri, Dec 4, 2009 at 9:44 AM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Seems like we had this problem back in 1.4.2. Ours did the same thing - the script output shows the success messages you mention below, however if you look in the dspace.log, you'll see that it's indeed getting relational integrity errors - can't remember exactly, but it was something between the bitstream, bundle2bitstream, and bundle tables - it might have been the primary_bitstream_id was pointing to the wrong row in the bundle2bitstream and/or bitstream tables..?? In order to correct it, I believe I had to write some sql queries and, one by one, clean up the errors by updating column(s) in the offending table. Sorry I can't remember exactly what I did, but if you'll look in the dspace.log, you'll see the output from the cleanup script and it should give you a better idea of exactly what needs to be done. If you'll check your log and post the error(s) you're getting, it might help me remember what exactly we did to fix it. Best, Sue Walker-Thornton -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.demailto:claudia.juer...@ub.tu-dortmund.de] Sent: Wednesday, December 02, 2009 7:26 AM To: Anjanette Young Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Asset store cleanup failing Hello Anjanette, can you provide more information from the logs, postgres and/or dspace? Claudia Jürgen Anjanette Young schrieb: We are running DSpace 1.5.2 with Postgresql 7.3. I have been running $dspace/bin/cleanup which happily states: Cleaning the asset store Cleanup completed But files have not been cleaned from the assetstore, nor have the deleted=true bitstreams been deleted from the db table. I've checked to see if it might be related to http://jira.dspace.org/jira/browse/DS-197 , but none of the primary_bitstream_id 0 bundles are related to bitstreams marked for deletion. Has anyone else run into this problem? Any help appreciated, Anjanette -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Inherit authorization from collection to items and bundles
This is the exact problem we're having and I don't know how to assign the authorization to Add to bundle. Sue From: Guillermo Antonio Varela [mailto:gavar...@icesi.edu.co] Sent: Wednesday, December 02, 2009 2:27 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Inherit authorization from collection to items and bundles Hi, We're working with DSpace 1.5.1 and when a user wants to add or remove bitstreams (files) to an ítem, that was already submited, appears an authorization error. The user already has all the privileges in the community and the collection. In order to allow the user to add or remove bitstreams we have to give them the authorization directly to the bundle. ¿Is there a way to inherit the authorizations from collection to items and bundles, so we don't have to wait until the item be submited? Thanks for the help you can give us. Guillermo Antonio Varela Herrera Desarrollo de Sistemas Servicios y Recursos de Informaciónhttp://www.icesi.edu.co/servicios_apoyo Universidad Icesihttp://www.icesi.edu.co/ -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Asset store cleanup failing
Seems like we had this problem back in 1.4.2. Ours did the same thing - the script output shows the success messages you mention below, however if you look in the dspace.log, you'll see that it's indeed getting relational integrity errors - can't remember exactly, but it was something between the bitstream, bundle2bitstream, and bundle tables - it might have been the primary_bitstream_id was pointing to the wrong row in the bundle2bitstream and/or bitstream tables..?? In order to correct it, I believe I had to write some sql queries and, one by one, clean up the errors by updating column(s) in the offending table. Sorry I can't remember exactly what I did, but if you'll look in the dspace.log, you'll see the output from the cleanup script and it should give you a better idea of exactly what needs to be done. If you'll check your log and post the error(s) you're getting, it might help me remember what exactly we did to fix it. Best, Sue Walker-Thornton -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Wednesday, December 02, 2009 7:26 AM To: Anjanette Young Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Asset store cleanup failing Hello Anjanette, can you provide more information from the logs, postgres and/or dspace? Claudia Jürgen Anjanette Young schrieb: We are running DSpace 1.5.2 with Postgresql 7.3. I have been running $dspace/bin/cleanup which happily states: Cleaning the asset store Cleanup completed But files have not been cleaned from the assetstore, nor have the deleted=true bitstreams been deleted from the db table. I've checked to see if it might be related to http://jira.dspace.org/jira/browse/DS-197 , but none of the primary_bitstream_id 0 bundles are related to bitstreams marked for deletion. Has anyone else run into this problem? Any help appreciated, Anjanette -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Add Bitstream
I'm having the same problem in online DSpace 1.5.1. We don't do this much since most of our documents/Items are uploaded via ItemImport in batch. Recently though I've had to sign on as Administrator and upload documents for a User due to authorization problems. I've looked at it a bit and it looks like it wants to have Add permission at the Bundle level, but I can't figure out how to assign it! (see my email to dspace-tech dated 11/24/2009, entitled, [Dspace-tech] Authorization Error/Question - How to add ADD authorization for Bundle to DSpace 1.5.1? - copy attached!) Sue -Original Message- From: Serbe Leon Rojas [mailto:serbe.ro...@biblioteca.udea.edu.co] Sent: Thursday, December 03, 2009 9:45 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Add Bitstream Hello, I have assigned permissions to a user in a collection in order that him/her could submit the documents and also I have assigned the manager's privileges of the collection for when it's necessary to add a bitstream or to delete someone. When the user tries to add the bitstream, the system says to him(her) that it's does not have authorization... Where more I must assign permissions? Thank you - Serbe León Rojas Yepes Biblioteca Digital Universidad de Antioquia Medellin - Colombia Somos el Alma de la Universidad -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [susan.m.thorn...@nasa.gov] Sent: Tuesday, November 24, 2009 3:50 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Authorization Error/Question - How to add ADD authorization for Bundle to DSpace 1.5.1? Attachments: ATT1.txt; ATT2.txt A User reported a problem she was having in our Production DSpace instance this morning as follows: There was an already-existing Item with 1 bundle/bitstream (.pdf file) in a Collection. She was trying to add another bitstream (.pdf file) to the Item and received this error: authorize_error:org.dspace.authorize.AuthorizeException: Authorization denied for action ADD on BUNDLE:618242 by user 34 This doesnt make sense to me because I have thoroughly explored the authorization screens in the online app. this morning and cant find anywhere that I could grant ADD access at the BUNDLE level. Im trying to figure out exactly what this User is missing. She is a member of a group that has the following access to this collection: ADDTHISCOLLECTION_SUBMIT_GROUP Thanks in advance, Sue Walker-Thornton Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.gov -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How to determine DSpace version?
Very simply, we put the version in our text on our site in the configuration parameter dspace.name in dspace.cfg. Example: dspace.name = Langley Digital Repository (LDR), version 1.5.1 Cheers, Sue -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Monday, November 30, 2009 7:14 AM To: Gary Browne Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] How to determine DSpace version? Hello Gary, if you are using the source release, CHANGES and README do contain the version information. For a more standard way, this is something being discussed atm. Hope that helps Claudia Jürgen Gary Browne schrieb: Hi all, Is there a definitive way to determine the version of dspace that is running? I note that in 1.5.x I can do something like look at the name of the dspace-VERSION.jar, but there must be a more standard way? What about for older versions? Cheers Gary Gary Browne Development Programmer Library IT Services University of Sydney ph: 9351-5946 Sent from my plain old desktop computer. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Join us December 9, 2009 for the Red Hat Virtual Experience, a free event focused on virtualization and cloud computing. Attend in-depth sessions from your desk. Your couch. Anywhere. http://p.sf.net/sfu/redhat-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Authorization Error/Question - How to add ADD authorization for Bundle to DSpace 1.5.1?
A User reported a problem she was having in our Production DSpace instance this morning as follows: There was an already-existing Item with 1 bundle/bitstream (.pdf file) in a Collection. She was trying to add another bitstream (.pdf file) to the Item and received this error: authorize_error:org.dspace.authorize.AuthorizeException: Authorization denied for action ADD on BUNDLE:618242 by user 34 This doesn't make sense to me because I have thoroughly explored the authorization screens in the online app. this morning and can't find anywhere that I could grant ADD access at the BUNDLE level. I'm trying to figure out exactly what this User is missing. She is a member of a group that has the following access to this collection: ADDTHISCOLLECTION_SUBMIT_GROUP Thanks in advance, Sue Walker-Thornton Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Errors during vacuuming postgres
Also it takes a lng time to grant license while subscribing to a collection We have also been having this problem for quite awhile now and I have so far been unable to track it down. There can sometimes be an up to 7 minute delay. I think it may be related to authorization checking (resourcepolicies table)...??? But I'm not sure. Attached is a portion of a dspace.log from today that traces the ingest of an Item online thru the workflow process. There are no approvals required along the way. Once the User clicks I grant the license, the system hangs for several minutes before completing successfully. It is somewhere in the update_item process. Note the gap of time between 08:14:11,594 and 08:19:25,567 is OVER 5 MINUTES! What in the world is causing this??? Thanks, Sue From: Sangamnerkar Tushar [mailto:sangam...@yahoo.com] Sent: Wednesday, November 18, 2009 2:05 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Errors during vacuuming postgres Hello We are running dspace 1.4.2 on RHEL 5.0 with postgresql 8.1.9-1.el5 as database. These are the warning messages I am getting during vacuuming postgres WARNING: skipping pg_authid --- only table or database owner can vacuum it WARNING: skipping pg_tablespace --- only table or database owner can vacuum it WARNING: skipping pg_pltemplate --- only table or database owner can vacuum it WARNING: skipping pg_shdepend --- only table or database owner can vacuum it WARNING: skipping pg_auth_members --- only table or database owner can vacuum it WARNING: skipping pg_database --- only table or database owner can vacuum it How can they be handled Also it takes a lng time to grant license while subscribing to a collection Tushar Sangamnerkar ARDE TIRC Pune The INTERNET now has a personality. YOURS! See your Yahoo! Homepagehttp://in.rd.yahoo.com/tagline_yyi_1/*http:/in.yahoo.com/. sample.dspace.log Description: sample.dspace.log -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] HELP with Implementing SRB or an alternative in DSpace 1.5.1
Hi, We have some unique collection access/authorization issues and we're trying to figure out if there's a way to implement the basic scenario depicted in the diagram below. What we're trying to avoid is having to implement the DSpace application on two servers, and having to deal with loading documents and metadata onto two separate servers. ***Note: We cannot store these documents on the same server. 1. Is implementing SRB in DSpace simply a matter of correctly configuring the dspace.cfg file? Is there any separate software you need to install on your server? 2. Has anyone actually implemented SRB in DSpace and, if so I would like to see a real example of how you configured all the srb.*.assetstore# parameters in dspace.cfg? The documentation does not say much about how these parameters should be configured, for example I have no idea what to use for srb.mcatzone, srb.mdasdomainname, or srb.defaultstorageresource?? 3. Is there any plan to configure a future release of dspace so that you can control which assetstore an Item/Document get written to based on Collection id? Ultimately we'd like to do this so we wouldn't have to keep manipulating assetstore.incoming based on which Collection was being loaded. 4. Can anyone suggest any alternatives? We've also looked at registration, but that also duplicates metadata in two separate instances of DSpace from what I understand. Thanks in advance, Sue [cid:image001.jpg@01CA687C.B99C1D90] Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov inline: image001.jpg-- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Error : ant fresh_install
You are now getting this error: [java] java.sql.SQLException: The url cannot be null Check your dspace.cfg configuration parameter for db.url. It looks like yours is null. Here is what we have ours set to: db.url = jdbc:postgresql://127.0.0.1:5432/dspace Hope this helps, Sue Walker-Thornton From: SANDEEP BHAVSAR [mailto:sandeep.bhav...@gmail.com] Sent: Sunday, November 01, 2009 1:51 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Error : ant fresh_install Respected All AS per your suggestions I have changed the database password in dspace.cfg and that works for me. Now if you notice the error is not showing this line. [java] org.postgresql.util. PSQLException: FATAL: password authentication failed for user dspace dsp...@sbhavsar-server:~/ dspace-1.5.2-src-release/dspace/target/dspace-1.5.2-build.dir$ ant fresh_install Buildfile: build.xml init_installation: init_configs: setup_database: [java] 2009-11-01 09:48:46,229 INFO org.dspace.core.ConfigurationManager @ Loading system provided config property (-Ddspace.configuration): config/dspace.cfg [java] 2009-11-01 09:48:46,238 INFO org.dspace.core.ConfigurationManager @ Using default log4j provided log configuration,if uninitended, check your dspace.cfg for (log.init.config) [java] 2009-11-01 09:48:46,238 INFO org.dspace.storage.rdbms.InitializeDatabase @ Initializing Database [java] 2009-11-01 09:48:46,314 FATAL org.dspace.storage.rdbms.InitializeDatabase @ Caught exception: [java] java.sql.SQLException: The url cannot be null [java] at java.sql.DriverManager.getConnection(DriverManager.java:554) [java] at java.sql.DriverManager.getConnection(DriverManager.java:185) [java] at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:65) [java] at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:294) [java] at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:974) [java] at org.apache.commons.dbcp.PoolingDriver.connect(PoolingDriver.java:176) [java] at java.sql.DriverManager.getConnection(DriverManager.java:582) [java] at java.sql.DriverManager.getConnection(DriverManager.java:207) [java] at org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:550) [java] at org.dspace.storage.rdbms.DatabaseManager.loadSql(DatabaseManager.java:923) [java] at org.dspace.storage.rdbms.InitializeDatabase.main(InitializeDatabase.java:100) BUILD FAILED /home/dspace/dspace-1.5.2-src-release/dspace/target/dspace-1.5.2-build.dir/build.xml:585: Java returned: 1 Total time: 1 second Simulataneously I am installing Dspace on Centos 5.3 (existing error is on Ubuntu 8.04) and getting the same error. -- Thanks and Regards Sandeep Bhavsar Librarian Dr.V.N.Bedekar Institute of Management Studies Thane(W) 400601 MUMBAI. INDIA @@ email: sandeep.bhav...@gmail.commailto:sandeep.bhav...@gmail.com Mob : 9987049099 elibrary :http://www.vpmthane.org/im/elib/main.htm @@ -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP!
Hi Mark, I see what you're saying. I'm going to try to change LDAPServlet.java to get it to do exactly what you're suggesting. Will you let you know what happens! Thanks a bunch, Sue -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Tuesday, October 27, 2009 9:22 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP! On Mon, Oct 26, 2009 at 08:36:46AM -0500, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: We are getting error: 32LDAP_NO_SUCH_OBJECT 20No such objectThe specified object does not exist in the directory. I put some displays in LDAPServlet.java and here is what I'm getting when I try to enter my username (it's in a field called agencyUID): 2009-10-26 09:28:22,278 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:login:type=ldap,netid=suethorn 2009-10-26 09:28:22,302 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:display:security_principal=ou=people,dc=nasa,dc=gov If this ^^ means what I think it means, then I'm not surprised at the No Such Object. I doubt that an OU can be a security principal. I would have expected security_principal=agencyUID=suethorn,ou=people,dc=nasa,dc=gov. But from your earlier note, I suspect that authentication will require a security_principal like employeenumber=NNN,ou=people,dc=nasa,dc=gov and DSpace would have to look up the user account's DN by searching the context for agencyUID=... and then authenticating the password and the result of that search. Your directory administrator should be able to give you a definitive statement on what is required for authentication. If you must look up the DN using another attribute, you may have to have an authenticated binding to the directory first in order to be permitted to search. That is, the sequence of directory operations would be: 1. Bind using a fixed (DN, password) pair allocated for looking up users. Let's call this DistinguishedName DN1. 2. Search the context for an account with the presented attribute (agencyUID) and requesting the DistinguishedName. Call the returned object's DN DN2. 3. Unbind. 4. Bind again using (DN2, user-entered password). Log the DSpace session in as the presented user if this succeeds. 5. Unbind. We don't actually use LDAP with DSpace here -- I've used it in other applications -- so I don't know whether it can carry out this sequence, but it should not be difficult or lengthy to adapt the existing authenticator if required. 2009-10-26 09:28:22,311 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:login:type=ldap_search_context =ou=people,dc=nasa,dc=gov 2009-10-26 09:28:22,311 WARN org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:ldap_authentication:type=failed_auth javax.naming.AuthenticationException: [LDAP: error code 32 - No Such Object] This is a critical project we should have had implemented weeks ago...and we're at a loss so any help you can provide would really be appreciated. I've tried everything I know to try. One last question - should I be able to see where the password is stored thru the ldap browser? I don't see an actual password field there. The directory administrator probably won't let you fetch any form of the password, as that would tend to compromise security. Depending on how the directory is set up, it may not even store the passwords itself, but rather pass them through to an authentication service or act as authentication proxy working against such a service (such as Kerberos). Even if the directory does store passwords, it's most likely configured to prevent you seeing even their existence, since it can test the user's credentials and return success/failure without revealing password hashes and that's all it is required to do. -- Mark H. Wood, Lead System Programmer mw...@iupui.edu Friends don't let friends publish revisable-form documents. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP!
Hi Stuart, With the documentation on your blog, I was able to get anonymous bind working so that we don't have to use a preconfigured set of credentials. What a relief!! Thanks Stuart, Mark, and to everyone else who offered their help on this issue!! Best, Sue -Original Message- From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Tuesday, October 27, 2009 2:08 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY]; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP! Hi Sue, Try using LDAPHeirarchicalAuthentication instead as your authentication method, as that is how it works. It is designed to first bind using a pre-configured set of credentials, find the DN of the user (typically because it is down a few branches in the trree somewhere), unbind, and then re-bind using the user's DN. Further details and a sample config are at http://blog.stuartlewis.com/2008/08/18/test-ldap-service-upgraded-now-with-branches/ Thanks, Stuart From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [susan.m.thorn...@nasa.gov] Sent: Wednesday, 28 October 2009 3:57 a.m. To: Mark H. Wood; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP! Hi Mark, I see what you're saying. I'm going to try to change LDAPServlet.java to get it to do exactly what you're suggesting. Will you let you know what happens! Thanks a bunch, Sue -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Tuesday, October 27, 2009 9:22 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP! On Mon, Oct 26, 2009 at 08:36:46AM -0500, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: We are getting error: 32LDAP_NO_SUCH_OBJECT 20No such objectThe specified object does not exist in the directory. I put some displays in LDAPServlet.java and here is what I'm getting when I try to enter my username (it's in a field called agencyUID): 2009-10-26 09:28:22,278 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:login:type=ldap,netid=suethorn 2009-10-26 09:28:22,302 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:display:security_principal=ou=people,dc=nasa,dc=gov If this ^^ means what I think it means, then I'm not surprised at the No Such Object. I doubt that an OU can be a security principal. I would have expected security_principal=agencyUID=suethorn,ou=people,dc=nasa,dc=gov. But from your earlier note, I suspect that authentication will require a security_principal like employeenumber=NNN,ou=people,dc=nasa,dc=gov and DSpace would have to look up the user account's DN by searching the context for agencyUID=... and then authenticating the password and the result of that search. Your directory administrator should be able to give you a definitive statement on what is required for authentication. If you must look up the DN using another attribute, you may have to have an authenticated binding to the directory first in order to be permitted to search. That is, the sequence of directory operations would be: 1. Bind using a fixed (DN, password) pair allocated for looking up users. Let's call this DistinguishedName DN1. 2. Search the context for an account with the presented attribute (agencyUID) and requesting the DistinguishedName. Call the returned object's DN DN2. 3. Unbind. 4. Bind again using (DN2, user-entered password). Log the DSpace session in as the presented user if this succeeds. 5. Unbind. We don't actually use LDAP with DSpace here -- I've used it in other applications -- so I don't know whether it can carry out this sequence, but it should not be difficult or lengthy to adapt the existing authenticator if required. 2009-10-26 09:28:22,311 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:login:type=ldap_search_context =ou=people,dc=nasa,dc=gov 2009-10-26 09:28:22,311 WARN org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:ldap_authentication:type=failed_auth javax.naming.AuthenticationException: [LDAP: error code 32 - No Such Object] This is a critical project we should have had implemented weeks ago...and we're at a loss so any help you can provide would really be appreciated. I've tried everything I know to try. One last question - should I be able to see where the password is stored thru the ldap browser? I don't see an actual password field there. The directory administrator probably won't let you
Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP!
Hi, Thanks very much for your suggestions! With helps from you and several others today, we have gotten our LDAP Authentication working with Dspace 1.5.1!! Best regards, Sue Walker-Thornton -Original Message- From: Filippos Kolovos [mailto:filip...@uom.gr] Sent: Tuesday, October 27, 2009 4:14 AM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net Subject: Re: Can't get LDAP to work in DSpace 1.5.1 - Please HELP! Hello there, I have enabled the LDAP server in our institution and I also had some problems during the process. At first you have to make sure that there's no firewall behind the LDAP server that prohibits dspace from accessing the directory. Secondly, to answer a question you pose below, if you need to authenticate via LDAP *only* then you do not need to use both authentication methods for that. Only the LDAP method will suffice. However, please note that enabling only the LDAP method will prohibit existing users in the dspace database (i.e. users that have registered themselves in dspace) to login in the future, since only the LDAP method will be available. Third, the files that are actually used to authenticate in LDAP (and via password authentication) are in the directory: dspace-source-release/dspace-api/src/main/java/org/dspace/authenticate and they are the files: LDAPAuthentication.java and PasswordAuthentication.java. Furthermore, in the dspace-source-release/dspace-jspui/dspace-jspui-api/src/main/java/org/dspace/app/webui/servlet you will find the LDAPServlet.java file that controls what JSP file is being displayed to the user according to the parameter ldap.enable. Also, in the dspace.cfg file, make sure where you edit the authentication methods, to edit them *in the file* and not pasting the authentication method from an external source, since sometimes it can get somehow corrupted and it does not see that you have enabled an authentication method. Also in the log directory of the running instance of dspace, e.g. /dspace/log/ the file dspace.log, or dspace.log.1, etc records some useful information during the LDAP authentication process that may actually point the errors that prevent the LDAP from working properly. I hope that I have helped. Best Regards, -Fk -- Filippos Kolovos Software Systems Analyst Engineer M.Sc. (Eng.) in Data Communications Automation Networking Department University of Macedonia Library Egnatia 156, P.O.Box 1591 540 06 Thessaloniki, Greece E-Mail: f.kolo...@ieee.org, filip...@uom.gr Profile: http://www.linkedin.com/in/filipposkolovos --- - Original Message - Date: Thu, 22 Oct 2009 15:33:13 -0500 From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.gov Subject: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP! To: dspace-tech@lists.sourceforge.net dspace-tech@lists.sourceforge.net Message-ID: 03de6124b1f32240b3692ed5e591ed1604de005...@ndmsscc07.ndc.nasa.gov Content-Type: text/plain; charset=us-ascii We have been struggling for awhile trying to get LDAP to work in DSpace 1.5.1 and I hope someone can help. I am new to LDAP and have followed the instructions in the doc. but something's still not right. First, I want to make sure I understand what LDAP is supposed to do for me in DSpace: 1. If I've never been on the DSpace site before, I click on Register, which takes me to another logon screen that prompts me to enter Userid, password, and email address. When I have entered this information, DSpace goes out to LDAP and looks for whatever parameters I have set up in the dspace.cfg file and then, based on those parameters, it tries to find me in LDAP. If it finds me, if I have autoregister turned on, I get registered and an e-person record gets added to DSpace with my appropriate netid. If it doesn't find me, I can still register by filling out all the fields (registering myself). Or 2. If I've never been on the DSpace site before, I click on Sign in which takes me to the logon screen that only prompts me to enter my Userid and password. When I have entered this information, DSpace goes out to LDAP and looks for whatever parameters I have set up in the dspace.cfg file and then, based on those parameters, it tries to find me in LDAP. If it finds me, if I have autoregister turned on, I get registered and an e-person record gets added to DSpace with my appropriate netid. If it doesn't find me, I can still register by filling out all the fields (registering myself). I downloaded an LDAP browser and here is how I find the record I want: ou=people,dc=nasa,dc=gov filter on agencyUID=swalkthor to get to record. Here are my parameters from dspace.cfg: Stackable Authentication Methods # # Stack of authentication methods # (See
Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP!
We are getting error: 32LDAP_NO_SUCH_OBJECT 20No such objectThe specified object does not exist in the directory. I put some displays in LDAPServlet.java and here is what I'm getting when I try to enter my username (it's in a field called agencyUID): 2009-10-26 09:28:22,278 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:login:type=ldap,netid=suethorn 2009-10-26 09:28:22,302 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:display:security_principal=ou=people,dc=nasa,dc=gov 2009-10-26 09:28:22,311 INFO org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:login:type=ldap_search_context =ou=people,dc=nasa,dc=gov 2009-10-26 09:28:22,311 WARN org.dspace.app.webui.servlet.LDAPServlet @ anonymous:session_id=567AE3ACFD839A70BE84ED443557B907:ip_addr=xx:ldap_authentication:type=failed_auth javax.naming.AuthenticationException: [LDAP: error code 32 - No Such Object] This is a critical project we should have had implemented weeks ago...and we're at a loss so any help you can provide would really be appreciated. I've tried everything I know to try. One last question - should I be able to see where the password is stored thru the ldap browser? I don't see an actual password field there. Thanks, Sue -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Friday, October 23, 2009 12:14 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Can't get LDAP to work in DSpace 1.5.1 - Please HELP! Please tell us in what way it fails to work. (Doesn't authenticate; authenticates but doesn't auto-register; something else) What errors might DSpace be logging when you try this? Hmmm, yes, if the DN is built using employeenumber and you tell DSpace that the unique identifier is agencyUID, that could be a problem. It's going to use agencyUID=someone to bind to the directory in order to validate credentials, and that isn't the name of the object. If you need to provide logon by agencyUID then you're going to need to be able to tell the code to look up by one attribute but form the binding DN using another, having looked up the object by the former and retrieved the latter. I don't see that DSpace can do that yet. -- Mark H. Wood, Lead System Programmer mw...@iupui.edu Friends don't let friends publish revisable-form documents. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Filtering errors with XPDF Tools
Hi Eric, I was successfully able to install and use pdftotext, but got the same errors as you when trying to create thumbnails. I tried a bunch of different things, but alas was not able to get it working. I know some folks have gotten it working though, so I'm not sure what the problem is. Sue -Original Message- From: Kurzenberger, Eric [mailto:eric.kurzenber...@yale.edu] Sent: Tuesday, October 20, 2009 10:52 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Filtering errors with XPDF Tools Just an update to this issue, it looks like there's a section missing from the DSpace documentation. I believe this dependency needs to be added to the pom.xml in the dspace-api directory: dependency groupIdcom.sun.media/groupId artifactIdjai_imageio/artifactId version1.0_01/version /dependency Unfortunately, this doesn't fix my issue: I'm still getting the java.io.IOException: Cannot run program /usr/bin/pdftoppm : java.io.IOException: error=2, No such file or directory errors when running filter-media. Anyone have any ideas? I've gone through the other installation steps in the documentation repeatedly, to no avail. Cheers, Eric On 10/19/09 9:44 AM, Eric Kurzenberger eric.kurzenber...@yale.edu wrote: Hello, I'm running DSpace 1.5.2 XMLUI on a Linux system, and I've been trying to install the XPDF tools for PDF thumbnails, following the recommendation of a user on this list. I followed the instructions to install the tools in the 1.5.2 documentation and believe I've successfully installed the jai_imageio jar and set the configuration correctly. But when I try to run the filter-media command, I'm getting errors with pdfoppm. The documentation mentions that a POM in the dspace-api module needs to be edited, but it doesn't specify which POM, and what element needs to be added. I've included a sample of the errors below. Thanks for any help you can provide. Error: ERROR filtering, skipping bitstream: Item Handle: 10538/148 Bundle Name: ORIGINAL File Size: 6898424 Checksum: 4637dd47354393dc87f3d2b881ec311d (MD5) Asset Store: 0 java.io.IOException: Cannot run program /usr/bin/pdftoppm : java.io.IOException: error=2, No such file or directory java.io.IOException: Cannot run program /usr/bin/pdftoppm : java.io.IOException: error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:459) at java.lang.Runtime.exec(Runtime.java:593) at java.lang.Runtime.exec(Runtime.java:466) at org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnail.java:251) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:668) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:570) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:520) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:488) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:427) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:359) Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.init(UNIXProcess.java:148) at java.lang.ProcessImpl.start(ProcessImpl.java:65) at java.lang.ProcessBuilder.start(ProcessBuilder.java:452) I have verified that the XPDF tools, including pdftoppm, are in the /usr/bin directory. Cheers, Eric -- Eric Kurzenberger Digital Media Coordinator Yale School of Architecture 180 York St. New Haven, CT 06511 T: 203.436.4176 F: 203.432.7175 -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The
Re: [Dspace-tech] Number of items in Community/Collection
You also have some options in dspace.cfg as to how you want to keep these numbers updated -- realtime or in a nightly cron. We choose the nightly cron to minimize online overhead. So what happens is that any Items that are added to (or deleted from) DSpace are not reflected in the Community/Collection counts until the following day. Sue -Original Message- From: gathub [mailto:thermalfluids...@gmail.com] Sent: Thursday, October 08, 2009 3:57 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Number of items in Community/Collection What you want to modify is the 'webui.strengths' configuration in your dspace.cfg I think all you have to do is change it to 'webui.strengths.show = true' and the count will show up for each community/collection. Baseer wrote: Hello , I have recently updated Dspace 1.5 and presently customizing it , I had a question . Is there a code which would generate/display number of items in a community or collection . Thank you , Baseer. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- View this message in context: http://www.nabble.com/Number-of-items-in-Community-Collection-tp25805567p25807014.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] media filter problem
The instructions are in the DSpace 1.5.2 Manual at http://www.dspace.org/1_5_2Documentation/DSpace-Manual.pdf Let me know if you have any questions about the install! Best, Sue -Original Message- From: Susan Teague Rector [mailto:setea...@vcu.edu] Sent: Wednesday, September 23, 2009 4:57 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] media filter problem Hi Sue, Thanks - I've had those errors as well - How do you switch to xpdf? Thanks, Susan Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] wrote: Hi Susan, I'm not sure if the problem we were having is related to yours since you're dealing with .jpg files (we have all .pdfs), but we saw lots of similar errors prior to switching from the use of PDFBox to xpdftotext and xpdftothumbnail. When we were using PDFBox, approximately 10% of the documents in our repository would not filter due to errors that looked suspiciously like the ones you're getting. Now that we've switched to xpdf, 100% of our documents filter successfully. Sue -Original Message- From: Susan Teague Rector [mailto:setea...@vcu.edu] Sent: Wednesday, September 23, 2009 3:07 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] media filter problem Hi all, Just wondering if anyone else is having this issue - I haven't seen other comments, which leads me to believe it's either a) a bug or b) our installation. Thanks for your help! Susan Susan Teague Rector wrote: Hi all, I've been searching in the archives, but haven't found the specific problem I'm having I'm on Dspace 1.4.1 and when I run the filter media program, I'm receiving a ton of null pointer exceptions, especially on jpeg files: java.lang.NullPointerException at org.dspace.app.mediafilter.JPEGFilter.getDestinationStream(JPEGFilter.java:108) at org.dspace.app.mediafilter.MediaFilter.processBitstream(MediaFilter.java:155) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:327) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:296) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:266) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:234) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:185) I'm not sure that this is related, but what's happening is that on the item view, I can see the word 'thumbnail' but there is no image there. If I log in and click on 'edit' to see all metadata, I can view the generated thumbnail. See an example here: https://digarchive.library.vcu.edu/handle/10156/1349 Thanks in advance Susan -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Can you limit search index updates to overnight cron processing in DSpace 1.5.1?
We have a large repository (currently 251,708 items) and are currently experiencing performance issues when doing online Item adds, modifies, or deletes. I'm thinking that this may be caused, at least in part, by the online index-updating. Is there a way in DSpace 1.5.1 to specify that you don't want your search index to be updated in the online application and that you will only update it in a nightly cron (index-update)? I thought maybe I could accomplish this by commenting out these two lines in dspace.cfg: event.consumer.search.class = org.dspace.search.SearchConsumer event.consumer.search.filters = Item|Collection|Community|Bundle+Create|Modify|Modify_Metadata|Delete:Bundle+Add|Remove This didn't appear to work though. What did happen was that online updates stopped working. For instance, if I tried to modify the value of one of the metadata fields for an item, I wouldn't get any error(s), but the update did not take. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] media filter problem
Hi Susan, I'm not sure if the problem we were having is related to yours since you're dealing with .jpg files (we have all .pdfs), but we saw lots of similar errors prior to switching from the use of PDFBox to xpdftotext and xpdftothumbnail. When we were using PDFBox, approximately 10% of the documents in our repository would not filter due to errors that looked suspiciously like the ones you're getting. Now that we've switched to xpdf, 100% of our documents filter successfully. Sue -Original Message- From: Susan Teague Rector [mailto:setea...@vcu.edu] Sent: Wednesday, September 23, 2009 3:07 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] media filter problem Hi all, Just wondering if anyone else is having this issue - I haven't seen other comments, which leads me to believe it's either a) a bug or b) our installation. Thanks for your help! Susan Susan Teague Rector wrote: Hi all, I've been searching in the archives, but haven't found the specific problem I'm having I'm on Dspace 1.4.1 and when I run the filter media program, I'm receiving a ton of null pointer exceptions, especially on jpeg files: java.lang.NullPointerException at org.dspace.app.mediafilter.JPEGFilter.getDestinationStream(JPEGFilter.java:108) at org.dspace.app.mediafilter.MediaFilter.processBitstream(MediaFilter.java:155) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:327) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:296) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:266) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:234) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:185) I'm not sure that this is related, but what's happening is that on the item view, I can see the word 'thumbnail' but there is no image there. If I log in and click on 'edit' to see all metadata, I can view the generated thumbnail. See an example here: https://digarchive.library.vcu.edu/handle/10156/1349 Thanks in advance Susan -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Can Stemming be turned off in DSpace Lucene searches?
We are trying to figure out an easy way to turn off stemming in DSpace searches. Can anyone point me in the right direction? Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem creating dspace database in 1.5.1 - correction
Sorry, here was the command I was trying to execute: createdb -U dspace -E UNICODE dspace and here is the error I'm getting: createdb: database creation failed: ERROR: encoding UTF8 does not match server's locale en_US.ISO8859-15 DETAIL: The server's LC_CTYPE setting requires encoding LATIN9. Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Sent: Tuesday, August 25, 2009 1:57 PM To: dspace-tech@lists.sourceforge.net Cc: 'Kimbrough, Glenn W. (LARC-B704)[NCI INFORMATION SYSTEMS]'; Smail, James W. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: Problem creating dspace database in 1.5.1 Hi, I am trying to install dspace 1.5.1 on a Windows machine with Solaris 10 x86. I'm getting an error when I try to create the dspace database: STATEMENT: createuser -U postgres -d -A -P dspace; ERROR: encoding UTF8 does not match server's locale en_US.ISO8859-15 DETAIL: The server's LC_CTYPE setting requires encoding LATIN9. STATEMENT: CREATE DATABASE dspace ENCODING 'UNICODE'; We are running postgreSQL 8.3. Here are our locale settings from postgresql.conf: # - Locale and Formatting - datestyle = 'iso, mdy' #timezone = unknown # actually, defaults to TZ environment # setting #timezone_abbreviations = 'Default' # Select the set of available time zone # abbreviations. Currently, there are # Default # Australia # India # You can create your own file in # share/timezonesets/. #extra_float_digits = 0 # min -15, max 2 #client_encoding = sql_ascii# actually, defaults to database # encoding # These settings are initialized by initdb, but they can be changed. lc_messages = 'C' # locale for system error message # strings lc_monetary = 'en_US.ISO8859-15'# locale for monetary formatting lc_numeric = 'en_US.ISO8859-15' # locale for number formatting lc_time = 'en_US.ISO8859-15'# locale for time formatting # default configuration for text search default_text_search_config = 'pg_catalog.english' Can anyone help? I'm not exactly sure what to do about this. We have another instance running on a Sun Solaris 10 sparc machine and the only difference I see in the postgresql.conf files is that lc_time='C' in sparc. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: xpdf question in DSpace 1.5.1
Hi Fabio, How many zeros are supposed to prefix the 1? My XPDF2Thumbnail.java originally had five zeros and a one and I've changed it to two zeros and a one as follows: Original line in XPDF2Thumbnail.java =File outf = new File(outPrefix+-01.ppm); New line in XPDF2Thumbnail.java =File outf = new File(outPrefix+-001.ppm); Is this correct?? Thanks, Sue From: Fabio N. Kepler [mailto:fabio.kep...@gmail.com] Sent: Friday, August 14, 2009 11:56 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Fwd: xpdf question in DSpace 1.5.1 -- Forwarded message -- From: Fabio N. Kepler fabio.kep...@gmail.commailto:fabio.kep...@gmail.com Date: Fri, Aug 14, 2009 at 12:53 Subject: Re: [Dspace-tech] xpdf question in DSpace 1.5.1 To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov Hi Susan, I don't know if you have already solved this problem, but I ran into it yesterday. What I found out was that the 'pdftoppm' binary was converting 'file.pdf' to 'file-001.ppm' instead of 'file-1.ppm'. Strangely, even with the manual ('man pdftoppm') says the output is 'file-n.ppm', where n is the page number. The solution was to change a line in XPDF2Thumbnail.java near the line reporting the error (in your case, 229). The line was File outf = new File(outPrefix+-1.ppm); and I changed it to File outf = new File(outPrefix+-001.ppm); Hope this solves your problem, too. Regards, Fabio N. Kepler On Thu, Jul 23, 2009 at 13:18, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi, I have successfully implemented xpdf pdftotext (replacing PDFBox) in DSpace 1.5.1. It works GREAT and so far has filtered 100% of our documents, even the ones PDFBox found to be unfilterable. Now I'm trying to get pdftoppm to work and I'm getting this error: Applying Media Filters The following MediaFilters are enabled: Full Filter Name: org.dspace.app.mediafilter.HTMLFilter org.dspace.app.mediafilter.HTMLFilter Full Filter Name: org.dspace.app.mediafilter.WordFilter org.dspace.app.mediafilter.WordFilter Full Filter Name: org.dspace.app.mediafilter.JPEGFilter org.dspace.app.mediafilter.JPEGFilter Full Filter Name: org.dspace.app.mediafilter.XPDF2Text org.dspace.app.mediafilter.XPDF2Text Full Filter Name: org.dspace.app.mediafilter.XPDF2Thumbnail org.dspace.app.mediafilter.XPDF2Thumbnail FILTERED: bitstream 443 and created 'CA029045.pdf.txt' ERROR filtering, skipping bitstream: Item Handle: 2121/169228 Bundle Name: ORIGINAL File Size: 2064225 Checksum: 4216969d76a86e6c9c169bbe0a3cff7d (MD5) Asset Store: 0 javax.imageio.IIOException: Can't read input file! javax.imageio.IIOException: Can't read input file! at javax.imageio.ImageIO.read(ImageIO.java:1275) at org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnail.java:229) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:668) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:570) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:520) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:488) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:379) Wrote Item: 2121/169228 to Index at Thu Jul 23 12:16:16 EDT 2009 I think it is complaining because xpdf2Thumbnail needs to know where the input file is and where to put the output file(s)?? Can anyone help with this? Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Fwd: xpdf question in DSpace 1.5.1
I displayed outPrefix and it is trying to write to /var/tmp, however I just found this in the dspace.log: 2009-08-14 16:05:28,638 ERROR org.dspace.app.mediafilter.XPDF2Thumbnail @ PDF conversion proc failed, exit status=9, file=/var/tmp/DSfilt63853.pdf From: Fabio N. Kepler [mailto:fabio.kep...@gmail.com] Sent: Friday, August 14, 2009 3:41 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Fwd: xpdf question in DSpace 1.5.1 Hi, In my system the temporary file gets created in /tmp. When I was getting this error, I took a look at the /tmp directory and saw some prevu + lots of numbers + -001.ppm files. Check your /var/tmp or /tmp directories for something similar. Or try using something like log.infohttp://log.info(XPDF2Thumbnail: outPrefix: + outPrefix); before the line File outf = new File(outPrefix+-001.ppm); and then check dspace/log/dspace/log to see where the temporary file is trying to be created. And/or change the lines File outPrefixF = File.createTempFile(prevu,out); String outPrefix = outPrefixF.toString(); so as to create a temporary file in a location of your choice. I think something like the below should work: File outPrefixF = new File(/tmp/prevu); String outPrefix = outPrefixF.toString(); I forgot to mention that I'm using DSpace 1.5.2. Hope it doesn't make any difference. Fabio On Fri, Aug 14, 2009 at 16:22, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Unfortunately, no it's not working. :( Here is the output from filter-media: The following MediaFilters are enabled: Full Filter Name: org.dspace.app.mediafilter.XPDF2Text org.dspace.app.mediafilter.XPDF2Text Full Filter Name: org.dspace.app.mediafilter.XPDF2Thumbnail org.dspace.app.mediafilter.XPDF2Thumbnail SKIPPED: bitstream 558073 because 'CA048879.pdf.txt' already exists ERROR filtering, skipping bitstream: Item Handle: 2121/322310 Bundle Name: ORIGINAL File Size: 676967526 Checksum: 6726b1fe79d8d56b398f1613108d956c (MD5) Asset Store: 2 javax.imageio.IIOException: Can't read input file! javax.imageio.IIOException: Can't read input file! at javax.imageio.ImageIO.read(ImageIO.java:1275) at org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnail.java:233) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:668) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:570) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:520) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:488) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:379) $ Am I correct that it's trying to write a temporary file to /var/tmp? In Googling this error, I saw some talk about it might be either a permissions or space problem??? Thanks for your help, Sue From: Fabio N. Kepler [mailto:fabio.kep...@gmail.commailto:fabio.kep...@gmail.com] Sent: Friday, August 14, 2009 2:40 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Fwd: xpdf question in DSpace 1.5.1 Hi Susan, Yes, you're right. There were five zeros and a one, and I changed it to two zeros and a one. Sorry for the inaccuracy. Has it worked for you? Fabio On Fri, Aug 14, 2009 at 15:35, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi Fabio, How many zeros are supposed to prefix the 1? My XPDF2Thumbnail.java originally had five zeros and a one and I've changed it to two zeros and a one as follows: Original line in XPDF2Thumbnail.java =File outf = new File(outPrefix+-01.ppm); New line in XPDF2Thumbnail.java =File outf = new File(outPrefix+-001.ppm); Is this correct?? Thanks, Sue From: Fabio N. Kepler [mailto:fabio.kep...@gmail.commailto:fabio.kep...@gmail.com] Sent: Friday, August 14, 2009 11:56 AM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Fwd: xpdf question in DSpace 1.5.1 -- Forwarded message -- From: Fabio N. Kepler fabio.kep...@gmail.commailto:fabio.kep...@gmail.com Date: Fri, Aug 14, 2009 at 12:53 Subject: Re: [Dspace-tech] xpdf question in DSpace 1.5.1 To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov Hi Susan, I don't know if you have already solved
[Dspace-tech] Import/Export vs. Registration in DSpace 1.5.1
We are in the process of moving a Collection of documents out of our main DSpace repository, and into another separate DSpace instance. Our reasons for doing this are as follows: 1. We currently have 139,000 documents in this Collection and will eventually have approximately 900,000. The 139,000 documents currently comprises 56% of our entire repository. 2. This particular Collection is being added to DSpace as part of a mass digitization effort, however it does not contain any metadata and is not nearly as useful to our researchers as the remainder of the repository. 3. The processing times for our filter-media, browse/search index build and updates, etc are significantly increased due to the large number of documents in this collection and online performance is negatively affected. 4. The document ingest process is slowly degrading in direct proportion to the number of documents in our repository. I just came across the documentation on Registration in DSpace 1.5.1 vs. the physical export/import from one database/instance to another, separate one, and I'm thinking this would be a much easier and quicker way to migrate these documents from our main repository to the new one we've created just to house this one Collection. My understanding is that basically you are exporting the metadata from one instance to another, you leave the documents in their original location in /dspace/assetstore(n), and the new Item in the new repository contains a pointer (in the bitstream table...?) to the original location of the document. Is my understanding correct? If so, given that we are leaving the original assetstore directory(s) as is, but moving the metadata to a separate database (in the same postgreSQL environment on the same server) and deploying our web application in a separate directory on the same machine, are we really going to see a significant improvement in processing time and performance in the original repository? I am thinking we will, but I would like to hear from anyone else who may have had a similar situation or has an idea of what we can expect. Also, I'm trying to figure out exactly how the filter-media, browse/search index build and updates, etc are going to work if we end up using the Registration technique? Will we end up with a single /dspace/search directory with combined indexes, or will we have two separate ones? How will our searching and browsing be impacted? Any thoughts or recommendations are welcome! Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] question about ItemImport processing in DSpace 1.5.1
Can anyone tell me if, as delivered and by default, ItemImport.java in DSpace 1.5.1 updates both the browse and search indices for each new record it adds/imports to DSpace? If so, can these real-time updates be turned off in order to speed up import processing time? We do run index-update every night so our indices would be updated prior to the next day. I am thinking that maybe this is all configurable via the dspace.cfg file, but I'm not exactly sure. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] ant fresh_install error
Sounds like maybe you have already run fresh_install or at least part of it...? It's getting an error trying to insert new rows into table(s) in the database. The good news is that, if this is what is happening, it won't hurt anything - the queries will just fail, but won't mess anything up. Try running ant update. Best, Sue -Original Message- From: Emilios Hadjiprokopi [mailto:hadjiprokopi.emil...@ucy.ac.cy] Sent: Friday, August 07, 2009 7:24 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] ant fresh_install error I am getting the following error when I am runninh ant fresh_install [java] 2009-08-07 14:30:46,031 WARN org.dspace.storage.rdbms.DatabaseManager @ Got SQL Exception: org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint checksum_results_pkey [java] org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint checksum_results_pkey I have comment out in pg_hba.conf #hostall all 127.0.0.1/32 ident sameuser I have also change TOMCAT_USER=dspace in tomcat6.conf I am login as dspace user. A hint will be helpfull as for what the error might be. Thanks -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Migrating Dspace to new physical server
Documents are stored on the server, usually in /dspace/assetstore while metadata is stored in the dspace database. You'll need to copy the assetstore directory(s) from the old server to the new as well as restoring the database. Hope I'm understanding your question and that this may help you! Best, Sue From: Lewatle Phaladi [mailto:lewatle.phal...@wits.ac.za] Sent: Friday, August 07, 2009 7:35 AM To: dspace-gene...@mit.edu; dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Migrating Dspace to new physical server Hi All We have production Dspace 1.5.0 site and new phisical server that we want to setup Dspace 1.5.2 on it, we restored data fine from production server database to our postgres database on new server and when i open web browser i can view it perfect with the customazation that are on production site (1.5.2), The only problem is any files from the assetstore we are unable to see or access them on our dspace system. does anybody encountered such a problem or have an idea on how to solve this errors. Regards Lewatle This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Strange Search results
Thanks Stuart and Kim for your answers. Given the stemming issue, is there any way, via syntax or options, etc to get results for propeller without getting results for propellant? Thanks again! Sue From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Wednesday, August 05, 2009 5:44 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY]; DSpace-tech@lists.sourceforge.net Cc: Smail, James W. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: RE: [Dspace-tech] Strange Search results Hi Sue, Lucene (the search system used by DSpace) is 'stemming' the words (http://en.wikipedia.org/wiki/Stemming). It indexes the stem of the word (in this case propel) so that it can find similar words (engine will find engines etc). Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nzhttp://www.library.auckland.ac.nz// From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, 6 August 2009 9:31 a.m. To: DSpace-tech@lists.sourceforge.net Cc: Smail, James W. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: [Dspace-tech] Strange Search results A User emailed me and told me he was getting some incorrect search results in DSpace 1.5.1. Here is the advanced search he did: Title = propeller Along with documents where the title contained the word propeller, he also got lots of documents where the title contained the word propellant. I tried it and got the same results. I also tried looking for propeller NOT propellant and then got *no* results. I thought maybe Lucene was cutting off the er and/or ant, but couldn't find this anywhere in the documentation. Does anyone know what might be going on? Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Creating E Person
You're correct. You cannot set a password for an eperson even if you are an Administrator. I don't know if this is the proper way to do it, but once you define a new eperson, you can let them know to click on Forgot password on the site and from there they can set an initial password. They will then be able to log in to DSpace. Best, Sue From: Hardik Mishra [mailto:har...@webinito.com] Sent: Thursday, August 06, 2009 2:57 AM To: General List; Tech List Subject: [Dspace-tech] Creating E Person Hi Everyone, I have installed Dspace 1.5.2 with JSPUI interface. I am admin. I want to create E-PERSON for our staff from ADMINSTER. But in create E-Person , there is no column for default password or like that. So, how can members login ? -- Best Regards Hardik Mishra Software Engineer Webinito Networks Give a man a fish, and you feed him for a day. Teach a man to catch fish and you feed him for a lifetime. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Strange Search results
A User emailed me and told me he was getting some incorrect search results in DSpace 1.5.1. Here is the advanced search he did: Title = propeller Along with documents where the title contained the word propeller, he also got lots of documents where the title contained the word propellant. I tried it and got the same results. I also tried looking for propeller NOT propellant and then got *no* results. I thought maybe Lucene was cutting off the er and/or ant, but couldn't find this anywhere in the documentation. Does anyone know what might be going on? Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] suggest an item
Hi Claudia, I'm wondering if you can switch back and forth from jspui to xmlui dynamically?? For instance, since the xmlui doesn't have the suggest feature, would it be possible to put a link on an xmlui page that links to the jspui ui suggest feature? Thanks, Sue -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.uni-dortmund.de] Sent: Friday, July 31, 2009 2:56 AM To: Damian Marinaccio Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] suggest an item Hi Damian, you are right this is not available in the xmlui. Atm not all freatures are available in both ui's. Sunny greetings Claudia Damian Marinaccio schrieb: Is the suggest an item not available in the xmlui? Searching through the source code reveals that its present in the jspui, but I have been unable to find any trace of it in the xmlui? Thanks, Damian -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] dspace hanging up at the upload stage
Whenever a strange error occurs in DSpace, I look in 3 places for error or other messages that might indicate what the problem is: 1. dspace.log 2. webserver logs (access and server) 3. postgresql log I'd say 99% of the time, you will see some kind of error in at least one, if not all of these logs that will let you know where the problem is. DSpace is really good in giving diagnostic messages. If, at first, you don't see any useful information in the dspace.log, you could try turning on debug (via the log4j.xml or log4j.properties file), then trying the upload again and see if you get any further messages that might indicate what the problem is. Good luck, Sue From: Lebohang Lengoatha [mailto:lengoath...@gmail.com] Sent: Thursday, July 30, 2009 4:13 AM To: DSpace-tech@lists.sourceforge.net Subject: [Dspace-tech] dspace hanging up at the upload stage Hi all I am having a problem with dspace when trying to upload a file. The process goes well until upload stage is reached. After browsing the file from my hard disk, I click next, it cannot go to the next page. It hangs there forever. What might be the problem?? Thanks in advance Regards, Lebohang National University of Lesotho -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Upgrading Version And Getting Error On Viewing Item
For some reason, it can't find Java program DSIndexer. You say you are trying to run org.dspace.search.DSIndexer, but for some reason, it's looking for DSIndexer in org.dspace.browse From: Onte, Michael [mailto:mo...@lrri.org] Sent: Monday, July 27, 2009 11:02 AM To: Hardik Mishra Cc: Tech List; General List Subject: Re: [Dspace-tech] Upgrading Version And Getting Error On Viewing Item I ran the commands you sent me but I encountered an error when I ran dsrun org.dspace.search.DSIndexer -b The error is below. Exception in thread main java.lang.NoClassDefFoundError: org/dspace/browse/DSIndexer I'm running Linux if that makes a difference. Michael Onte Database Administrator Lovelace Respiratory Research Institute mo...@lrri.orgmailto:mo...@lrri.org Office - (505) 348-9460 Cell - (505) 975-4504 From: Hardik Mishra [mailto:har...@webinito.com] Sent: Monday, July 27, 2009 5:38 AM To: Onte, Michael Cc: General List; Tech List Subject: Upgrading Version And Getting Error On Viewing Item Hi Micheal, Run this command form your command prompt c:/dspace/bin/dsrun org.dspace.browse.IndexBrowse -f -r c:/dspace/bin/dsrun org.dspace.browse.ItemCounter c:/dspace/bin/ dsrun org.dspace.search.DSIndexer -b --- Best Regards Hardik Mishra Jr. Software Engineer Follow Us On Twitter : webinito Webinito Networks Give a man a fish, and you feed him for a day. Teach a man to catch fish and you feed him for a lifetime. Original Error : I upgraded our Dspace from 1.4.2 to 1.5 by following the steps on the manual. Everything seems to work fine after that except when we do a search and then click on the name of the title. I then get the message Internal System Error. Below is the java stack displayed when I viewed the source of the page. If anybody can help, it would be greatly appreciated. java.lang.NullPointerException at org.dspace.app.webui.servlet.HandleServlet.displayItem(HandleServlet.java:331) at org.dspace.app.webui.servlet.HandleServlet.doDSGet(HandleServlet.java:180) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:690) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:210) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:870) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685) at java.lang.Thread.run(Thread.java:595) Michael Onte Database Administrator Lovelace Respiratory Research Institute -- -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Upgrading Version And Getting Error On ViewingItem
Let's see what error you're getting now (the entire error output would be helpful - thanks!) Sue From: Onte, Michael [mailto:mo...@lrri.org] Sent: Monday, July 27, 2009 1:37 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY]; Hardik Mishra Cc: Tech List; General List Subject: RE: [Dspace-tech] Upgrading Version And Getting Error On ViewingItem This was my fault. I ran org.dspace.browse.DSIndexer instead of org.dspace.search.DSIndexer So I ran the commands again but it didn't help at all. The error is still there. Michael Onte Database Administrator Lovelace Respiratory Research Institute mo...@lrri.orgmailto:mo...@lrri.org Office - (505) 348-9460 Cell - (505) 975-4504 From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Monday, July 27, 2009 11:21 AM To: Onte, Michael; Hardik Mishra Cc: Tech List; General List Subject: RE: [Dspace-tech] Upgrading Version And Getting Error On ViewingItem For some reason, it can't find Java program DSIndexer. You say you are trying to run org.dspace.search.DSIndexer, but for some reason, it's looking for DSIndexer in org.dspace.browse From: Onte, Michael [mailto:mo...@lrri.org] Sent: Monday, July 27, 2009 11:02 AM To: Hardik Mishra Cc: Tech List; General List Subject: Re: [Dspace-tech] Upgrading Version And Getting Error On Viewing Item I ran the commands you sent me but I encountered an error when I ran dsrun org.dspace.search.DSIndexer -b The error is below. Exception in thread main java.lang.NoClassDefFoundError: org/dspace/browse/DSIndexer I'm running Linux if that makes a difference. Michael Onte Database Administrator Lovelace Respiratory Research Institute mo...@lrri.orgmailto:mo...@lrri.org Office - (505) 348-9460 Cell - (505) 975-4504 From: Hardik Mishra [mailto:har...@webinito.com] Sent: Monday, July 27, 2009 5:38 AM To: Onte, Michael Cc: General List; Tech List Subject: Upgrading Version And Getting Error On Viewing Item Hi Micheal, Run this command form your command prompt c:/dspace/bin/dsrun org.dspace.browse.IndexBrowse -f -r c:/dspace/bin/dsrun org.dspace.browse.ItemCounter c:/dspace/bin/ dsrun org.dspace.search.DSIndexer -b --- Best Regards Hardik Mishra Jr. Software Engineer Follow Us On Twitter : webinito Webinito Networks Give a man a fish, and you feed him for a day. Teach a man to catch fish and you feed him for a lifetime. Original Error : I upgraded our Dspace from 1.4.2 to 1.5 by following the steps on the manual. Everything seems to work fine after that except when we do a search and then click on the name of the title. I then get the message Internal System Error. Below is the java stack displayed when I viewed the source of the page. If anybody can help, it would be greatly appreciated. java.lang.NullPointerException at org.dspace.app.webui.servlet.HandleServlet.displayItem(HandleServlet.java:331) at org.dspace.app.webui.servlet.HandleServlet.doDSGet(HandleServlet.java:180) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:690) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:210) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:870) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685) at java.lang.Thread.run(Thread.java:595) Michael Onte Database Administrator Lovelace Respiratory Research Institute -- -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists
[Dspace-tech] xpdf question in DSpace 1.5.1
Hi, I have successfully implemented xpdf pdftotext (replacing PDFBox) in DSpace 1.5.1. It works GREAT and so far has filtered 100% of our documents, even the ones PDFBox found to be unfilterable. Now I'm trying to get pdftoppm to work and I'm getting this error: Applying Media Filters The following MediaFilters are enabled: Full Filter Name: org.dspace.app.mediafilter.HTMLFilter org.dspace.app.mediafilter.HTMLFilter Full Filter Name: org.dspace.app.mediafilter.WordFilter org.dspace.app.mediafilter.WordFilter Full Filter Name: org.dspace.app.mediafilter.JPEGFilter org.dspace.app.mediafilter.JPEGFilter Full Filter Name: org.dspace.app.mediafilter.XPDF2Text org.dspace.app.mediafilter.XPDF2Text Full Filter Name: org.dspace.app.mediafilter.XPDF2Thumbnail org.dspace.app.mediafilter.XPDF2Thumbnail FILTERED: bitstream 443 and created 'CA029045.pdf.txt' ERROR filtering, skipping bitstream: Item Handle: 2121/169228 Bundle Name: ORIGINAL File Size: 2064225 Checksum: 4216969d76a86e6c9c169bbe0a3cff7d (MD5) Asset Store: 0 javax.imageio.IIOException: Can't read input file! javax.imageio.IIOException: Can't read input file! at javax.imageio.ImageIO.read(ImageIO.java:1275) at org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnail.java:229) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:668) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:570) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:520) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:488) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:379) Wrote Item: 2121/169228 to Index at Thu Jul 23 12:16:16 EDT 2009 I think it is complaining because xpdf2Thumbnail needs to know where the input file is and where to put the output file(s)?? Can anyone help with this? Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Search errors after deleting records in DSpace 1.5.1
I'm thinking maybe that, due to the fact that there were duplicates of a metadata field that we added a new index on, when one of the records was deleted, the program that updates the search index after a delete, updated or deleted the wrong pointer??? For example: We added a new index on a field called identifier.accessionNumber. For some reason, we had two Items in our repository with the same accession number - this isn't supposed to happen (accession numbers are supposed to be unique). When one of the records was deleted yesterday, when it went to update the search index, there were two pointers for that accession number in the search index, and the wrong one either got updated or deleted. Developers?? Anyone?? Does this sound plausible?? Thanks, Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, July 16, 2009 2:44 PM To: DSpace Tech Subject: [Dspace-tech] Search errors after deleting records in DSpace 1.5.1 Has anyone seen this error occur in DSpace 1.5.1? We deleted some duplicate records yesterday and now, if a search is done on the handle of the record that was deleted (or on the document name, or on any other metadata that was indexed by index-init and added to the search index), the following errors occur: Search term entered in Simple Search box on home page: -- Entered handle of a deleted record -- Errors in dspace.log: 2009-07-16 13:12:14,674 INFO org.dspace.search.DSQuery @ Final query string: 2121/138230 2009-07-16 13:12:14,680 WARN org.dspace.app.webui.servlet.DSpaceServlet @ anonymous:session_id=5B8E91A7ED52FF2C4344D055F89CDF0B:ip_addr=198.119.152.109:database_error:java.sql.SQLException: Query 2121/138230 returned unresolvable item java.sql.SQLException: Query 2121/138230 returned unresolvable item at org.dspace.app.webui.servlet.SimpleSearchServlet.doDSGet(SimpleSearchServlet.java:297) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:796) at javax.servlet.http.HttpServlet.service(HttpServlet.java:917) at org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:398) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:277) at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:255) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:188) at org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:586) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:556) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:187) at org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:586) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:556) at com.sun.webserver.connector.nsapi.NSAPIProcessor.service(NSAPIProcessor.java:160) 2009-07-16 13:12:14,698 WARN org.dspace.app.webui.servlet.InternalErrorServlet @ :session_id=5B8E91A7ED52FF2C4344D055F89CDF0B:internal_error:-- URL Was: http://ldr.larc.nasa.gov/dspace/webapps/jspui/simple-search?query=2121%2F138230submit=Go -- Method: GET -- Parameters were: -- submit: Go -- query: 2121/138230 java.lang.NullPointerException at org.apache.jsp.error.internal_jsp._jspService(Unknown Source) at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:80) at javax.servlet.http.HttpServlet.service(HttpServlet.java:917) at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:373) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:464) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:358) at javax.servlet.http.HttpServlet.service(HttpServlet.java:917) at org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:398) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:792) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:472) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:353) at org.dspace.app.webui.util.JSPManager.showJSP(JSPManager.java:91) at org.dspace.app.webui.util.JSPManager.showInternalError(JSPManager.java:106
Re: [Dspace-tech] Multiple Dspace instances on same DB
Hi Van, I understand what you're saying, but can you actually have both webservers running simultaneously on one IP address??? Oh, and we don't expect the 2nd instance to have much traffic at all. Thanks, Sue From: Van Ly [mailto:v...@library.usyd.edu.au] Sent: Wednesday, July 08, 2009 1:50 AM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY]; DSpace Tech Subject: RE: [Dspace-tech] Multiple Dspace instances on same DB Hi Sue, I can confirm it is possible to operate two instances of DSpace with a single set of database engine (postgres) plus app server (tomcat) on a host with one ip-address. Whether or not you need another ip-address could depend on the expected network traffic to those 800,000 documents. I'm looking at upgrading DSpace 1.4.2 to 1.5.2 and have a test configuration as follows: # dspace.dir is /common/dspace-data /common/dspace152-data # webapps has /var/lib/tomcat5/webapps/dspace142 /var/lib/tomcat5/webapps/dspace142-oai /var/lib/tomcat5/webapps/dspace152 /var/lib/tomcat5/webapps/dspace152-oai # URL access is http://localhost:8080/dspace142 http://localhost:8080/dspace152 Hope that helps. -- Van Ly -Original Message- From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Wed 2009-07-08 06:15 To: DSpace Tech Subject: [Dspace-tech] Multiple Dspace instances on same DB Hi, We need to create a separate instance of DSpace for several reasons, including the fact that this collection is so large (approximately 800,000 documents), and the fact that there is no metadata associated with these documents. I found the following article in the archives today and it sounds like a great way for us to accomplish this, however I just have one question: I'm pretty sure we will need another ip address for this new instance, correct? We are using Sun Webserver7 with virtual servers. http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg02387.html Thanks in advance, Sue Walker-Thornton Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Multiple Dspace instances on same DB
I found this old discussion (from fall of 2007) and followed the instructions, however I believe these instructions were geared toward DSpace 1.4.2. Given that the compile and assemble steps are very different in DSpace 1.5.1, I'm wondering if someone could modify these instructions for DSpace 1.5.1. Thanks, Sue Mon, 24 Sep 2007 04:54:59 -0700 Hi Mika, if you want to set up mulitple instances on one machine using the same source directory and dspace user you got to: - In this example all elements of the new installation are named dspace2 - It assumes that the dspace user is called dspace - [dspace-source] is the directory where you got your dspace source - [tomcat] is the installation directory of tomcat 1. create a new database createdb -U dspace dspace2 2. create a new installation directory mkdir /dspace2 chown dspace /dspace2 2. copy the dspace.cfg cd [dspace-source]/config cp dspace.cfg dspace2.cfg 3. edit dspace2.cfg set dspace.dir = /dspace2 dspace.url = http://[YourURL]:8080/dspace2http://%5BYourURL%5D:8080/dspace2 db.url = jdbc:postgresql://localhost:5432/dspace2 4. do the fresh installation cd [dspace-source] ant clean ant -Dconfig=config/dspace2.cfg fresh_install 5. deploy cp build/dspace.war [tomcat]/webapps/dspace2.war 6. restart tomcat 7. create the Administrator /dspace2/bin/create-administrator hope that helps Claudia Jürgen From: Van Ly [mailto:v...@library.usyd.edu.au] Sent: Wednesday, July 08, 2009 1:50 AM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY]; DSpace Tech Subject: RE: [Dspace-tech] Multiple Dspace instances on same DB Hi Sue, I can confirm it is possible to operate two instances of DSpace with a single set of database engine (postgres) plus app server (tomcat) on a host with one ip-address. Whether or not you need another ip-address could depend on the expected network traffic to those 800,000 documents. I'm looking at upgrading DSpace 1.4.2 to 1.5.2 and have a test configuration as follows: # dspace.dir is /common/dspace-data /common/dspace152-data # webapps has /var/lib/tomcat5/webapps/dspace142 /var/lib/tomcat5/webapps/dspace142-oai /var/lib/tomcat5/webapps/dspace152 /var/lib/tomcat5/webapps/dspace152-oai # URL access is http://localhost:8080/dspace142 http://localhost:8080/dspace152 Hope that helps. -- Van Ly -Original Message- From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] [mailto:susan.m.thorn...@nasa.gov] Sent: Wed 2009-07-08 06:15 To: DSpace Tech Subject: [Dspace-tech] Multiple Dspace instances on same DB Hi, We need to create a separate instance of DSpace for several reasons, including the fact that this collection is so large (approximately 800,000 documents), and the fact that there is no metadata associated with these documents. I found the following article in the archives today and it sounds like a great way for us to accomplish this, however I just have one question: I'm pretty sure we will need another ip address for this new instance, correct? We are using Sun Webserver7 with virtual servers. http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg02387.html Thanks in advance, Sue Walker-Thornton Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/Challenge___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] metadatafieldregistry_pkey duplicate key error
You just need to reset sequence metadatafieldregistry_seq to max(metadata_field_id) + 1 and then retry it. I ran into this problem when we migrated from Test to Prod since we had added new registry fields in Test. Best, Sue susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov NASA Langley Research Center NCI Information Systems, Inc. Information Management Branch (757) 224-4074 From: Van Ly [mailto:v...@library.usyd.edu.au] Sent: Sunday, May 17, 2009 11:05 PM To: DSpace-tech@lists.sourceforge.net Subject: [Dspace-tech] metadatafieldregistry_pkey duplicate key error Hello everyone, Has anyone worked around or fixed this kind of `PSQLException: ERROR: duplicate key' internal error. #2 occurs When trying to add dublin core and qualifier labels (on 1.4.2 DSpace + Postgresql 8.1.11) similar to: description.exhibit description.exhibitHost description.exhibitCity description.exhibitCountry description.exhibitCategory description.exhibitImpact Kind regards, -- Van Ly -- #2 - specifically in the case of already having ## description.exhibitHost ## description.exhibition ## adding description.exhibit fails 2009-05-18 12:52:45,935 WARN org.dspace.app.webui.servlet.DSpaceServlet @ name\ @place:session_id=F32DD4066DD475B8841A2A2204961B9A:ip_addr=1.2\ .3.4:database_error:org.postgresql.util.PSQLException: ERROR: duplicate key \ violates unique constraint metadatafieldregistry_pkey org.postgresql.util.PSQLException: ERROR: duplicate key violates unique constra\ int metadatafieldregistry_pkey at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryE\ xecutorImpl.java:1525) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecuto\ rImpl.java:1309) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.j\ ava:188) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Sta\ tement.java:452) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(Abstrac\ tJdbc2Statement.java:354) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJd\ bc2Statement.java:308) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(De\ legatingPreparedStatement.java:101) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(De\ legatingPreparedStatement.java:101) at org.dspace.storage.rdbms.DatabaseManager.execute(DatabaseManager.jav\ a:1492) at org.dspace.storage.rdbms.DatabaseManager.insert(DatabaseManager.java\ :815) at org.dspace.content.MetadataField.create(MetadataField.java:281) at org.dspace.app.webui.servlet.admin.MetadataFieldRegistryServlet.doDS\ Post(MetadataFieldRegistryServlet.java:166) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServ\ let.java:147) at org.dspace.app.webui.servlet.DSpaceServlet.doPost(DSpaceServlet.java\ :105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(App\ licationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(Application\ FilterChain.java:188) at org.dspace.app.webui.filter.AdminOnlyFilter.doFilter(AdminOnlyFilter\ .java:103) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(App\ licationFilterChain.java:215) at org.apache.catalina.core.ApplicationFilterChain.doFilter(Application\ FilterChain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapper\ Valve.java:213) at org.apache.catalina.core.StandardContextValve.invoke(StandardContext\ Valve.java:174) at org.dspace.storage.rdbms.DatabaseManager.execute(DatabaseManager.jav\ a:1492) at org.dspace.storage.rdbms.DatabaseManager.insert(DatabaseManager.java\ :815) at org.dspace.content.MetadataField.create(MetadataField.java:281) at org.dspace.app.webui.servlet.admin.MetadataFieldRegistryServlet.doDS\ Post(MetadataFieldRegistryServlet.java:166) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServ\ let.java:147) at org.dspace.app.webui.servlet.DSpaceServlet.doPost(DSpaceServlet.java\ :105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(App\ licationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(Application\ FilterChain.java:188) at org.dspace.app.webui.filter.AdminOnlyFilter.doFilter(AdminOnlyFilter\ .java:103) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(App\ licationFilterChain.java:215) at
[Dspace-tech] New Advanced Search index question - DSpace 1.5.1
Hi, Can anyone tell me if it is necessary to run index-init again if I'm just adding a new index to the Advanced search, or is there an option where I can just build the new index without having to rebuild *all* of the indexes? We have just implemented DSpace 1.5.1 in Production and our index-init has been running since Friday afternoon @ 3:00 p.m. and has only indexed a bit over half of our documents (we have approximately 243,000 records in our repository and still have lots to import). I'd hate to have to rerun the whole thing again. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] New Advanced Search index question - DSpace 1.5.1
Hi Andrea, I was afraid that was going to be the answer. Wow...we are looking at probably 6-7 days to run a complete browse and search index build for a 243,000 record repository. Thanks a lot, Sue From: Andrea Bollini [mailto:boll...@cilea.it] Sent: Monday, May 18, 2009 2:31 PM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: DSpace-tech@lists.sourceforge.net; Smail, James W. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: Re: [Dspace-tech] New Advanced Search index question - DSpace 1.5.1 Hi, at the moment the answer is yes, you need to re-index all your contents, as far as I know there is no possibility to update a lucene doc http://wiki.apache.org/lucene-java/LuceneFAQ#head-917dd4fc904aa20a34ebd23eb321125bdca1dea2 the only tips that I can suggest is to run only the piece of the index-init script related to lucene ./dsrun org.dspace.search.DSIndexer -b these because you don't need to rebuild the browse system tables Hope this help, Andrea Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] ha scritto: Hi, Can anyone tell me if it is necessary to run index-init again if I'm just adding a new index to the Advanced search, or is there an option where I can just build the new index without having to rebuild *all* of the indexes? We have just implemented DSpace 1.5.1 in Production and our index-init has been running since Friday afternoon @ 3:00 p.m. and has only indexed a bit over half of our documents (we have approximately 243,000 records in our repository and still have lots to import). I'd hate to have to rerun the whole thing again. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Dott. Andrea Bollini Project Manager, IT Architect Systems Integrator Sezione Servizi per le Biblioteche e l'Editoria Elettronica CILEA, http://www.cilea.it tel. +39 06-59292853 cel. +39 348-8277525 --- Disclaimer: the content of this email is confidential and may be privileged, and it must not be disclosed or copied without the sender's consent. If you have received this message in error, please notify the sender and remove it from your system. The content of this email does not constitute legal advice, nor any responsibility is accepted for loss or damage incurred as a result of acting upon its contents or attachments. The statements and opinions expressed in this email are those of the author and do not necessarily reflect those of the employer. -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Error in HandleServlet.java in DSpace 1.5.1
I am getting an error in DSpace 1.5.1 when I try to display an Item. The error I'm getting is: java.lang.NullPointerException and it's happening in HandleServlet.java on the following line: List l = xHTMLHeadCrosswalk.disseminateList(item); I also noticed a couple of new errors in my dspace.log that say: 2009-05-15 19:24:17,125 ERROR org.dspace.core.PluginManager @ Self-named plugin class org.dspace.content.crosswalk.XSLTDisseminationCrosswalk returned null or empty name list! 2009-05-15 19:24:17,125 WARN org.dspace.core.PluginManager @ Cannot find named plugin for interface=org.dspace.content.crosswalk.DisseminationCrosswalk, name=XHTML_HEAD_ITEM Can anyone help? I'm in the middle of migrating DSpace 1.5.1 to Production. :( Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Error in HandleServlet.java in DSpace 1.5.1
I solved the problem, thankfully. I think the ### Crosswalk and Packager Plugin Settings In dspace.cfg had become corrupted. Anyway, when I copied this section from the source code again, the problem disappeared. Strange :) Sue From: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Sent: Friday, May 15, 2009 7:25 PM To: DSpace Tech Cc: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Subject: Error in HandleServlet.java in DSpace 1.5.1 I am getting an error in DSpace 1.5.1 when I try to display an Item. The error I'm getting is: java.lang.NullPointerException and it's happening in HandleServlet.java on the following line: List l = xHTMLHeadCrosswalk.disseminateList(item); I also noticed a couple of new errors in my dspace.log that say: 2009-05-15 19:24:17,125 ERROR org.dspace.core.PluginManager @ Self-named plugin class org.dspace.content.crosswalk.XSLTDisseminationCrosswalk returned null or empty name list! 2009-05-15 19:24:17,125 WARN org.dspace.core.PluginManager @ Cannot find named plugin for interface=org.dspace.content.crosswalk.DisseminationCrosswalk, name=XHTML_HEAD_ITEM Can anyone help? I'm in the middle of migrating DSpace 1.5.1 to Production. :( Thanks, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about /dspace directory when upgrading from 1.4.2 to 1.5.1
I'm thinking maybe I'll just save our current 1.4.2 /dspace directory somewhere I'll have access to it if I need to, and then completely wipe all subdirectories out of /dspace and let them get built new from the 1.5.1 maven and ant steps. I'm thinking that should work fine since, if I was doing a first-time installation, we wouldn't have an existing /dspace directory anyway and it would get built from the /dspace-source files too...oh, and yes I think I'll move assetstore to a different location rather than under /dspace so that won't be an issue either. Does my plan sound prudent to you? Thanks Mark! Sue p.s. If you can think of any other 1.4.2--1.5.1 Test--Production migration tips that might help me out, I'd appreciate that as well!!! :) From: Mark Diggory [mailto:mdigg...@gmail.com] Sent: Friday, May 08, 2009 9:28 AM To: Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] Cc: DSpace Tech; Kimbrough, Glenn W. (LARC-B7)[NCI] Subject: Re: [Dspace-tech] Question about /dspace directory when upgrading from 1.4.2 to 1.5.1 Susan, I try to answer inline... On Thu, May 7, 2009 at 3:35 PM, Thornton, Susan M. (LARC-B702)[RAYTHEON TECHNICAL SERVICES COMPANY] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: What is the best way to get your /dspace directory correctly upgraded in Production? It seems to me that I've been unclear on this in previous releases and have had problems as a result. My confusion arises from the following factors: 1. The directory/file structure in DSpace 1.5.1 under /dspace is different: a. /jsp directory resides under /dspace in 1.4.2; no /jsp directory in 1.5.1 the jsp directory that goes into /dspace was never used outside the source tree in 1.4.2 so you should feel comfortable removing it. b. The /bin directory never got overlaid when you recompiled the application in 1.4.2; in 1.5.1, the /bin directory gets rebuilt from /dspace-source/dspace/bin every time you reassemble/recompile the application not only the bin, but files do get added to the config, and the lib, webapp and etc directories are backed up each build so that they can be recovered if necessary. c. /assetstore resides under /dspace in 1.4.2 and 1.5.1, however I do NOT want to copy over my test (1.5.1) /assetstore over my prod (1.4.2) assetstore b/c I only have a subset of data in Test An option, change the dspace.cfg assetstore location outside the /dspace directory and maintain it separately. 2. When I first started our 1.5.1 implementation in Test, I copied everything under /dspace/bin in 1.4.2 to /dspace-source/dspace/bin; however we have added new files and modified some old files in /dspace/bin in 1.4.2 since then - very confusing as to which /dspace/bin files are the correct ones You should take all your changes in the /dspace/bin and try to maintain them in your [dspace-source]/dspace/bin rather than maintaining them directly in the installation. Next time you need to upgrade, you'll have them in the [dspace-source]. If you maintain your [dspace-source] in a version control system, then you can keep track of those changes as if they are source just like all your other changes. The documentation for upgrading from 1.4.2 to 1.5.1 does not specifically address this issue. I caution the documentation needs updating to address such issues and that we need volunteers to work on this documentation from the community. Mark -- Mark R. Diggory @mire NV USA http://www.atmire.com -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about /dspace directory when upgrading from 1.4.2 to 1.5.1
I have DSpace 1.5.1 successfully implemented on our Test machine and I am preparing to move it to Production, where we already have 1.4.2 implemented. My question is: What is the best way to get your /dspace directory correctly upgraded in Production? It seems to me that I've been unclear on this in previous releases and have had problems as a result. My confusion arises from the following factors: 1. The directory/file structure in DSpace 1.5.1 under /dspace is different: a. /jsp directory resides under /dspace in 1.4.2; no /jsp directory in 1.5.1 b. The /bin directory never got overlaid when you recompiled the application in 1.4.2; in 1.5.1, the /bin directory gets rebuilt from /dspace-source/dspace/bin every time you reassemble/recompile the application c. /assetstore resides under /dspace in 1.4.2 and 1.5.1, however I do NOT want to copy over my test (1.5.1) /assetstore over my prod (1.4.2) assetstore b/c I only have a subset of data in Test 2. When I first started our 1.5.1 implementation in Test, I copied everything under /dspace/bin in 1.4.2 to /dspace-source/dspace/bin; however we have added new files and modified some old files in /dspace/bin in 1.4.2 since then - very confusing as to which /dspace/bin files are the correct ones The documentation for upgrading from 1.4.2 to 1.5.1 does not specifically address this issue. I would appreciate any comments and/or recommendations from anyone, especially those who have upgraded from 1.4.2 to 1.5.1 and may have faced some of these exact issues. Thanks in advance, Best regards, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Java Heap dumps during Filter-Media
We've also experienced the Java heap errors in filter-media. What I did was create a postgreSQL table that holds the bitstream_id of each document that will not filter. I modified MediaFilterManager.java to write a row to this table whenever it encounters an unfilterable document (via Java heap or other error(s)) and to query this table for the bitstream_id it's getting ready to try and filter *BEFORE* it attempts to filter it. If the bitstream_id *is* found in this table, the document is skipped. Essentially we're accomplishing the same thing as Tim, only we are also collecting date, time, # of times a document has been skipped, and we're also able to report this list of unfilterable documents to our users. Then they can open the problematic .pdf file and save it as a .txt file, and we import -update them back into DSpace. Sue -Original Message- From: Tim Donohue [mailto:tdono...@illinois.edu] Sent: Wednesday, April 08, 2009 10:37 AM To: Jeffrey Trimble Cc: DSpace Tech Subject: Re: [Dspace-tech] Java Heap dumps during Filter-Media Jeffrey, I've seen this same issue all to many times to count. From what I've noticed it seems that the PDFBox software (which DSpace uses) occasionally has difficulties with larger PDFs (usually 7MB or larger) which included OCRed, scanned images. I've never encountered this problem with PDFs created directly from digital files (like Word, etc.)... From what I've seen, occasionally recreating the PDF will resolve the problem...but, more often than not even that doesn't help. The problem seems to be more of an issue with how PDFBox loads the content into memory. Locally, I've only come up with two possible solutions: (1) Increase the memory available to the 'filter-media' script (by bumping up the -Xmx value in the '[dspace]/bin/dsrun' script). This works for some PDFs, but others will continue to have problems (as PDFBox seems to use up enormous amounts of memory for some PDFs). (2) Force those problematic PDFs to be skipped over by the 'filter-media' script (by using the -s flag): To make this easier on myself, I've started maintaining a filter-skiplist file which lists all the handles of the problematic PDFs (so far we've encountered 35 of them), with a separate handle on each line. Then, I pass this filter-skiplist file to the cronjob which runs 'filter-media' like so: 0 2 * * * filter-media -s `less filter-skiplist | tr '\n' ','` The above script translates all the newlines (\n) to commas (,) in the 'filter-skiplist' file and passes the result to the 'filter-media' -s (skip) flag. So, in the end, filter-media receives a comma-separated list of handles of PDFs which it should no longer process. (Obviously this means any PDFs belonging to items in your 'filter-skiplist' can not be full text searched in DSpace) I'm hoping that in the longer term PDFBox will resolve its memory issues as it comes out of the incubation stage under Apache. If anyone else has potential solutions, I'd love to hear them, as I'm in a similar situation as Jeffrey. - Tim Jeffrey Trimble wrote: I've run into a funky situation. After using the distributed PDFBOXand the associated jars (bouncy castle) the filter media works really, really well, until-- We have one pdf that has caused the filter-media to produce a memory dump/ java heap dump. The errors are reports first the IBM flavor of JVM. We removed the offending PDF from the database, the filter-media went on it's way merrily. Has anyone seen anything like this? I have a copy of the heap dump and trace. I can reproduce it one demand by placing this PDF back into the IR. If you have seen this, and was able to resolve it, please let me know. The only thing I can think of doing is to rescan the PDF file from the original and seeing if there is something that resovles itself with the new scan. Thanks in advance, Jeffrey Trimble System LIbrarian William F. Maag Library Youngstown State University 330.941.2483 (Office) jtrim...@cc.ysu.edu mailto:jtrim...@cc.ysu.edu http://www.maag.ysu.edu http://digital.maag.ysu.edu -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Tim Donohue Research Programmer, IDEALS http://www.ideals.uiuc.edu/ University of Illinois tdono...@illinois.edu | (217) 333-4648
Re: [Dspace-tech] error running filter-media script
If there are more than one document for this handle, then you can identify which one it is by looking at column size_bytes (file size below) in the bitstream table. Below is a sql query I use to list information from the bitstream, bundle, item, and handle tables, when I know one piece of information, say - the handle - and don't know the rest (you can modify the query as needed). It's useful in the situation below, in listing the data in the bitstream table when you only know the handle. Hope this helps. Sue select bi.* from bitstream bi , bundle2bitstream b2b , bundle bu , item2bundle i2b , item it , handle ha where ha.resource_id = it.item_id and it.item_id = i2b.item_id and i2b.bundle_id = bu.bundle_id and bu.bundle_id = b2b.bundle_id and b2b.bitstream_id = bi.bitstream_id and ha.handle = '2121/169402' -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Friday, March 06, 2009 9:03 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] error running filter-media script On Thu, Mar 05, 2009 at 03:58:52PM -0600, Jewel wrote: I am running Dspace version 1.5.1 on a Windows 2003 box. We have loaded very little into our collection. I can't make out what the error means. Below is the error I receive after running: dsrun org.dspace.app.mediafilter.MediaFilterManager / E:\dspace\bindsrun org.dspace.app.mediafilter.MediaFilterManager Using DSpace installation in: E:\dspace ERROR filtering, skipping bitstream: Item Handle: 10425/53 Bundle Name: ORIGINAL File Size: 11301578 Checksum: 4a6333832dc9b7ee8704b2c0ec735bbe (MD5) Asset Store: 0 java.io.IOException: Invalid header signature; read 3759996809423114277, expected -2226271756974174256 java.io.IOException: Invalid header signature; read 3759996809423114277, expected -2226271756974174256 at org.apache.poi.poifs.storage.HeaderBlockReader.init(HeaderBlockReader. java:88) It sure would be nice if the message indicated which bitstream had the problem, no? It appears that one of the bitstreams attached to item 53 is either a corrupt MS Office document, or is not an MS Office document at all but DSpace believes it is one. (POI is the library that DSpace uses to extract text from MS Word documents.) If there is only one Office document attached to item 53, that is the culprit. If there are more than one, examine each until you find the problematic one. If there are no bitstreams that should be treated as Office documents, check the associated format of each bitstream to see if it matches the content type you would expect. -- Mark H. Wood, Lead System Programmer mw...@iupui.edu Friends don't let friends publish revisable-form documents. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Embargo
Hi Sean, If you need a field in the database to control embargo, get your DBA to add one. We have added several custom fields to our database and it works fine. You just have to keep track of them and make the same changes in future releases. Sue -Original Message- From: Sean Carte [mailto:sean.ca...@gmail.com] Sent: Thursday, March 05, 2009 5:31 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Embargo Sorry to resurrect this sad thread, but I'm still stuck and getting nowhere fast. Are there plans to include an embargo facility in a future version of DSpace? Alternatively, has anybody implemented embargoes with an external script that checks a field in the database. In desperation, I've been considering doing something along those lines, but I can't find a suitable field in the database that could be used to restrict access to a bitstream. Sean -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] log levels in DSpace 1.5.1
We are in the testing phase of a DSpace upgrade from version 1.4.2 to 1.5.1. I happened to notice today that there seems to be a lot more INFO-level lines in 1.5.1's dspace.log files, than in 1.4.2. For example, there are a lot of displays when an online browse is executed, as follows: 2009-03-04 15:06:30,182 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=3181d231122020fb74f624dff43b:ip_addr=146.165.42.166 :browse:type=dateissued,order=ASC,value=null,month=null,year=null,starts _with=null,vfocus=null,focus=-1,rpp=20,sort_by=2,community=n/a,collectio n=2121/4,level=0,etal=-1 2009-03-04 15:06:30,183 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=3181d231122020fb74f624dff43b:ip_addr=146.165.42.166 :browse_by_item: 2009-03-04 15:06:30,273 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=3181d231122020fb74f624dff43b:ip_addr=146.165.42.166 :browse:type=dateissued,order=ASC,value=null,month=null,year=null,starts _with=null,vfocus=null,focus=-1,rpp=20,sort_by=2,community=n/a,collectio n=2121/4,level=0,etal=-1 2009-03-04 15:06:30,273 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=3181d231122020fb74f624dff43b:ip_addr=146.165.42.166 :browse_by_item: 2009-03-04 15:06:30,355 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=3181d231122020fb74f624dff43b:ip_addr=146.165.42.166 :browse:type=dateissued,order=ASC,value=null,month=null,year=null,starts _with=null,vfocus=null,focus=-1,rpp=20,sort_by=2,community=n/a,collectio n=2121/4,level=0,etal=-1 2009-03-04 15:06:30,356 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=3181d231122020fb74f624dff43b:ip_addr=146.165.42.166 :browse_by_item: 2009-03-04 15:06:30,435 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=3182b1ecfefe90f55876a671b86a:ip_addr=146.165.42.166 :browse:type=dateissued,order=ASC,value=null,month=null,year=null,starts _with=null,vfocus=null,focus=-1,rpp=20,sort_by=2,community=n/a,collectio n=2121/4,level=0,etal=-1 2009-03-04 15:06:30,435 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=3182b1ecfefe90f55876a671b86a:ip_addr=146.165.42.166 :browse_by_item: 2009-03-04 15:06:30,534 INFO org.dspace.app.webui.servlet.AbstractBrowserServlet @ anonymous:session_id=3182b1ecfefe90f55876a671b86a:ip_addr=146.165.42.166 :browse:type=dateissued,order=ASC,value=null,month=null,year=null,starts _with=null,vfocus=null,focus=-1,rpp=20,sort_by=2,community=n/a,collectio n=2121/4,level=0,etal=-1 2009-03-04 15:06:30,534 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=3182b1ecfefe90f55876a671b86a:ip_addr=146.165.42.166 :browse_by_item: 2009-03-04 17:41:50,727 INFO org.dspace.app.webui.servlet.CommunityListServlet @ anonymous:session_id=3a662851092e88fedee77d129e4f:ip_addr=198.119.152.10 9:view_community_list: 2009-03-04 17:41:55,426 INFO org.dspace.app.webui.servlet.DSpaceServlet @ anonymous:session_id=3a662851092e88fedee77d129e4f:ip_addr=198.119.152.10 9:view_collection:collection_id=1 2009-03-04 17:41:55,426 INFO org.dspace.browse.BrowseEngine @ anonymous:session_id=3a662851092e88fedee77d129e4f:ip_addr=198.119.152.10 9:browse_mini: Etc etc Are these multiple INFO lines really necessary in a normal, everyday operation? It's very nice to be able to check the logs whenever a problem has occurred, however I routinely browse them as part of my daily routine site monitoring and I don't think I need to see all this. Normally if a problem occurs, it can be recreated also, after changing the log level to show more detail (DEBUG, etc). What is the best way to decrease the amount of information I'm currently seeing in the 1.5.1 logs? Is there such a thing as log4j.rootCategory=WARN (or WARNING) in log4j.properties?? I did a Google search on this and nothing came up. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center //Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.gov mailto:susan.m.thorn...@nasa.gov -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Deleting a community
Besides the online user interface, is there a way to delete either a Collection or Community without having to first delete all the Items contained within? I tried this the other day in 1.4.2 and the only way I could find to do it was to use the import script (ItemImport.java) with the delete (-d) option and I had to create a mapfile that contained the handle of every Item in the Collection to get it to work. Is there a better way in 1.4.2? What about 1.5.1? Thanks, Sue -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.uni-dortmund.de] Sent: Friday, February 27, 2009 2:28 AM To: Diggory Mark Cc: dspace-tech@lists.sourceforge.net; Karen_Savage Subject: Re: [Dspace-tech] Deleting a community Hi all, yes as far as I remember this is true in 1.3.2. In 1.5.1 the item will be deleted and unmapped. Claudia Jürgen Diggory Mark schrieb: Yes, but I think that if any item is mapped to another collection, it may not be deleted. Others can correct me on this if I'm wrong. Mark On Feb 26, 2009, at 7:20 AM, Karen_Savage wrote: I'm sorry if this is a noob question, but if I delete a community or a collection, does it automatically delete all the items as well? Running Dspace 1.3.2 -- Karen S -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech ~ Mark R. Diggory http://purl.org/net/mdiggory/homepage -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] How long do you need to keep all the dspace.log.*s around?
We are getting quite an accumulation of dspace/log/dspace.log.* files and I'm wondering if, once the dspace-log-general. file for those logs is created, is there any need to keep the old .log files around? We use WebTrends for usage statistics, by the way. We currently have DSpace 1.4.2, and are in the process of upgrading to 1.5.1, so my question applies to both versions. Thanks in advance, Sue Sue Walker-Thornton ConITS Contract NASA Langley Research Center //Integrated Library Systems Application Database Administrator 130 Research Drive Hampton, VA 23666 Office: (757) 224-4074 Fax:(757) 224-4001 Pager: (757) 988-2547 Email: susan.m.thorn...@nasa.gov mailto:susan.m.thorn...@nasa.gov -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Installation Question
Hi Jeff, You can just do a database query (use command line or a tool such as pgAdminIII (this is what I like to use)) to either modify or remove the metadata entries for element=identifier, qualifier=uri. Very simple! We've also done this. Good luck! Sue From: West, Jeff [mailto:jw...@mail.barry.edu] Sent: Thursday, February 19, 2009 5:36 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Installation Question I just installed DSpace 1.5 on a Fedora 10 Server. Everything is working fine, but I need to remove the handle server link. The server is not publicly accessible, so the information is incorrect. Is there a way to mask the handle URI, or change hdl.handle.net to my server name? image001.jpg-- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech