[Dspace-tech] [SOLVED] RE: CC Licence step not completing?
Hi, Just for completeness, I have now solved the problem I was having using the CC Licence Selection step in DSpace v5.2, JSPUI using https - and I believe it was due to a minor bug in the code. http://dspace.2283337.n4.nabble.com/CC-license-and-HTTPS-in-JSPUI- td4674301.html reports an issue when using https that causes mixed content security warnings, but it looks like the changes suggested on that thread have been incorporated into the DSpace code now (https://jira.duraspace.org/browse/DS-2151?) and a quick review of the relevant code seems to confirm this. So I don't think I'm hitting this issue? Turns out it was this issue I was suffering from and I think it is because the fix detailed in https://jira.duraspace.org/browse/DS-2151 had a small mistake in the code which I didn't spot with my initial quick review (that's just my take on it though, happy for others to contradict me!). The initial problem was that the Proceed link that appears at the end of the CC Licence step was still using http rather than https (despite the fix detailed above) - tracking down the relevant part of the code suggested that it was not correctly stripping the protocol and replacing it with // (part of the fix suggested in http://dspace.2283337.n4.nabble.com/CC-license-and-HTTPS-in-JSPUI-td4674301.html). Around line 41 in creative-commons.jsp it has: String reqURL = request.getRequestURL().toString(); int firstIndex = reqURL.indexOf(://) + 3; int secondIndex = reqURL.indexOf(/, firstIndex); String baseURL = reqURL.substring(0, secondIndex) + request.getContextPath(); - which doesn't appear to strip the protocol (?) - I replaced it with the following: String reqURL = request.getRequestURL().toString(); int firstIndex = reqURL.indexOf(://) + 3; int secondIndex = reqURL.indexOf(/, firstIndex); // Fixed the following to force https to prevent mixed content errors - MW: 17/8/15 String baseURL = // + reqURL.substring(firstIndex, secondIndex) + request.getContextPath(); //String baseURL = reqURL.substring(0, secondIndex) + request.getContextPath(); - which strips the protocol and replaces it with // - this seems to have resolved the problems I was experiencing - the Proceed link is now using https and the CC Licence selection step is now completing as expected :-). I hope this will be helpful for any others that encounter this problem using the CC Licence Selection step with JSPUI and https. Regards, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -Original Message- From: Michael White Sent: 10 August 2015 14:23 To: dspace-tech@lists.sourceforge.net Subject: CC Licence step not completing? Hi, Running DSpace v5.2 with JSPUI. Configured to run over https (which may, or may not, be behind this issue?). I’ve just been having a play with the Creative Commons licence selection step but it doesn’t seem to be working for me so I’m wondering if I’ve done something wrong, or hit a known issue? I’ve “switched on” the CC License step by uncommenting it in item- submission.xml. The CC licence selection step now appears as expected (in an iFrame), and I can select radio buttons and click Select a Licence - the selection process appears to work as I get a page back that shows the selected licence, but when I click on the proceed link, the page just hangs and I'm not moved on to the next step :-( Reviewing the metadata of the record by returning to the Input Forms, I can see that dc.rights now contains “An error occurred on the license name” and I can see that an RDF file has been added to the uploaded files, but this license_rdf file only contains: result - which certainly doesn’t seem right ☺ I've done some googling, and had a dig about in the mailing list archives and JIRA but haven't managed to resolve this or find anything definitive. http://dspace.2283337.n4.nabble.com/CC-license-and-HTTPS-in-JSPUI- td4674301.html reports an issue when using https that causes mixed content security warnings, but it looks like the changes suggested on that thread have been incorporated into the DSpace code now (https://jira.duraspace.org/browse/DS-2151?) and a quick review of the relevant code seems to confirm this. So I don't think I'm hitting this issue? And this JIRA also points to an issue with DSpace 5.2 and CC licences, https://jira.duraspace.org/browse/DS-2604, but this seems to suggest that the process completes (in terms of the record being saved and the CC logo turning up on the item record) which is not what I'm experiencing. So I'm not sure if I'm hitting this issue? I also read somewhere (that I've lost now!) that the specification of a jurisdiction value in dspace.cfg causes problems with the selection of CC v4 licences, so I have tried commenting out this option in dspace.cfg
Re: [Dspace-tech] CC Licence step not completing?
Hi Andrea, Is there anything useful in the dspace log file? Not really - running at DEBUG, I can see when the CC Licence step is being accessed - the below snippet is what I get when I click Next to go to the CC Licence step: 2015-08-11 11:06:16,803 DEBUG org.dspace.app.webui.servlet.SubmissionController @ Calling Step Class: 'org.dspace.submit.step.CCLicenseStep' 2015-08-11 11:06:16,805 DEBUG org.dspace.app.webui.submit.JSPStepManager @ Doing pre-processing for step org.dspace.app.webui.submit.JSPStepManager 2015-08-11 11:06:17,294 DEBUG org.dspace.storage.rdbms.DatabaseManager @ Running query SELECT * FROM MetadataValue WHERE resource_id= ? and resource_type_id = ? ORDER BY metadata_field_id, place with parameters: 91,1 2015-08-11 11:06:17,295 DEBUG org.dspace.app.webui.util.JSPManager @ michael.wh...@stir.ac.uk:session_id=7FF301D30EC1B9F9E67AFAB59C07A542:ip_addr=139.153.115.7:view_jsp:/submit/creative-commons.jsp - but as I select radio buttons on the CC Licence page, and click Select a Licence, things appear to proceed in the browser but nothing else is logged beyond this point - when I click Select a licence to determine the appropriate CC licence - I'm presented with a page that says: provided by Creative Commons You have selected the Attribution 4.0 International License. This licence is permanently located at http://creativecommons.org/licenses/by/4.0/. You may now proceed - with proceed being a hyperlink that points to: http://datastorre.stir.ac.uk/submit/cc-license.jsp?license_url=http%3A//creativecommons.org/licenses/by/4.0/, but when I click that link on the CC Licence page, the iFrame just goes blank and nothing further happens (so I can't get beyond this step), and nothing is added to the logs beyond the log entries that appeared when I first accessed the CC Licence step :-( If I Cancel out from the empty page, and then Save, and then go back in to Edit the record, I can see that the value An error occurred on the license name. has been added to dc.rights, and an empty (bar one line containing result) license_rdf file has been added to the bitstreams . . . . HTTPS vs HTTP should not make any difference to this. However, a network proxy would -- does your DSpace instance have direct access to the Internet? I believe so (we've not had a web proxy here for many years), but I don't work at that level so I'm not 100% sure (but I'm certainly going to double check) - the fact that I do get the page that shows the licence that applies suggests to me that my DSpace is making contact with Creative Commons, but I could be mistaken (is the licence selection logic held in DSpace, or is this retrieved from CC in real time?). Is the behaviour I'm seeing (i.e. that CC Licence selection appears to complete up to the point of clicking Proceed when it hangs) what would happen if a proxy was in play but not configured in DSpace? So, I'm still stuck with this - does anyone have this working in v5.2, JSPUI? Did this just work for you after uncommenting the step in item-submission.xml? or did you have to do anything special to get it working? Many thanks as ever, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] CC Licence step not completing?
Hi, Running DSpace v5.2 with JSPUI. Configured to run over https (which may, or may not, be behind this issue?). I’ve just been having a play with the Creative Commons licence selection step but it doesn’t seem to be working for me so I’m wondering if I’ve done something wrong, or hit a known issue? I’ve “switched on” the CC License step by uncommenting it in item-submission.xml. The CC licence selection step now appears as expected (in an iFrame), and I can select radio buttons and click Select a Licence - the selection process appears to work as I get a page back that shows the selected licence, but when I click on the proceed link, the page just hangs and I'm not moved on to the next step :-( Reviewing the metadata of the record by returning to the Input Forms, I can see that dc.rights now contains “An error occurred on the license name” and I can see that an RDF file has been added to the uploaded files, but this license_rdf file only contains: result - which certainly doesn’t seem right ☺ I've done some googling, and had a dig about in the mailing list archives and JIRA but haven't managed to resolve this or find anything definitive. http://dspace.2283337.n4.nabble.com/CC-license-and-HTTPS-in-JSPUI-td4674301.html reports an issue when using https that causes mixed content security warnings, but it looks like the changes suggested on that thread have been incorporated into the DSpace code now (https://jira.duraspace.org/browse/DS-2151?) and a quick review of the relevant code seems to confirm this. So I don't think I'm hitting this issue? And this JIRA also points to an issue with DSpace 5.2 and CC licences, https://jira.duraspace.org/browse/DS-2604, but this seems to suggest that the process completes (in terms of the record being saved and the CC logo turning up on the item record) which is not what I'm experiencing. So I'm not sure if I'm hitting this issue? I also read somewhere (that I've lost now!) that the specification of a jurisdiction value in dspace.cfg causes problems with the selection of CC v4 licences, so I have tried commenting out this option in dspace.cfg, but that didn't seem to make any difference either. I found this (about writing these CC selection step errors into the metadata), too - https://jira.duraspace.org/browse/DS-1538 - but I don't think that is behind the problem (just a consequence of it)? So, does anyone have the CC licence selection step running on DSpace v5.2, using JSPUI and everything over https? If so, any hints or tips on anything you had to do to get it working? . . . or is CC Licence selection known not to work in that configuration? Many thanks as ever, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Replacing Date Issued sidebar Facet with Funder
Thanks Terry (and Hilton who contacted me off list), Your contributions both confirmed that I was at least taking the right approach and that what I'd done should have worked (all things being equal), thus suggesting I was just missing something simple . . . I'm obviously doing something wrong or have missed something trying to create this sidebar facet Well, it is amazing what a good night’s sleep and a fresh cup of coffee can do – I had, indeed done something wrong/stupid that I just couldn’t see yesterday, but which jumped off the page and slapped me in the face as soon as I looked at it again this morning - I had spurious white space at the end of the metadata field name in the line: valuedc.contributor.other /value [OMG! Face palm! Etc, etc!] Once I'd removed this, restarted Tomcat and rebuilt the Discovery index, it all worked as hoped and the new Funder Facet appeared on my Homepage :-). As an aside (and for the archives), Hilton's notes pointed me to the following useful utility which can be used to display how the Discovery system thinks it is configured (might be a useful addition to the Discovery documentation page?): [dspace]/bin/dspace dsrun org.dspace.discovery.configuration.DiscoveryConfigurationService - which in my case suggested that the config was (generally!) OK, which was helpful to know: 80 default Facets: author dc.contributor.author dc.creator subject dc.subject.* funder dc.contributor.other Search filters dc.title dc.contributor.author dc.creator dc.subject.* dc.contributor.other Recent submissions configuration: Metadata sort field: dc.date.accessioned Max recent submissions: 20 site Facets: author dc.contributor.author dc.creator subject dc.subject.* funder dc.contributor.other Search filters dc.title dc.contributor.author dc.creator dc.subject.* dc.contributor.other Recent submissions configuration: Metadata sort field: dc.date.accessioned Max recent submissions: 5 Regards, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA From: Terry Brady [mailto:terry.br...@georgetown.edu] Sent: 28 July 2015 18:03 To: Michael White michael.wh...@stir.ac.uk Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Replacing Date Issued sidebar Facet with Funder Mike, It sounds like you are following all of the right steps. I find it trickier than I would expect to successfully make changes to the facets. If it is helpful, I have posted a copy of our discovery.xml file: https://gist.github.com/terrywbrady/d31fc1bcb9567204470f We have created a number of collection-specific sidebar facets. I have found it necessary to define a search filter each time that I need to add a new sidebar facet. I have also found it tricky to apply different custom facets at different levels of the hierarchy (collection vs sub-community). Terry -- Terry Brady Applications Programmer Analyst Georgetown University Library Information Technology https://www.library.georgetown.edu/lit/code 425-298-5498 (Seattle, WA) -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Replacing Date Issued sidebar Facet with Funder
Hi, DSpace v5.2, JSPUI. I've been trying to change the Date Issued side bar facet to be a Funder side bar facet, but I haven't been able to get it working. I was successfully able to change the Date Issued facet to use Date Accessioned (so I've been doing something right!), but I've not been able to get the Funder facet working - I'm hoping someone can point out where I'm going wrong :-) In /usr/local/dspace/config/spring/api/discovery.xml: I updated the homepageConfiguration bean to reference a new search filter for Funder: !--The Homepage specific configuration settings for discovery-- bean id=homepageConfiguration class=org.dspace.discovery.configuration.DiscoveryConfiguration scope=prototype !--Which sidebar facets are to be displayed (same as defaultConfiguration above)-- property name=sidebarFacets list ref bean=searchFilterAuthor / ref bean=searchFilterSubject / ref bean=searchFilterFunder / /list /property - and defined the new searchFilterFunder bean (as a Search Filter/Facet using the class DiscoverySearchFilterFacet): !-- New bean for contributor.other/othernew (Funder) Search filter - MW: 27/7/15 -- bean id=searchFilterFunder class=org.dspace.discovery.configuration.DiscoverySearchFilterFacet property name=indexFieldName value=funder/ property name=metadataFields list valuedc.contributor.other /value !--valuedc.contributor.othernew /value -- /list /property property name=facetLimit value=10/ property name=sortOrder value=COUNT/ /bean - and created a sort property bean for Funder: !-- New bean for contributor.other (Funder) Sort properties - MW 27/7/15 -- bean id=sortFunder class=org.dspace.discovery.configuration.DiscoverySortFieldConfiguration property name=metadataField value=dc.contributor.other/ /bean - which I referenced in the homepage searchSortConfiguration: !--The sort filters for the discovery search (same as defaultConfiguration above)-- property name=searchSortConfiguration bean class=org.dspace.discovery.configuration.DiscoverySortConfiguration !--property name=defaultSort ref=sortDateIssued/-- !--DefaultSortOrder can either be desc or asc (desc is default)-- property name=defaultSortOrder value=desc/ property name=sortFields list ref bean=sortTitle / ref bean=sortFunder / /list /property /bean /property But after restarting Tomcat and rebuilding the discovery indices (with /usr/local/dspace/bin/dspace index-discovery -b), the homepage loads, but only displays the facets for Author and Subject - the Date Issued facet is no longer displayed as expected, but nothing appears in its place (just white space) :-( I've been following the instructions at https://wiki.duraspace.org/display/DSDOC5x/Discovery but no joy so far. These instructions also suggest that I should be using the class org.dspace.discovery.configuration.SidebarFacetConfiguration for the Search Filter bean, but I tried that and it generated an error at startup (plus this class isn't listed in the summary of classes on that page that lists the classes found in the discovery.xml file, so I'm left a little confused). As an aside, I've also set up a Search Index and a Browse filter for Funder in dspace.cfg which seem to be working: search.index.3 = funder:dc.contributor.other ... webui.browse.index.4 = funder:metadata:dc.contributor.other:text I'm obviously doing something wrong or have missed something trying to create this sidebar facet, so if anyone has any insights or suggestions they would be very welcome :-). Thanks in advance, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Shibboleth and role based groups?
Thanks Tim, A silly question, but is the org.dspace.authenticate.ShibAuthentication class listed *first* amongst your AuthenticationMethod settings in authentication.cfg? Or are there other authentication plugins appearing above it? No such thing as a silly question - always worth checking the obvious :-) But yes, the Shib Authentication class is listed first (with Password authentication second as a fall back for external users) . . . . It seems really odd to me that you are not seeing DEBUG logs from the ShibAuthentication.getSpecialGroups() method, as they should be written on *login* (and shouldn't actually be affected by that other bug I mentioned, DS- 2527). Yes, agreed - I thought it odd that I couldn't see any of these log lines appearing when logging on . . . . So, it made me wonder if somehow the Special Groups are not being initialized properly (though I cannot think of why that'd be). It certainly seems that way on the evidence so far . . . You could try listing ShibAuthentication *first* (or removing any other Authentication plugins temporarily) to see if that makes any difference. I will try and find some time to investigate again and will try this . . . Beyond that, honestly your configs look fine to me. I don't see anything obviously wrong here, and I've done something similar myself in the past (and it's always worked). That's good to know - I'll have another play with this at some point and see if I can learn any more - if I do, I'll obviously share what I find :-) Thanks again, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: 17 June 2015 21:42 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth and role based groups? Hi Michael, A silly question, but is the org.dspace.authenticate.ShibAuthentication class listed *first* amongst your AuthenticationMethod settings in authentication.cfg? Or are there other authentication plugins appearing above it? https://github.com/DSpace/DSpace/blob/master/dspace/config/modules/aut hentication.cfg#L37 It seems really odd to me that you are not seeing DEBUG logs from the ShibAuthentication.getSpecialGroups() method, as they should be written on *login* (and shouldn't actually be affected by that other bug I mentioned, DS- 2527). So, it made me wonder if somehow the Special Groups are not being initialized properly (though I cannot think of why that'd be). You could try listing ShibAuthentication *first* (or removing any other Authentication plugins temporarily) to see if that makes any difference. Beyond that, honestly your configs look fine to me. I don't see anything obviously wrong here, and I've done something similar myself in the past (and it's always worked). - Tim -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] JACS Controlled Vocabulary
Hi, DSpace v5.2/JSPUI I've been asked to implement the JACS controlled vocabulary for subject classification in a new repository I'm setting up. For this I need the JACS vocabulary in the appropriate XML format. A small amount of Googling hasn't turned anything up, so, as I know a number of other repositories make use of this, I wondered if anyone has a copy of the required JACS XML that they'd be willing to share? Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Shibboleth and role based groups?
Thanks Tim, You might be hitting this bug: https://jira.duraspace.org/browse/DS-2527 Yes, it does look like what I'm experiencing, but I've tried the fix and it didn't seem to do the job for me - I uncommented the following in dspace.cfg: org.dspace.content.Collection.findAuthorizedPerformanceOptimize = false - and restarted Tomcat, but no joy. In authentication-shibboleth.cfg, I have: -- # The shibboleth header to do role-based mappings role-header = affiliation # Whether to ignore the attribute's scope or value. role-header.ignore-scope = true #role-header.ignore-value = false # Default mappings of roles values to a comma separated list of DSpace group # names (Case Sensitive). #role.faculty = Faculty, Member role.staff = STIR_USERS -- But, when I log on as a user with the appropriate role defined, they are not allocated to the named group (which should give them deposit permissions as the special group has deposit permissions in my one and only test group). With logging at DEBUG, I can see the role header (affiliation) being passed over (amongst others): eppn='m...@stir.ac.uk' affiliation='st...@stir.ac.uk;mem...@stir.ac.uk' unscoped-affiliation='' entitlement='' targeted-id='' persistent-id='' sn='White' givenname='Michael' mail='michael.wh...@stir.ac.uk' netid='mw6' o='Information Services' ou='eLearning Liaison and Development' However, I'm not seeing any of the log lines from the getSpecialGroups function in ShibAuthentication.java - so it still looks like this function isn't being called? So, just wanted to report that the simple fix didn't seem to resolve the problem for me. However, It isn't life or death for me to solve this now as allocation to a single special group wasn't quite what I wanted to do anyway - I ideally wanted to allocate Researchers to deposit groups for the Collections for their department (pulled from ou header), so instead I extended the ShibAuthentication code to use a mapping of departments to deposit groups (abstracted to authentication-shibboleth.cfg) to add users to their department's deposit group during logon (which I now have working a treat). Not sure why the stipulated fix for the original problem didn't work for me though :-( Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: 12 June 2015 15:25 To: Michael White; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth and role based groups? Mike, You might be hitting this bug: https://jira.duraspace.org/browse/DS-2527 If so, there's a quick fix listed in the bug report. Good luck, - Tim On 6/9/2015 5:21 AM, Michael White wrote: Hi, I can't seem to get the auto population of this group working. Just to add to what I've already said - I upped the log level to DEBUG and ran some more tests, but that didn't seem to shine any additional light. So I've been looking through the Shibboleth authentication code (in ShibAuthentication.java) - In the code I can see the function: public int[] getSpecialGroups(Context context, HttpServletRequest request) - which appears to be the code that adds the user to the special group(s). This code contains lots of INFO and DEBUG logging lines, but I'm not seeing any of these lines appearing in my logs - suggesting that this code to populate the special groups isn't actually being called . . . . . ? It certainly isn't called from within ShibAuthentication.java as far as I can tell . . . . Am I missing some config somewhere to turn this feature on? It all looks like it should work, so I feel like I'm missing something obvious (assuming this feature is working for others)? Any pointers welcome! Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -Original Message- From: Michael White Sent: 09 June 2015 10:17 To: dspace-tech@lists.sourceforge.net Subject: Shibboleth and role based groups? Hi, DSpace v5.2/JSPUI. I've set up Shibboleth authentication for a new v5.2 installation - the authentication part appears to be working well, but I'm struggling with automatically placing authenticated users into role based groups based on their (scoped) affiliation and I'm hoping someone might be able to help. I've configured authentication-shibboleth.cfg to add staff users into the group ALL_Collections_Submit (and I've double checked the group name/case etc): # The shibboleth header to do role-based mappings
[Dspace-tech] Shibboleth and role based groups?
Hi, DSpace v5.2/JSPUI. I've set up Shibboleth authentication for a new v5.2 installation - the authentication part appears to be working well, but I'm struggling with automatically placing authenticated users into role based groups based on their (scoped) affiliation and I'm hoping someone might be able to help. I've configured authentication-shibboleth.cfg to add staff users into the group ALL_Collections_Submit (and I've double checked the group name/case etc): # The shibboleth header to do role-based mappings role-header = affiliation # Whether to ignore the attribute's scope or value. role-header.ignore-scope = true # Default mappings of roles values to a comma separated list of DSpace group # names (Case Sensitive). #role.faculty = Faculty, Member role.staff = ALL_Collections_Submit #role.student = Students, Member - when I authenticate, I can see in the dspace logs that the shib authentication module is picking up the affiliation header (amongst others): 2015-06-09 09:53:05,024 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:affiliation=st...@stir.ac.uk;mem...@stir.ac.uk 2015-06-09 09:53:05,024 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:unscoped-affiliation= 2015-06-09 09:53:05,025 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:entitlement= 2015-06-09 09:53:05,025 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:targeted-id= 2015-06-09 09:53:05,026 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:persistent-id= 2015-06-09 09:53:05,027 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:sn=White 2015-06-09 09:53:05,027 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:givenname=Michael 2015-06-09 09:53:05,028 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:mail=michael.wh...@stir.ac.uk - but, even though the authentication is successful (and creates a new ePerson record for that user using the supplied header data if they don't already exist in the system), I can't seem to get the auto population of this group working. I only have a handful of test collections in this DSpace currently: 0 Anonymous 1 Administrator 2 Test_Collection_SUBMIT 3 ALL_Collections_Submit - where ALL_Collections_Submit has group deposit permissions to Test_Collection_SUBMIT. If I manually add a user to the ALL_Collections_Submit group, then when I log on as that user via Shibboleth, I do get the appropriate deposit permissions for Test_Collection_SUBMIT (so the group logic seems OK), but it doesn't work if relying on Shibboleth to dynamically add the user to the ALL_Collections_Submit group . . . . I also tried amending the shibboleth attribute filter policy to only supply st...@stir.ac.uk, just in case it was the semi colon separated list of scoped affiliations that was behind the problem, but it still didn't work . . . . Does anyone have any thoughts on what I might be missing? Do others have this working as intended? Have I misunderstood or done something stupid? Thanks in advance for any thoughts or insights anyone might have. Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Shibboleth and role based groups?
Hi, I can't seem to get the auto population of this group working. Just to add to what I've already said - I upped the log level to DEBUG and ran some more tests, but that didn't seem to shine any additional light. So I've been looking through the Shibboleth authentication code (in ShibAuthentication.java) - In the code I can see the function: public int[] getSpecialGroups(Context context, HttpServletRequest request) - which appears to be the code that adds the user to the special group(s). This code contains lots of INFO and DEBUG logging lines, but I'm not seeing any of these lines appearing in my logs - suggesting that this code to populate the special groups isn't actually being called . . . . . ? It certainly isn't called from within ShibAuthentication.java as far as I can tell . . . . Am I missing some config somewhere to turn this feature on? It all looks like it should work, so I feel like I'm missing something obvious (assuming this feature is working for others)? Any pointers welcome! Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -Original Message- From: Michael White Sent: 09 June 2015 10:17 To: dspace-tech@lists.sourceforge.net Subject: Shibboleth and role based groups? Hi, DSpace v5.2/JSPUI. I've set up Shibboleth authentication for a new v5.2 installation - the authentication part appears to be working well, but I'm struggling with automatically placing authenticated users into role based groups based on their (scoped) affiliation and I'm hoping someone might be able to help. I've configured authentication-shibboleth.cfg to add staff users into the group ALL_Collections_Submit (and I've double checked the group name/case etc): # The shibboleth header to do role-based mappings role-header = affiliation # Whether to ignore the attribute's scope or value. role-header.ignore-scope = true # Default mappings of roles values to a comma separated list of DSpace group # names (Case Sensitive). #role.faculty = Faculty, Member role.staff = ALL_Collections_Submit #role.student = Students, Member - when I authenticate, I can see in the dspace logs that the shib authentication module is picking up the affiliation header (amongst others): 2015-06-09 09:53:05,024 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:affiliation=st...@stir.ac.uk;mem...@stir.ac.uk 2015-06-09 09:53:05,024 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:unscoped- affiliation= 2015-06-09 09:53:05,025 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:entitlement= 2015-06-09 09:53:05,025 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:targeted-id= 2015-06-09 09:53:05,026 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:persistent-id= 2015-06-09 09:53:05,027 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:sn=White 2015-06-09 09:53:05,027 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:givenname=Michael 2015-06-09 09:53:05,028 INFO org.dspace.app.webui.servlet.ShibbolethServlet @ header:mail=michael.wh...@stir.ac.uk - but, even though the authentication is successful (and creates a new ePerson record for that user using the supplied header data if they don't already exist in the system), I can't seem to get the auto population of this group working. I only have a handful of test collections in this DSpace currently: 0 Anonymous 1 Administrator 2 Test_Collection_SUBMIT 3 ALL_Collections_Submit - where ALL_Collections_Submit has group deposit permissions to Test_Collection_SUBMIT. If I manually add a user to the ALL_Collections_Submit group, then when I log on as that user via Shibboleth, I do get the appropriate deposit permissions for Test_Collection_SUBMIT (so the group logic seems OK), but it doesn't work if relying on Shibboleth to dynamically add the user to the ALL_Collections_Submit group . . . . I also tried amending the shibboleth attribute filter policy to only supply st...@stir.ac.uk, just in case it was the semi colon separated list of scoped affiliations that was behind the problem, but it still didn't work . . . . Does anyone have any thoughts on what I might be missing? Do others have this working as intended? Have I misunderstood or done something stupid? Thanks in advance for any thoughts or insights anyone might have. Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159
Re: [Dspace-tech] DSpace 5.2, Tomcat 8, JSPUI and servlet-api
Thanks Mark, Mark H. Wood wrote: I think you may be seeing https://jira.duraspace.org/browse/DS-2502 (Incorrect dependencies drag javax.servlet:servlet-api into all webapp.s) There's an untested patch at https://github.com/DSpace/DSpace/pull/953 The PR previously mentioned is meant to prevent servlet-api being pulled in. I would be interested to learn whether this patch is helpful. Yes, very! I patched the 2 pom files as detailed in that patch and, after cleaning everything out and starting again, I was able to rebuild/redeploy DSpace v5.2 AND successfully access the JSPUI interface :-) I did not undo the changes I made to the pom files previously (to reference v3.1 of servlet-api and the new Artifact ID as discussed in http://sourceforge.net/p/dspace/mailman/message/33532346/) but simply added the changes outlined in the patch. Let me know if that was not correct! You say above that this patch should prevent servlet-api being pulled into the DSpace WARs, but I note that if I look for the servlet-api, it does still turn up (although not as much as previously!): # find /usr/src/dspace-5.2-src-release -name '*servlet-api*' -print /usr/src/dspace-5.2-src-release/dspace-oai/target/dspace-oai-5.2/WEB-INF/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace-xmlui/target/dspace-xmlui-5.2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/modules/swordv2/target/swordv2-5.2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/modules/oai/target/oai-5.2/WEB-INF/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace/modules/xmlui/target/xmlui-5.2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/swordv2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/oai/WEB-INF/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/xmlui/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/lib/javax.servlet-api-3.1.0.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace-swordv2/target/dspace-swordv2-5.2/WEB-INF/lib/servlet-api-2.4.jar So, it may be that this patch has only partially fixed the problem? (i.e. just enough for me to get into the JSPUI?) - I've not yet done anything beyond bring up the home page with the vanilla install, so perhaps I'm going to bump up against this issue again when/if I start using any of the webapps listed above that still seem to contain explicit references to servlet-api v2.4/2.5? If I should be concerned about the above, just let me know! But for now I've cleared the hurdle that was preventing me getting the basic install up and running - hopefully it will be smooth sailing from here on in, but if not, I'll certainly shout! :-) Thanks a million, that was very helpful indeed! Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA Message: 2 Date: Wed, 27 May 2015 15:20:46 +0100 From: Michael White michael.wh...@stir.ac.uk Subject: [Dspace-tech] DSpace 5.2, Tomcat 8, JSPUI and servlet-api version problems? To: dspace-tech@lists.sourceforge.net dspace-tech@lists.sourceforge.net Message-ID: 7C43CB6F3460394F9B5236C0F68D7B6AC522E3B0BC@EXCH2007.a d.stir.ac.uk Content-Type: text/plain; charset=us-ascii Hi, I've been trying to bring up a brand new install of DSpace 5.2 on a shiny new box with the following: Debian 8 OpenJDK 7U79 Maven 3.0.5 Ant 1.9.4 PostgreSQL 9.4 Tomcat 8.0.14 I've been able to build and deploy, but when I try and access the JSPUI, I get an Internal Server Error (XMLUI works OK, but I want to use JSPUI): Exception: org.apache.jasper.JasperException: Unable to compile class for JSP: An error occurred at line: [60] in the generated java file: [/var/lib/tomcat8/work/Catalina/localhost/jspui/org/apache/jsp/index_jsp.jav a] The method getDispatcherType() is undefined for the type HttpServletRequest Stacktrace: at snip Help! :-) Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. Message: 4 Date: Wed, 27 May 2015 13:47:13 -0400 From: Mark H. Wood mw...@iupui.edu Subject: Re: [Dspace-tech] DSpace 5.2, Tomcat 8, JSPUI and servlet-api version problems? To: dspace-tech@lists.sourceforge.net Message-ID: 20150527174712.ga13...@iupui.edu Content-Type: text/plain; charset=us-ascii
[Dspace-tech] DSpace 5.2, Tomcat 8, JSPUI and servlet-api version problems?
/sword-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/swordv2/target/swordv2-5.2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/modules/swordv2/target/swordv2-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/oai/target/oai-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/oai/target/oai-5.2/WEB-INF/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace/modules/xmlui/target/xmlui-5.2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/modules/xmlui/target/xmlui-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/rest/target/war/work/org.dspace/dspace-rest/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/rest/target/rest-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/rdf/target/war/work/org.dspace/dspace-rdf/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/modules/rdf/target/rdf-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/jspui/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/sword/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/swordv2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/swordv2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/oai/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/oai/WEB-INF/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/xmlui/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/xmlui/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/rest/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/webapps/rdf/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/lib/javax.servlet-api-3.1.0.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace/target/dspace-installer/lib/servlet-api-2.5.jar /usr/src/dspace-5.2-src-release/dspace-swordv2/target/dspace-swordv2-5.2/WEB-INF/lib/servlet-api-2.4.jar /usr/src/dspace-5.2-src-release/dspace-swordv2/target/dspace-swordv2-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar /usr/src/dspace-5.2-src-release/dspace-sword/target/dspace-sword-5.2/WEB-INF/lib/servlet-api-2.5-20081211.jar I am now officially at a loss as to what to try next in order to get the DSpace 5.2 JSPUI up and running under tomcat 8 :-( Should what I did have worked (i.e. if I can just get the system to forget what it thinks it should be doing and actually use the pom files as configured, this should work)? Have I missed a step or something obvious? Am I just being dense? If anyone else has run into this problem and worked their way around it, I would welcome any insights you have to share as I've been banging my head against this for a while now and I'm starting to lose the will to develop ;-( Help! :-) Cheers, Mike Michael White eLearning Developer Information Services T: (01786) 466877 E: michael.wh...@stir.ac.uk A: S8, Library, University of Stirling, Stirling, FK9 4LA -- The University is ranked in the QS World Rankings of the top 5% of universities in the world (QS World University Rankings, 2014) The University of Stirling is a charity registered in Scotland, number SC 011159. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Request a copy and Captcha?
Hi, DSpace v4.1, JSPUI. We are having problems with our Request a copy form being used by bots to systematically spam our Researchers, therefore I have been asked to investigate adding some kind of Captcha to the Request a copy form to ensure that the form is only submitted by real users. I'm just starting my investigations but in the hope of avoiding re-inventing the wheel, I was wondering if anyone out there had already done anything like this and might be willing to share their solution? I've not implemented a Captcha before and see that there are a number of Captcha options available (Google's reCaptcha is one that crops up a lot, but then I am searching in Google!), so wondered if anyone had any experiences/opinions on any of the available solutions? Or pointers to useful sites that might help me cut through the promotional chatter to the nuts and bolts of actually doing it? I've had a quick look in the DSpace mail archives, but could only find some fairly old cursory discussions on the topic (and were mostly around the XMLUI), but if I've missed anything, feel free to point me in the right direction. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Dive into the World of Parallel Programming. The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace-tech Digest, Vol 103, Issue 56
Hi Lars, I don't know if this is your problem or not, but I saw something similar (i.e. the slash in the handle being URL encoded) when working with DSpace v3.1. This was due to a bug that was fixed in v3.2. If you're using v3.0 or v3.1 then this might be what you've encountered: https://jira.duraspace.org/browse/DS-1537 Hope that helps. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- Message: 6 Date: Mon, 24 Nov 2014 10:44:03 +0100 From: Lars M?ller moel...@basis5.de Subject: [Dspace-tech] xsl question To: dspace-tech@lists.sourceforge.net Message-ID: 5472fde3.60...@basis5.de Content-Type: text/plain; charset=iso-8859-15 Hi, i have a problem providing in the DSpace OAI-PMH Data Provider a file name. i want to use the first bitstream and catch the data with: xsl:if test=count(doc:metadata/doc:element[@name='bundles']/doc:element/doc :field[text()='ORIGINAL']) gt; 0 xsl:for-each select=doc:metadata/doc:element[@name='bundles']/doc:element/doc:fiel d[text()='ORIGINAL'] xsl:for-each select=../doc:element[@name='bitstreams']/doc:element xsl:if test=(position() =1) europeana:object xmlns:europeana=http://europeana.eu/terms;xsl:value-of select=node()/ xsl:value-of select=doc:field[@name='url']/text() / /europeana:object /xsl:if /xsl:for-each /xsl:for-each /xsl:if but the output string has a %2F instead of /. http://domain.com/bitstream/11153%2F104-006-005/1/bitstream instead of http://domain.com/bitstream/11153/104-006-005/1/bitstream dos anyone know how to get the correct stream url? best lars -- next part -- An HTML attachment was scrubbed... -- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.cl ktrk -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech End of DSpace-tech Digest, Vol 103, Issue 56 -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Free web tool for analyzing DSpace SEO analysis
Hi Bram, Many thanks for this (and for your previous response to my initial questions and the link to the extended analysis for my repo) ☺ 1. Discrepancy in item count This should now be fixed. If anyone finds other discrepancies, please let me know. Just to confirm that this looks much better now – it is now showing the correct Item count for our repository ☺ 2. Extended analysis emails Emails are still broken, but after entering your email address you will immediately get the link to the extended analysis in the webUI as a temporary workaround. Thanks again for sending me a link to the extended analysis for our repository – it all came back looking OK, so that’s nice ☺ 3. Sense and nonsense of my repository speed measurements Found that my measurement was actually measuring more than just ONE page request. Changed this so you should get considerably lower response time reports now. And I can confirm that this is also now looking much better from here – our response time is now showing as around 300ms (down from 2000ms), so that is also nice to see ☺ Thanks again, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: 20 September 2014 13:45 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Free web tool for analyzing DSpace SEO analysis Hi, short update after rolling out a few changes directly on http://dspacecheck-atmire.rhcloud.com/ 1. Discrepancy in item count This should now be fixed. If anyone finds other discrepancies, please let me know. 2. Extended analysis emails Emails are still broken, but after entering your email address you will immediately get the link to the extended analysis in the webUI as a temporary workaround. 3. Sense and nonsense of my repository speed measurements Found that my measurement was actually measuring more than just ONE page request. Changed this so you should get considerably lower response time reports now. best regards, Bram -- [http://atmire.com/images/@mire_web_2.jpg] Bram Luyten +1 202 684 6365 2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010 Esperantolaan 4, Heverlee 3001, Belgium www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On 20 September 2014 12:56, Bram Luyten b...@atmire.commailto:b...@atmire.com wrote: Hi Michael, thanks for your feedback on the prototype of this new tool: 1. Discrepancy in item count Thanks for reporting this, as it will help me debugging. The script retrieves the item count from the browse-title pagehttp://dspace.stir.ac.uk/browse?type=title, parsing it from the string Showing results 1 to 20 of 8509. Will need to figure out why this is currently not working on your repo. 2. Extended analysis emails All outgoing emails are broken since earlier this month. I was happily using Gmail SMTP for this, but it is now rejecting the emails. I will need to make gmail happy again or move off to a different email provider. In the meanwhile, I'll send you a personal email with the link that directs you to the extended analysis of your repository. 3. Sense and nonsense of my repository speed measurements I need to get a better speed measurement in place and include in the description that the app currently runs on the redhat openshift cloud in the US. This means the measurement is obviously biased towards US repositories and will partially explain why you get a worse result for a repository based in the UK. For me personally, browsing here from my couch in Belgium, one of the fastest / snappiest repositories is CADAIR: http://cadair.aber.ac.uk/dspace/ Just clicking around, yours feels *very* fast as well Michael, so I wouldn't worry about the responsetime reported by my blunt instrument. Anyhow, if you're interested in this type of analysis, I would recommend to hook up your repository to New Relic ( http://newrelic.com/ ) that has awesome and detailed reports and monitoring. best regards, Bram -- [http://atmire.com/images/@mire_web_2.jpg] Bram Luyten +1 202 684 6365tel:%2B1%20202%20684%206365 2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010 Esperantolaan 4, Heverlee 3001, Belgium www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On 16 September 2014 17:01, Michael White michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk wrote: Hi, we have deployed a prototype of a free tool that can analyze a few SEO properties for your DSpace repository. More precisely, the tool can take a look at your robots.txt file to see if there potential problems. Having just upgraded to v4.1
Re: [Dspace-tech] Free web tool for analyzing DSpace SEO analysis
Hi, we have deployed a prototype of a free tool that can analyze a few SEO properties for your DSpace repository. More precisely, the tool can take a look at your robots.txt file to see if there potential problems. Having just upgraded to v4.1 and done my best to carry out SEO, I thought I'd have a look at this out of curiosity and have a couple of questions: - the Itemcount for our repository shows as 7536 items, but the actual number of items in our repository is 8496 - any ideas where the discrepancy is creeping in? The sitemap referenced from our robots.txt lists 8626 objects (which includes Items along with Community and Collection Homepages) so I don't think it is the case that the Itemcount is being (correctly?) generated from the sitemap referenced in robots.txt (or is it?!) . . . . - I wanted to see the Extended Analysis but it is asking for an email address with the same domain as our repository - as our repository is dspace.stir.ac.uk I thought it would be OK with michael.wh...@stir.ac.uk but I've not received anything as yet (and the email didn't appear to have been Junked either) - should I have received anything, or is that email domain not acceptable? - the response time for the homepage of my repository is generally being reported at around 2000 milliseconds (I tried it a few times :-)), but the text on that page says some DSpace sites can serve pages in under 100ms: The faster your site is, the better. Some DSpaces can serve pages under 100ms. If you experience substantially slower loading times you may need to optimize. I didn't think of our repository as slow, but should I (i.e. does 2000 milliseconds constitute a substantially slower loading time)? And if so, any thoughts why our repository is 20 times slower than the potential value noted on that page (yes, I appreciate this is why is my bit of string longer than yours type question ;-) )? Perhaps it is just a geographical issue (I'm guessing the analysis is being done stateside, so repositories on this side of the pond might expect longer response times?)? Or maybe, in certain configurations, DSpace just runs faster/slower (e.g. we are using JSPUI with Apache in front of Tomcat along with Postgres, all on the same Virtual Linux box) . . . ? And, if relevant, what is the optimization that is being alluded to in the text on that page? Thanks in advance for any insights anyone might have. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld Message: 2 Date: Fri, 20 Jun 2014 18:06:48 +0200 From: Bram Luyten b...@atmire.com Subject: [Dspace-tech] Free web tool for analyzing DSpace SEO analysis To: DSpace Tech dspace-tech@lists.sourceforge.net, General List dspace-gene...@lists.sourceforge.net Message-ID: CACwo3X0_5w=c1xJ=dQFJhJeh+MboTFMqetxi17Ved5SAYUmo9g@ mail.gmail.com Content-Type: text/plain; charset=utf-8 Hi, we have deployed a prototype of a free tool that can analyze a few SEO properties for your DSpace repository. More precisely, the tool can take a look at your robots.txt file to see if there potential problems. You can access the tool here: https://bitly.com/or14-analysis If the tool identifies certain problems, you can find more information at: https://wiki.duraspace.org/display/DSDOC4x/Search+Engine+Optimization This tool was partly developed at the Open Repositories 2014 Developer Challenge. A short slidedeck is available at: http://www.slideshare.net/bramluyten/big-elephant If you have any suggestions for this tool, please feel free to send them. We intend to extend this tool with a few more tests in the future. enjoy the weekend, Bram Luyten -- [image: logo] *Bram Luyten* +1 202 684 6365 *2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010* *Esperantolaan 4, Heverlee 3001, Belgium* www.atmire.com http://atmire.com/website/?q=servicesutm_source=emailfooterutm_me dium=emailutm_campaign=braml -- next part -- An HTML attachment was scrubbed... -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce. Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https
Re: [Dspace-tech] OAI baseURL incorrect . . .
Hi again,
So, does anyone have any thoughts on where this reference to localhost
could be creeping in? Is the baseURL taken from config somewhere
(where?), or assumed from the URL used to access the OAI interface (which
Apache may be mangling)?
Just for the record/mail archives - I looked into this in a bit more depth, and
it looked to me from examining the code in DSpaceIdentify.java that the OAI
baseURL is indeed determined by picking apart the request URL rather than
pulling it from config:
public String getBaseUrl()
{
if (_baseUrl == null)
{
_baseUrl = _request.getRequestURL().toString()
.replace(_request.getPathInfo(), );
}
return _baseUrl + _request.getPathInfo();
}
- so if the hostname of the request URL that was being picked apart was
localhost:8080, this did point to an issue with the request that Apache was
passing on to Tomcat . . .
Once I'd convinced myself of that fact and conveyed all that to my sys admin
colleague, he hacked about with the Apache and connector configurations (we're
using mod_proxy I believe) and we finally got it working, so the OAI base URL
that appears in the Identify response for our repository is now correct :-).
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
-Original Message-
From: Michael White
Sent: 02 September 2014 15:14
To: dspace-tech@lists.sourceforge.net
Subject: OAI baseURL incorrect . . .
Hi,
I was just checking the OAI-PMH output of my new DSpace v4.1 PROD system
against the OAI-PMH validator and was surprised to find the validation had
failed due to a baseURL mismatch, even though it had all been lovely when I
tested it previously on my DEV system.
[FAIL] baseURL supplied 'http://dspace.stir.ac.uk/oai/request' does not match
the baseURL in the Identify response 'http://localhost:8080/oai/request'.
- and they are quite right (obviously!) - when accessing
http://dspace.stir.ac.uk/oai/request?verb=Identify, I see :
request verb=Identifyhttp://localhost:8080/oai/request/request
Identify
repositoryNameSTORRE/repositoryName
baseURLhttp://localhost:8080/oai/request/baseURL
...
But this all looks OK in my DEV system
(http://dspace4dev.stir.ac.uk:8080/oai/request?verb=Identify):
request
verb=Identifyhttp://dspace4dev.stir.ac.uk:8080/oai/request/request
Identify
repositoryNameSTORRE (v4 DEV)/repositoryName
baseURLhttp://dspace4dev.stir.ac.uk:8080/oai/request/baseURL
I've checked through the various config files, and I can't see any difference
(or any unexpected references to localhost) - the main difference between
the systems is that I'm going straight to Tomcat on port 8080 in my DEV
environment and my sys admin colleague has stuck Apache in front of Tomcat
for our PROD system - I'll also add that, in order to validate our DEV system,
my sys admin colleague installed the reverse proxy pound so that we could
make the DEV system visible from off campus on port 80, and the OAI-PMH
output of my DEV system also validated correctly through that route.
I've tried clearing the OAI cache and rebuilding the index, but no joy so far
. . .
I also did a search for localhost in all the config files to see if I could
see
where this might be creeping in, but, again, no joy . . .
So, does anyone have any thoughts on where this reference to localhost
could be creeping in? Is the baseURL taken from config somewhere
(where?), or assumed from the URL used to access the OAI interface (which
Apache may be mangling)? Any suggestions of anything else to
change/investigate?
Given this works OK in DEV and the configs appear to be the same (or
equivalent) in all the key places (as far as I can tell), I'm wondering if
Apache is
to blame for this? But I'd obviously like to eliminate DSpace config as a
suspect
before I go back to my sys admin colleague . . .
Any thoughts, insights or pointers would be welcome :-)
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
--
The University of Stirling has been ranked in the top 12 of UK universities for
graduate employment*.
94% of our 2012 graduates were in work and/or further study within six months
of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
--
Slashdot TV.
Video for Nerds. Stuff
Re: [Dspace-tech] Request a copy
Hi Gary,
Is it possible to have the Request a copy button send to a DSpace
administrator email address only, rather than to the item owner? If so, where
would I configure/code/hack this?
I've done something similar with our DSpace v4.1/JSPUI - Amongst other changes
to our Embargo/Request a copy handling, I hacked our Request a copy
implementation to send the Request email to an email address specified in the
item's metadata (rather than always sending to the submitter), and I added a
config option to dspace.cfg to specify the metadata field that held that
address (which is dc.author.email in our case).
To achieve this, I hacked RequestItemServlet.java (src in
/usr/src/dspace-4.1-src-release/dspace-jspui/src/main/java/org/dspace/app/webui/servlet
IIRC), and I've attached my hacked version in case it is of use or help to you
(I'm guessing the mailing list will strip this, though, so if anyone else is
interested in this, just let me know). If you search for MW in this file,
you'll see the places where I've added/hacked the code (all my hacks (should!)
have comments with my initials and the date) . . .
Basically, if you want to control where the email goes, I think you need to
affect the email address that is passed into this line (it was a while ago I
did this!):
email.addRecipient(emailRequest);
- which occurs in the processForm and processAdmin functions I think . . .
So, if you wanted to hard code it, you could simply put the email address in
there (probably pulled from the config using
ConfigurationManager.getProperty(mail.admin) rather hard coding the actual
address) . . .
Alternatively, I note that just above the addRecipient line, the code checks
if emailRequest is empty, and if it is, populates it with the Admin email
address instead (I THINK this is in the original, and isn't something I have
added!?):
if (emailRequest == null) {
emailRequest = ConfigurationManager
.getProperty(mail.admin);
}
So, you could hack this test to get the change you want?
If it were me, I'd probably add a flag to the config file (a key with a value
of true or false) and add a test for that value to the if statement above, that
way you could toggle between sending emails to the Admin or to the expected
email address simply by changing the config option - so, for example (off the
top of my head, and NOT TESTED!), in dspace.cfg, add:
request.item.adminemail = true
- and then hack the above to something like:
if ((emailRequest == null) ||
(true.equalsIgnoreCase(ConfigurationManager.getProperty(request.item.adminemail
))) {
emailRequest = ConfigurationManager
.getProperty(mail.admin);
}
[Not sure if you actually need to test against true, or if the value in
request.item.adminemail can be used as a Boolean as is (without a
comparison) - so you may be able to clean that up a little!]
The above may not be the best way to achieve what you want (and others are
welcome to correct me or offer other/better solutions!), but would probably get
you where you want to go!
I hope this is of some use.
Regards,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
Message: 5
Date: Tue, 2 Sep 2014 06:58:59 +
From: Gary Browne gary.bro...@sydney.edu.au
Subject: [Dspace-tech] Request a copy
To: dspace-tech Tech dspace-tech@lists.sourceforge.net
Message-ID: 23DF3A1C5648DD43BCAE0666B5AFAD119405096A@ex-mbx-
pro-02
Content-Type: text/plain; charset=iso-8859-1
Hi all,
DSpace version: 4.1
UI: JSP
Servlet container: Tomcat 7
Server: RHEL 6.5 64-bit
Java: OpenJDK 1.7
Is it possible to have the Request a copy button send to a DSpace
administrator email address only, rather than to the item owner? If so, where
would I configure/code/hack this?
Thanks,
Gary
GARY BROWNE?| Development Programmer
Library IT Services | Fisher Library F03?
THE UNIVERSITY OF SYDNEY
T +61 2 9351 5946 | M +61 405 647 868 ?
E gary.bro...@sydney.edu.au | W http://sydney.edu.au Sent from my plain
old desktop computer.
CRICOS 00026A
This email plus any attachments to it are confidential. Any unauthorised use
is
strictly prohibited. If you receive this email in error, please delete it and
any
attachments.
Please think of our environment and only print this e-mail if necessary.
--
The University of Stirling has been ranked in the top 12 of UK universities for
graduate employment*.
94% of our 2012 graduates were in work and/or further study within six months
of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
RequestItemServlet.java
[Dspace-tech] DSpace 4.1 upgrade - can't delete
Hi, I am not able to delete items in my (upgraded) DSpace v4.1 system using JSPUI and SOLR Discovery/Browse/Search. This was an upgrade via data migration from our existing PROD DSpace v1.6 system onto a new server running DSpace v4.1. The migration was carried out by “pg_dump”ing the data on v1.6 and restoring it to a new v4.1 instance, and then running the various upgrade scripts to upgrade the database from v1.6 to v4.1. Finally I re-indexed with “/usr/local/dspace/bin/dspace index-discovery –b” and updated the existing embargoes “/usr/local/dspace/bin/dspace migrate-embargo –a”. Everything appeared to be fine, but I have recently discovered that when attempting to delete an item I get the following postgres error: ERROR: update or delete on table item violates foreign key constraint $2 on table communities2item My investigations have led me to believe that this table is related to the old Lucene indices – is this assumption correct? Anyone know if it is used by anything else? I have experimented with “cleaning out” the old lucene indexes using the following to rebuild the empty tables: /usr/local/dspace/bin/dspace index-lucene-init -r -t -v - this does throw one error: Elapsed time: 37 secs (37295 msecs) Exception: Caching is not supported by the ItemCountDAOSolr as it is not really needed, Solr is faster! org.dspace.browse.ItemCountException: Caching is not supported by the ItemCountDAOSolr as it is not really needed, Solr is faster! - but once I have run it, I am then able to delete items from DSpace without errors ☺ Has anyone else come across this (or similar)? Are my assumptions correct? And is rebuilding empty Lucene indexes a safe way to work around this? If not, has anyone get any other suggestions? I have, unfortunately, already gone live with v4.1 before picking up on this issue, so I am obviously very keen to find a fix asap and I’m hoping this is it? Any thoughts, observations, pointers or hints would be very welcome! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 4.1 upgrade - can't delete
Thanks Hilton, http://wiki.lib.sun.ac.za/index.php/SUNScholar/Browse_Indexes/3.2#WARNING That definitely looks like the issue that I’ve come across – thanks for the pointer ☺ I guess next I’ll check if rebuilding the lucene index with empty tables as I did has just “emptied out” the same tables that are indicated for deletion on that page - (i.e. that the same tables have been operated on) . . . . (?) If rebuilding an empty index (as I’ve done) appears to be equivalent to manually dropping those tables (as suggested on the above page), does anyone have any thoughts on which might be better (i.e. kill the tables completely or just empty them)? Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: 24 August 2014 17:03 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace 4.1 upgrade - can't delete Hi Michael Perhaps these links help. http://wiki.lib.sun.ac.za/index.php/SUNScholar/Browse_Indexes/3.2#WARNING http://wiki.lib.sun.ac.za/index.php/SUNScholar/Upgrading/DSpace/Release_Notes/3.X#During_our_upgrade_from_1.8.2_to_3.2.2C_the_following_errors_were_discovered_after_applying_the_upgrade_to_our_production_server http://wiki.lib.sun.ac.za/index.php/SUNScholar/Upgrading/DSpace/Release_Notes/4.X Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://scholar.sun.ac.za http://bit.ly/goodir http://library.sun.ac.za http://za.linkedin.com/in/hiltongibson On 24 August 2014 15:20, Michael White michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk wrote: Hi, I am not able to delete items in my (upgraded) DSpace v4.1 system using JSPUI and SOLR Discovery/Browse/Search. This was an upgrade via data migration from our existing PROD DSpace v1.6 system onto a new server running DSpace v4.1. The migration was carried out by “pg_dump”ing the data on v1.6 and restoring it to a new v4.1 instance, and then running the various upgrade scripts to upgrade the database from v1.6 to v4.1. Finally I re-indexed with “/usr/local/dspace/bin/dspace index-discovery –b” and updated the existing embargoes “/usr/local/dspace/bin/dspace migrate-embargo –a”. Everything appeared to be fine, but I have recently discovered that when attempting to delete an item I get the following postgres error: ERROR: update or delete on table item violates foreign key constraint $2 on table communities2item My investigations have led me to believe that this table is related to the old Lucene indices – is this assumption correct? Anyone know if it is used by anything else? I have experimented with “cleaning out” the old lucene indexes using the following to rebuild the empty tables: /usr/local/dspace/bin/dspace index-lucene-init -r -t -v - this does throw one error: Elapsed time: 37 secs (37295 msecs) Exception: Caching is not supported by the ItemCountDAOSolr as it is not really needed, Solr is faster! org.dspace.browse.ItemCountException: Caching is not supported by the ItemCountDAOSolr as it is not really needed, Solr is faster! - but once I have run it, I am then able to delete items from DSpace without errors ☺ Has anyone else come across this (or similar)? Are my assumptions correct? And is rebuilding empty Lucene indexes a safe way to work around this? If not, has anyone get any other suggestions? I have, unfortunately, already gone live with v4.1 before picking up on this issue, so I am obviously very keen to find a fix asap and I’m hoping this is it? Any thoughts, observations, pointers or hints would be very welcome! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877tel:%2B44%20%280%29%201786%20466877 Fax: +44 (0) 1786 466880tel:%2B44%20%280%29%201786%20466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech
[Dspace-tech] Removing case sensitivity in Search/Browse Facets?
Hi, I'm using DSpace v4.1 with JSPUI. I've been trying to make the terms that appear in the Discovery Search/Browse Facets case insensitive, i.e. after doing a search for face, in the Subject Facet I was seeing both Face Perception and Face perception with different results behind each link - what I would like is for the term to only appear once (presumably with whatever case the first occurrence had) with all the relevant results appearing behind this single term in the Facet. From reading the documentation (https://wiki.duraspace.org/display/DSDOC4x/Configuration+Reference#ConfigurationReference-BrowseIndexNormalizationRuleConfiguration), it looks like all I needed to do was uncomment the following line from dspace.cfg: webui.browse.metadata.case-insensitive = true - and then rebuild the Discovery Index with: ./dspace index-discovery -b I've now done this, and the example I gave above has disappeared (hooray), but I'm still seeing occurrences of the same term with different cases in my Facets - e.g. I still see both facial composite and Facial composite with different items behind each link - I've checked some of these items, and, aside from the difference in case, the items all appear to have the term spelled the same and in the same metadata field (dc.subject). For example, in my DSpace v4.1 DEV repository, http://dspace4.stir.ac.uk/: - search for Hancock, select Hancock, Peter J B from the top of the Authors Facet, and then, in the Subject Facet you should see both facial composite and Facial composite with a different set of results behind each link . . . - search for Simpson, select Simpson, Ian from the top of the Authors facet, and then, in the Subject facet you should see both Historical ecology and historical ecology, with a different set of results behind each link . . . Is my understanding of how this should work correct? Have I missed any steps? Any reason why some terms with different cases have merged, but other haven't (e.g. in both the above examples it is the first letter that has the case difference, so perhaps the case insensitivity is ignoring the very first character)? Any comments, pointers or general wisdom from the wise would be welcome :-) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Apostrophes in email templates?
HI Andrea,
You need to escape apostrophes with another apostrophe, ie write
publication''s
Thanks - that worked perfectly ☺
Now I can change all the email templates back to the original text supplied by
my colleagues, apostrophes and all!
Many thanks for the pointer, much appreciated.
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
From: Andrea Bollini [mailto:a.boll...@cineca.it]
Sent: 17 June 2014 21:10
To: Michael White; dspace-tech@lists.sourceforge.net
Subject: R: [Dspace-tech] Apostrophes in email templates?
This is a general issue when you have text that allow the use of placeholders
{}. You need to escape apostrophes with another apostrophe, ie write
publication''s
Andrea
Inviato da Samsung Mobile
Messaggio originale
Da: Michael White
Data:17/06/2014 17:09 (GMT+01:00)
A: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net
Oggetto: [Dspace-tech] Apostrophes in email templates?
Hi,
DSpace v4.1/JSPUI.
I have been tweaking the email templates and have noticed issues when
attempting to include apostrophes in a template. There appear to be 2 issues:
1. Apostrophes do not display
2. If an apostrophe is used before the placeholders in the template, then the
placeholders are not replaced (so email is sent out with {0}, {1} etc)
So, for issue 1 for example, my template contains the sentence:
This is a permanent URL so you can use it to reference this publication and it
will be included with the publication's citation on your RMS webpage.
- but when the email arrives, it contains:
This is a permanent URL so you can use it to reference this publication and it
will be included with the publications citation on your RMS webpage.
[i.e. no apostrophe!]
I have ensured my templates are encoded in UTF-8 (without the BOM as I noted
this also caused issues) using Notepad++ and have the following in DSpace
config:
mail.charset = UTF-8
I searched the mailing lists and Jira but could find no direct reference to
issue 1, and only one reference to issue 2 from way back in 2004:
http://sourceforge.net/p/dspace/mailman/message/9304257/
- where the workaround was not to use apostrophes in email templates! :-)
Has anyone else come across this? Anyone have any thoughts on how to get this
working?
My library colleagues are in the process of redrafting all our emails and
whilst I am able to tweak them to remove apostrophes (they've all contained at
least one apostrophe to date!) in some cases this makes the wording a bit
clumsy so it would be much nicer to fix the problem at source :-)
Any pointers, thoughts, or suggestions welcome.
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
--
The University of Stirling has been ranked in the top 12 of UK universities for
graduate employment*.
94% of our 2012 graduates were in work and/or further study within six months
of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing Easy Data Exploration
http://p.sf.net/sfu/hpccsystems
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
The University of Stirling has been ranked in the top 12 of UK universities for
graduate employment*.
94% of our 2012 graduates were in work and/or further study within six months
of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing Easy Data Exploration
http://p.sf.net/sfu/hpccsystems___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists
[Dspace-tech] DSpace v4.1 JSPUI more IE v9 display issues
Hi, Working on DSpace v4.1 with the JSPUI in IE v9 I've noticed a couple more display issues that I'd really like to resolve if at all possible: 1) If you open an unfinished submission from your My DSpace page, the text is not displayed on the 3 Option buttons that appear for Opening/Viewing/Removing the item (the Description text is displayed though) - example screenshot: http://www.is.stir.ac.uk/misc/storre/DSpace4.1-Option-button-text.png - it appears OK in Firefox: http://www.is.stir.ac.uk/misc/storre/DSpace4.1-Option-button-text-firefox.png 2) The light grey hint text for the Author 2 boxes is not appearing inside the boxes - example screenshot: http://www.is.stir.ac.uk/misc/storre/DSpace4.1-Author-hint-text.png - again, it works OK in Firefox: http://www.is.stir.ac.uk/misc/storre/DSpace4.1-Author-hint-text-firefox.png We still have IE v9 widely deployed here so if anyone has any thoughts on how to resolve either of these issues they would be very welcome. Many thanks as ever, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions Find What Matters Most in Your Big Data with HPCC Systems Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. Leverages Graph Analysis for Fast Processing Easy Data Exploration http://p.sf.net/sfu/hpccsystems___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Apostrophes in email templates?
Hi,
DSpace v4.1/JSPUI.
I have been tweaking the email templates and have noticed issues when
attempting to include apostrophes in a template. There appear to be 2 issues:
1. Apostrophes do not display
2. If an apostrophe is used before the placeholders in the template, then the
placeholders are not replaced (so email is sent out with {0}, {1} etc)
So, for issue 1 for example, my template contains the sentence:
This is a permanent URL so you can use it to reference this publication and it
will be included with the publication's citation on your RMS webpage.
- but when the email arrives, it contains:
This is a permanent URL so you can use it to reference this publication and it
will be included with the publications citation on your RMS webpage.
[i.e. no apostrophe!]
I have ensured my templates are encoded in UTF-8 (without the BOM as I noted
this also caused issues) using Notepad++ and have the following in DSpace
config:
mail.charset = UTF-8
I searched the mailing lists and Jira but could find no direct reference to
issue 1, and only one reference to issue 2 from way back in 2004:
http://sourceforge.net/p/dspace/mailman/message/9304257/
- where the workaround was not to use apostrophes in email templates! :-)
Has anyone else come across this? Anyone have any thoughts on how to get this
working?
My library colleagues are in the process of redrafting all our emails and
whilst I am able to tweak them to remove apostrophes (they've all contained at
least one apostrophe to date!) in some cases this makes the wording a bit
clumsy so it would be much nicer to fix the problem at source :-)
Any pointers, thoughts, or suggestions welcome.
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
--
The University of Stirling has been ranked in the top 12 of UK universities for
graduate employment*.
94% of our 2012 graduates were in work and/or further study within six months
of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing Easy Data Exploration
http://p.sf.net/sfu/hpccsystems
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Surfacing Google Analytics in v4.1 JSPUI?
Hi, DSpace v4.1 and JSPUI. I've been having a look at Google Analytics and I'm interested in embedding Analytics data into Item View pages (or elsewhere in DSpace). I've done a bit of googling and can see a number of discussions/solutions to this from a few years ago and for older versions of DSpace (e.g. http://blog.stuartlewis.com/2009/05/29/surfacing-google-analytics-stats-in-dspace/ for DSpace v1.6 and https://wiki.duraspace.org/display/DSPACE/Google+Analytics+Statistics+in+DSpace for DSpace v1.8) but I was wondering if anyone had done anything like this more recently? And ideally in DSpace v4.n with the new JSPUI? :-) Any pointers welcome. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions Find What Matters Most in Your Big Data with HPCC Systems Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. Leverages Graph Analysis for Fast Processing Easy Data Exploration http://www.hpccsystems.com ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] dspace 4.1, JSPUI and Day input field size
Hi, I have just noticed a problem on my DSpace 4.1 DEV system (running JSPUI) with the size of the Day input field (one of the 3 part date input fields) on the Item Submission forms in Firefox, Chrome and Opera - the field is present but it is too narrow to be able to see the day value that is entered - here is a screenshot of what I'm seeing (there is a value entered in the Day field!): http://www.is.stir.ac.uk/misc/storre/DSpace4.1-Submit-Firefox-dayfield.png - the field appears wide enough if the screen is narrowed, altering the flow of the elements on the page (you can now see the value entered): http://www.is.stir.ac.uk/misc/storre/DSpace4.1-submit-Firefox-dayfield2.png The field displays perfectly in Internet Explorer but is not wide enough to view the entered data in the other browsers I have at my disposal. Is anyone else seeing this? Anyone have any suggestions how to fix it? Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 4.1, JSPUI and IE 9 menu display issue
Hi Jacob,
You'll need to comment out the filter rule on the navbar-inverse class as well
(which is the filter actually applied to the navbar).
Fantastic, that did the trick - many thanks for the pointer :-)
If you want to preserve the header gradient, and don't care about supporting
IE8, you can just add the following rule to .navbar-inverse (after commenting
out the filters):
That worked wonderfully too - cheers!
Many, many thanks for this - getting past this has made my day (and it is still
only 9 in the morning!) - your help is very much appreciated! :-)
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
-Original Message-
From: Brown, Jacob [mailto:j.h.br...@tcu.edu]
Sent: 06 May 2014 22:22
To: Michael White
Cc: dspace-tech@lists.sourceforge.net
Subject: RE: DSpace 4.1, JSPUI and IE 9 menu display issue
Hi Mike,
You'll need to comment out the filter rule on the navbar-inverse class as well
(which is the filter actually applied to the navbar).
If you want to preserve the header gradient, and don't care about supporting
IE8, you can just add the following rule to .navbar-inverse (after commenting
out the filters):
background-
image:url(data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy5
3My5vcmcvMjAwMC9zdmciIHdpZHRoPSIxMDAlIiBoZWlnaHQ9IjEwMCUiIHZpZ
XdCb3g9IjAgMCAxIDEiIHByZXNlcnZlQXNwZWN0UmF0aW89Im5vbmUiPgo8bGl
uZWFyR3JhZGllbnQgaWQ9ImcyNjciIGdyYWRpZW50VW5pdHM9InVzZXJTcGFjZ
U9uVXNlIiB4MT0iMCUiIHkxPSIwJSIgeDI9IjAlIiB5Mj0iMTAwJSI+CjxzdG9wIHN0b
3AtY29sb3I9IiMzQzNDM0MiIG9mZnNldD0iMCIvPjxzdG9wIHN0b3AtY29sb3I9Ii
MyMjIyMjIiIG9mZnNldD0iMSIvPgo8L2xpbmVhckdyYWRpZW50Pgo8cmVjdCB4
PSIwIiB5PSIwIiB3aWR0aD0iMSIgaGVpZ2h0PSIxIiBmaWxsPSJ1cmwoI2cyNjcpIiA
vPgo8L3N2Zz4=);
This rule (generated from
http://ie.microsoft.com/TESTDRIVE/Graphics/SVGGradientBackgroundMaker/
Default.html) does pretty much the same thing as the vendor-prefixed
background-image gradients.
Jacob
-Original Message-
From: Michael White [mailto:michael.wh...@stir.ac.uk]
Sent: Tuesday, May 06, 2014 6:00 AM
To: Brown, Jacob
Cc: dspace-tech@lists.sourceforge.net
Subject: RE: DSpace 4.1, JSPUI and IE 9 menu display issue
Hi Jacob,
Thanks for the pointers.
I can confirm that removing the CSS filter property for the navbar fixes
the
issue on the JSPUI demo (of course, doing so will also remove the gradient).
Could you possibly provide some more details on how you achieved this as
I've just been trying but have been unable to get it to work :-(
I tried commenting out the filter property of the navbar in both bootstrap-
theme.css and in bootstrap-theme.min.css, so I had:
.navbar {
background-image:-webkit-gradient(linear,left 0,left
100%,from(#fff),to(#f8f8f8));
background-image:-webkit-linear-gradient(top,#fff,0%,#f8f8f8,100%);
background-image:-moz-linear-gradient(top,#fff 0,#f8f8f8 100%);
background-image:linear-gradient(to bottom,#fff 0,#f8f8f8 100%);
background-repeat:repeat-x;
border-radius:4px;
/*filter:progid:DXImageTransform.Microsoft.gradient(startColorstr='#',e
ndColorstr='#fff8f8f8',GradientType=0);*/
-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px
rgba(0,0,0,0.075);
box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px
rgba(0,0,0,0.075) }
- but this didn't seem to make any difference. Looking at the source, it
appears that it is (on the homepage at least!) bootstrap-theme.min.css that
is
being used and I did manage to make some progress by adding
position:static; to the navbar definition in that file (against the
recommendations on the pages you pointed to!) - so I had:
.navbar {
position: static;
background-image:-webkit-gradient(linear,left 0,left
100%,from(#fff),to(#f8f8f8));
background-image:-webkit-linear-gradient(top,#fff,0%,#f8f8f8,100%);
background-image:-moz-linear-gradient(top,#fff 0,#f8f8f8 100%);
background-image:linear-gradient(to bottom,#fff 0,#f8f8f8 100%);
background-repeat:repeat-x;
border-radius:4px;
/*filter:progid:DXImageTransform.Microsoft.gradient(startColorstr='#',e
ndColorstr='#fff8f8f8',GradientType=0);*/
-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px
rgba(0,0,0,0.075);
box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px
rgba(0,0,0,0.075) }
- after doing this, the pop-up menus worked fine in IE v9 (hooray!) but the
top
of the page had been pushed down with a load of white space above which is
no good (boo!) - also tried position:relative and position:fixed but the
menus just went back to being broken again with these values (boo hoo!) . .
. .
I'm definitely no css aficionado (I probably know just about enough to be very
dangerous) so
Re: [Dspace-tech] DSpace 4.1, JSPUI and IE 9 menu display issue
Hi Jacob,
Thanks for the pointers.
I can confirm that removing the CSS filter property for the navbar fixes
the issue on the JSPUI demo (of course, doing so will also remove the
gradient).
Could you possibly provide some more details on how you achieved this as I've
just been trying but have been unable to get it to work :-(
I tried commenting out the filter property of the navbar in both
bootstrap-theme.css and in bootstrap-theme.min.css, so I had:
.navbar {
background-image:-webkit-gradient(linear,left 0,left
100%,from(#fff),to(#f8f8f8));
background-image:-webkit-linear-gradient(top,#fff,0%,#f8f8f8,100%);
background-image:-moz-linear-gradient(top,#fff 0,#f8f8f8 100%);
background-image:linear-gradient(to bottom,#fff 0,#f8f8f8 100%);
background-repeat:repeat-x;
border-radius:4px;
/*filter:progid:DXImageTransform.Microsoft.gradient(startColorstr='#',endColorstr='#fff8f8f8',GradientType=0);*/
-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px
rgba(0,0,0,0.075);
box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px rgba(0,0,0,0.075)
}
- but this didn't seem to make any difference. Looking at the source, it
appears that it is (on the homepage at least!) bootstrap-theme.min.css that
is being used and I did manage to make some progress by adding
position:static; to the navbar definition in that file (against the
recommendations on the pages you pointed to!) - so I had:
.navbar {
position: static;
background-image:-webkit-gradient(linear,left 0,left
100%,from(#fff),to(#f8f8f8));
background-image:-webkit-linear-gradient(top,#fff,0%,#f8f8f8,100%);
background-image:-moz-linear-gradient(top,#fff 0,#f8f8f8 100%);
background-image:linear-gradient(to bottom,#fff 0,#f8f8f8 100%);
background-repeat:repeat-x;
border-radius:4px;
/*filter:progid:DXImageTransform.Microsoft.gradient(startColorstr='#',endColorstr='#fff8f8f8',GradientType=0);*/
-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px
rgba(0,0,0,0.075);
box-shadow:inset 0 1px 0 rgba(255,255,255,0.15),0 1px 5px rgba(0,0,0,0.075)
}
- after doing this, the pop-up menus worked fine in IE v9 (hooray!) but the top
of the page had been pushed down with a load of white space above which is no
good (boo!) - also tried position:relative and position:fixed but the menus
just went back to being broken again with these values (boo hoo!) . . . .
I'm definitely no css aficionado (I probably know just about enough to be very
dangerous) so would welcome any other pointers or suggestions of stuff to hack
that may help to fix this :-)
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
-Original Message-
From: Brown, Jacob [mailto:j.h.br...@tcu.edu]
Sent: 05 May 2014 16:46
To: Michael White; dspace-tech@lists.sourceforge.net
Subject: RE: DSpace 4.1, JSPUI and IE 9 menu display issue
This seems more like a Bootstrap 3 issue (although the theme developers
could have corrected it); see these related SO questions:
http://stackoverflow.com/questions/14664948/twitter-bootstrap-button-
dropdown-not-working-in-ie9
http://stackoverflow.com/questions/13256144/z-index-issue-in-twitter-
bootstrap-header
http://stackoverflow.com/questions/13916326/z-index-issue-with-twitter-
bootstrap-dropdown-menu
I can confirm that removing the CSS filter property for the navbar fixes the
issue on the JSPUI demo (of course, doing so will also remove the gradient).
Jacob
-Original Message-
From: Michael White [mailto:michael.wh...@stir.ac.uk]
Sent: Monday, May 05, 2014 8:43 AM
To: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] DSpace 4.1, JSPUI and IE 9 menu display issue
Hi again,
Setting up a DSpace 4.1 DEV system, with the new JSPUI, I've noticed
an issue with the display of the pop-up menus in the navigation bar
when using IE v9
- it works fine on the other browsers I have at my disposal.
snip
Has anyone else seen anything like this?
I'm guessing from the lack of responses that others haven't come across this
(yet)?
I've just tested my IE v9 against http://demo.dspace.org/jspui/ and I note the
same problem (options don't appear on the pop-up menus, and pop-up
menus appear behind other elements on the page, a la
http://www.is.stir.ac.uk/misc/storre/dspace4-menu-ie9.png).
Does anyone else out there have access to IE v9? Do you see the same issue
with http://demo.dspace.org/jspui/ (or is it just me)?
I also checked the DSpace v4.x with JSPUI sites listed in
http://registry.duraspace.org/registry/dspace and saw the same issue when
accessing each of these (so this definitely doesn't look like an issue
specific to
my implementation of DSpace v4!).
Does
Re: [Dspace-tech] DSpace 4.1, JSPUI and IE 9 menu display issue
Hi again, Setting up a DSpace 4.1 DEV system, with the new JSPUI, I've noticed an issue with the display of the pop-up menus in the navigation bar when using IE v9 - it works fine on the other browsers I have at my disposal. snip Has anyone else seen anything like this? I'm guessing from the lack of responses that others haven't come across this (yet)? I've just tested my IE v9 against http://demo.dspace.org/jspui/ and I note the same problem (options don't appear on the pop-up menus, and pop-up menus appear behind other elements on the page, a la http://www.is.stir.ac.uk/misc/storre/dspace4-menu-ie9.png). Does anyone else out there have access to IE v9? Do you see the same issue with http://demo.dspace.org/jspui/ (or is it just me)? I also checked the DSpace v4.x with JSPUI sites listed in http://registry.duraspace.org/registry/dspace and saw the same issue when accessing each of these (so this definitely doesn't look like an issue specific to my implementation of DSpace v4!). Does anyone else have v4.1 with JSPUI up and running? Are you able to confirm if it works OK for you in IE v9 or not? I'm trying to get a handle on whether or not this is an issue with the specific version of IE 9 we have deployed here (v9.0.8112.16421), or if it is a more general compatibility issue between IE (v9) and the JSPUI in DSpace v4.1 . . . A brief search for information on DSpace Browser Compatibility seems to suggest this is still under discussion to some extent for v4 - https://jira.duraspace.org/i#browse/DS-1831 - so perhaps IE v9 just isn't compatible? More importantly, I need to find a way around this before we can upgrade to DSpace v4 as this version of IE 9 is currently widely deployed on staff machines here! :-( Any thoughts, observations or suggestions welcome. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: Michael White Sent: 29 April 2014 09:44 To: dspace-tech@lists.sourceforge.net Subject: DSpace 4.1, JSPUI and IE 9 menu display issue Hi, Setting up a DSpace 4.1 DEV system, with the new JSPUI, I've noticed an issue with the display of the pop-up menus in the navigation bar when using IE v9 - it works fine on the other browsers I have at my disposal. When hovering over a menu item with a pop-up menu (e.g. Sign on to:), the pop-up area appears but most of the menu items are missing and what does appear is not hyperlinked - also the menu appears behind other components on the screen - here is a screen shot showing what I mean: http://www.is.stir.ac.uk/misc/storre/dspace4-menu-ie9.png I've tried playing with Browser/Document modes, but that just made things worse! Has anyone else seen anything like this? Anyone have any ideas how to address this issue? Unfortunately IE 9 is still widely deployed here so I really need to resolve this if at all possible! Any assistance or pointers welcome. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Is your legacy SCM system holding you back? Join Perforce May 7 to find out: #149; 3 signs your SCM is hindering your productivity #149; Requirements for releasing software faster #149; Expert tips and advice for migrating your SCM now http://p.sf.net/sfu/perforce ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Switch off SOLR stats?
Hi Keiji,
This seems a bug of JSPUI, so we should change the code,
DisplayStatisticsServlet.java, but temporarily you can set
authorization.admin = true
to hide usage statistics from anonymous users in the usage-statistics.cfg.
Excellent, many thanks, that worked perfectly :-)
The stats download icons are now alway visible in JSPUI. If you want to hide
it
from anonymous users, add the if-clause to the line 262 in
dspace/webapps/jspui/display-item.jsp as follows:
Thanks again - this also worked as hoped/expected and removed the stats
download icon from the item display page(s).
For completeness, I also added a similar if-clause to the Community and
Collection homepages (community-home.jsp and collection-home.jsp) in order
to hide the stats download icon on these pages as well.
So I've now successfully turned off the SOLR stats in my DSpace 4.1 DEV
system :-)
Thank you very much for the explanation of the issue and for the proposed
solution which worked perfectly - your help is very much appreciated :-)
Kind regards,
Mike
Michael White
eLearning Liaison and Development (eLD)
Information Services
S8, Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
-Original Message-
From: zuki.ebe...@gmail.com [mailto:zuki.ebe...@gmail.com] On Behalf Of
SUZUKI Keiji
Sent: 30 April 2014 04:36
To: Michael White
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Switch off SOLR stats?
Hi Mike,
2014-04-29 20:04 GMT+09:00 Michael White michael.wh...@stir.ac.uk:
Hi,
DSpace 4.1, JSPUI . . .
I'm trying to switch off the SOLR stats links for non-admin users - I've
checked usage-statistics.cfg and see:
#View/download statistics
authorization.admin.usage=true
#Search/search result statistics
authorization.admin.search=true
#Workflow result statistics
authorization.admin.workflow=true
Now JSPUI does not support last two kind of properties and supports only
authorization.admin.usage and authorization.admin
is used as the name of the property instead.
This seems a bug of JSPUI, so we should change the code,
DisplayStatisticsServlet.java, but temporarily you can set
authorization.admin = true
to hide usage statistics from anonymous users in the usage-statistics.cfg.
- but the stats download icons are still visible, and stats are available
behind
them, even when not logged in (following several rebuilds and tomcat restarts
etc) . . .
The stats download icons are now alway visible in JSPUI. If you want to hide
it
from anonymous users, add the if-clause to the line 262 in
dspace/webapps/jspui/display-item.jsp as follows:
%
if (admin_button ||
!ConfigurationManager.getBooleanProperty(usage-statistics,
authorization.admin, true)) {
%
a class=statisticsLink btn btn-primary href=%=
request.getContextPath() %/handle/%= handle %/statisticsfmt:message
key=jsp.display-item.display-statistics//a
%
}
%
Have I missed something? or am I doing something stupid? Anyone else
successfully turned these off in DSpace 4.1/JSPUI?
Any pointers, suggestions etc welcome :-)
Cheers,
Mike
Michael White
eLearning Liaison and Development (eLD) Information Services S8,
Library University of Stirling Stirling SCOTLAND
FK9 4LA
Email: michael.wh...@stir.ac.uk
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld
--
The University of Stirling has been ranked in the top 12 of UK universities
for graduate employment*.
94% of our 2012 graduates were in work and/or further study within six
months of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
--
Accelerate Dev Cycles with Automated Cross-Browser Testing -
For FREE Instantly run your Selenium tests across 300+ browser/OS
combos. Get unparalleled scalability from the best Selenium testing
platform available.
Simple to use. Nothing to install. Get started now for free.
http://p.sf.net/sfu/SauceLabs
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette:
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Regards,
Keiji Suzuki
--
The University of Stirling has been ranked in the top 12 of UK universities for
graduate employment*.
94% of our 2012 graduates were in work and/or further study within six months
of graduation.
*The Telegraph
The University of Stirling is a charity registered in Scotland, number SC
011159.
--
Accelerate Dev Cycles
[Dspace-tech] DSpace 4.1, JSPUI and IE 9 menu display issue
Hi, Setting up a DSpace 4.1 DEV system, with the new JSPUI, I've noticed an issue with the display of the pop-up menus in the navigation bar when using IE v9 - it works fine on the other browsers I have at my disposal. When hovering over a menu item with a pop-up menu (e.g. Sign on to:), the pop-up area appears but most of the menu items are missing and what does appear is not hyperlinked - also the menu appears behind other components on the screen - here is a screen shot showing what I mean: http://www.is.stir.ac.uk/misc/storre/dspace4-menu-ie9.png I've tried playing with Browser/Document modes, but that just made things worse! Has anyone else seen anything like this? Anyone have any ideas how to address this issue? Unfortunately IE 9 is still widely deployed here so I really need to resolve this if at all possible! Any assistance or pointers welcome. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE Instantly run your Selenium tests across 300+ browser/OS combos. Get unparalleled scalability from the best Selenium testing platform available. Simple to use. Nothing to install. Get started now for free. http://p.sf.net/sfu/SauceLabs ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Switch off SOLR stats?
Hi, DSpace 4.1, JSPUI . . . I'm trying to switch off the SOLR stats links for non-admin users - I've checked usage-statistics.cfg and see: #View/download statistics authorization.admin.usage=true #Search/search result statistics authorization.admin.search=true #Workflow result statistics authorization.admin.workflow=true - but the stats download icons are still visible, and stats are available behind them, even when not logged in (following several rebuilds and tomcat restarts etc) . . . Have I missed something? or am I doing something stupid? Anyone else successfully turned these off in DSpace 4.1/JSPUI? Any pointers, suggestions etc welcome :-) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE Instantly run your Selenium tests across 300+ browser/OS combos. Get unparalleled scalability from the best Selenium testing platform available. Simple to use. Nothing to install. Get started now for free. http://p.sf.net/sfu/SauceLabs ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Unable to delete Community
for a safe option, try to run index-init with the -r and -f parameters (see -h). The reindex will take a while, depending on the size of your repo, so prepare for the downtime. Thanks for the suggestion - I will try this during our early morning at risk period tomorrow so as to minimise the impact. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 24 February 2014 10:10 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Unable to delete Community Hi Mike, for a safe option, try to run index-init with the -r and -f parameters (see -h). The reindex will take a while, depending on the size of your repo, so prepare for the downtime. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Flow-based real-time traffic analytics software. Cisco certified tool. Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports. Network behavioral analysis security monitoring. All-in-one tool. http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Invalid bitstream URLs in OAI
Hi, I also had this problem and someone kindly pointed me to this patch that will resolve the problem in v3.1 :-) https://jira.duraspace.org/i#browse/DS-1537 Hope that helps. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld Date: Mon, 3 Feb 2014 14:08:47 -0200 From: Alcides Carlos de Moraes Neto alcides.n...@gmail.com Subject: [Dspace-tech] Invalid bitstream URLs in OAI To: dspace-tech DSpace-tech@lists.sourceforge.net Message-ID: CAMLLNmnx=FmNNF3zmQc8E7MKbOO0sxmsGW9ScZLQJSqM3OTrv a...@mail.gmail.com Content-Type: text/plain; charset=iso-8859-1 Hello everyone, Someone wanting to use the OAI service of our dspace install is having problems getting the bitstreams using the mets metadata. Example: http://www2.senado.leg.br/bdsf- oai/request?verb=ListRecordsmetadataPrefix=mets If you check the bitstream url, there is a URL escape for the dash (%2F) http://www2.senado.leg.br/bdsf/bitstream/id%2F194602/3/bitstream Everything else works as expected. My Dspace is 3.1, standard install, just with a heavily customized theme in XMLUI. Ats, Alcides Carlos de Moraes Neto Sometimes I think we're alone. Sometimes I think we're not. In either case, the thought is staggering. - R. Buckminster Fuller -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121051231iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] XOAI and broken bitstream links in v3.1?
Hi, Whilst working on an XSLT crosswalk for generating uketd_dc OAI-PMH metadata I noticed a problem with the Bitstream links - I have been told that this is a bug in v3.0 and v3.1, and that it was fixed in v3.2, but, despite a search of the mailing list archives, I've not been able to find any info or discussion on this. The issue is, in my v1.6.1 PROD repository I see this in the uketd_dc OAI-PMH metadata: dc:identifier xsi:type=dcterms:URIhttps://dspace.stir.ac.uk/bitstream/1893/21/1/Marques_Thesis_Complete.pdf/dc:identifier - which is correct - however, in my v3.1 DEV system, I see this: dc:identifier xsi:type=dcterms:URIhttp://dspace3dev.stir.ac.uk:8080/bitstream/1893%2F22/1/bitstream/dc:identifier - and looking at this data in xoai format, I see this: element name=bitstream field name=nameMarques_Thesis_Complete.pdf/field field name=originalNameMarques_Thesis_Complete.pdf/field field name=formatapplication/pdf/field field name=size1414144/field field name=urlhttp://dspace3dev.stir.ac.uk:8080/bitstream/1893%2F21/1/bitstream/field field name=checksum3d48300aa3c6b10a2813882525a9125f/field field name=checksumAlgorithmMD5/field field name=sid1/field /element - which suggests the error is happening in the code that is generating the source xoai data? Can anyone provide any insights into this, or point me in the direction of any discussion on this issue. I appreciate that this issue is reported to have been fixed in v3.2 but I'm stuck with v3.1 just now due to the amount of local customisation, so I would ideally like to patch my 3.1 instance to resolve this issue if at all possible. Any suggestions, pointers or insights welcome :-) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
Hi, Please, file a new Jira issue for this: With apologies for the delay getting around to it, but I have now done this: https://jira.duraspace.org/i#browse/DS-1740 - this is my first time adding a JIRA ticket, so I hope everything is OK, but feel free to let me know or change anything if not :-) - the output is not limited to only Theses What metadata field and value(s) in DSpace specifies that the item is a thesis? My understanding is that this is in dc.type - I'm currently liaising with a number of other DSpace users that participate in the EThOS service (the primary consumers of uketd_dc metadata) as there may well be more than one value - I'm hoping though that all the different variations will, at the very least, all contain the word Thesis, so my first question is to ask if you know if it is possible to use pattern matching to carry out the filtering in xoai.xsl? I am intending to investigate this further, I just haven't got to it yet, but if anyone knows the answer it would be helpful at this stage! In terms of dc.type - I've also noted an issue with this attribute - it looks to me like any dc.type or dc.type.* attributes are being concatenated into a single dc.type attribute before the data reaches the uketd_dc crosswalk (? Please correct me if I'm wrong!) - I don't think this behaviour is correct in uketd_dc as there are a couple of qualified dc.type attributes that are mapped to their own uketd_dc elements, so I'm hoping that it will be possible to prevent this behaviour when generating uketd_dc OAI metadata (again, not had a chance to look myself yet, but will!)? Please, provide the mapping of DSpace fields to uketd_dc fields (this will be an update to uketd_dc.xsl). I am currently working on this specification, which is nearly complete, and liaising with other institutions to ensure that the specified mapping is as generic as possible and so will work for the majority of institutions out of the box - alongside this I'm also creating a uketd_dc.xsl crosswalk that implements that specification, and, once complete, hopefully the folk from EThOS will be able to validate the output for us. I'm hoping that all this will only take a couple of weeks to sort out (other work commitments allowing), but that may, of course, be a bit optimistic :-) I hope that covers where I'm currently at and what I'm hoping to achieve, but of course, if anyone has any questions, comments, or concerns (or any pointers for any of the issues noted above), or if you are interested in participating in the specification/testing of this crosswalk (and haven't been in touch so far), then please don't hesitate to get back to me. Regards, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 22 October 2013 14:59 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3 and uketd_dc OAI? Hi Mike, I could modify the stylesheet if you can test the changes. Please, file a new Jira issue for this: https://jira.duraspace.org/browse/DS On Tue, Oct 22, 2013 at 12:51 PM, Michael White michael.wh...@stir.ac.uk wrote: - the output is not limited to only Theses What metadata field and value(s) in DSpace specifies that the item is a thesis? (This will be a modification to [dspace]/config/crosswalks/oai/xoai.xml) - the supervisor (from dc.contributor.advisor) is mapping to dc.contributor instead of uketdterms:advisor - a number of other uketc_dc specific terms (e.g. qualificationlevel, qualificationname, etc) are not being included Please, provide the mapping of DSpace fields to uketd_dc fields (this will be an update to uketd_dc.xsl). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
Hi, Just a simple question. Makes sense to use uketd_dc schema for non-thesis types? My understanding is that the uketd_dc schema was specifically devised to support the exchange of metadata of eTheses only, primarily for use by the EThOS service run by the British Library here in the UK, and it includes elements to hold thesis specific information (in uketdterms elements) that aren't used for most other publication types – so my understanding is that the schema doesn’t really make sense for non-thesis types. In my email exchanges with the EThOS folk, they also say (when reviewing the incorrect uketd_dc currently being served by DSpace v3.n repositories): I’m getting the same results as you, i.e. the uketd_dc output is not limited to theses and I’m not getting any uketdterms elements - so that certainly seems to confirm that the EThOS service expects uketd_dc output to be limited to eTheses only. However, that is only my understanding so I’m happy to be corrected if anyone else on the list knows better? ☺ Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: João Melo [mailto:jm...@lyncode.com] Sent: 30 October 2013 13:08 To: Michael White Cc: heli...@centrum.sk; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3 and uketd_dc OAI? Hi Michael, My understanding is that this is in dc.type - I'm currently liaising with a number of other DSpace users that participate in the EThOS service (the primary consumers of uketd_dc metadata) as there may well be more than one value - I'm hoping though that all the different variations will, at the very least, all contain the word Thesis, so my first question is to ask if you know if it is possible to use pattern matching to carry out the filtering in xoai.xsl? I am intending to investigate this further, I just haven't got to it yet, but if anyone knows the answer it would be helpful at this stage! Just a simple question. Makes sense to use uketd_dc schema for non-thesis types? On 30 October 2013 11:51, Michael White michael.wh...@stir.ac.uk wrote: Hi, Please, file a new Jira issue for this: With apologies for the delay getting around to it, but I have now done this: https://jira.duraspace.org/i#browse/DS-1740 - this is my first time adding a JIRA ticket, so I hope everything is OK, but feel free to let me know or change anything if not :-) - the output is not limited to only Theses What metadata field and value(s) in DSpace specifies that the item is a thesis? My understanding is that this is in dc.type - I'm currently liaising with a number of other DSpace users that participate in the EThOS service (the primary consumers of uketd_dc metadata) as there may well be more than one value - I'm hoping though that all the different variations will, at the very least, all contain the word Thesis, so my first question is to ask if you know if it is possible to use pattern matching to carry out the filtering in xoai.xsl? I am intending to investigate this further, I just haven't got to it yet, but if anyone knows the answer it would be helpful at this stage! In terms of dc.type - I've also noted an issue with this attribute - it looks to me like any dc.type or dc.type.* attributes are being concatenated into a single dc.type attribute before the data reaches the uketd_dc crosswalk (? Please correct me if I'm wrong!) - I don't think this behaviour is correct in uketd_dc as there are a couple of qualified dc.type attributes that are mapped to their own uketd_dc elements, so I'm hoping that it will be possible to prevent this behaviour when generating uketd_dc OAI metadata (again, not had a chance to look myself yet, but will!)? Please, provide the mapping of DSpace fields to uketd_dc fields (this will be an update to uketd_dc.xsl). I am currently working on this specification, which is nearly complete, and liaising with other institutions to ensure that the specified mapping is as generic as possible and so will work for the majority of institutions out of the box - alongside this I'm also creating a uketd_dc.xsl crosswalk that implements that specification, and, once complete, hopefully the folk from EThOS will be able to validate the output for us. I'm hoping that all this will only take a couple of weeks to sort out (other work commitments allowing), but that may, of course, be a bit optimistic :-) I hope that covers where I'm currently at and what I'm hoping to achieve, but of course, if anyone has any questions, comments, or concerns (or any pointers for any of the issues noted above), or if you are interested in participating in the specification/testing of this crosswalk (and haven't been in touch so far), then please don't hesitate
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
Because, there are 2 possible solutions, and the solution depends on what makes sense :) Many thanks for these pointers, that's really helpful, and all makes sense (on first reading anyway) ;-) My first though is that the first approach is probably what we want in this instance, so I take a look at the example and see how far I get! Thanks again, much appreciated. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: João Melo [mailto:jm...@lyncode.com] Sent: 30 October 2013 13:44 To: Michael White Cc: heli...@centrum.sk; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3 and uketd_dc OAI? Because, there are 2 possible solutions, and the solution depends on what makes sense :) - yeh! It makes sense to make sense. 1. Filtering and Metadata Format tied This solution associates to the Format definition a Filter, so then, for this specific Schema/Format, only a subset of items would be shown. You may want to look at the following example. https://gist.github.com/lyncodev/7232812 Basically, it specifies a Filter within the Format, so then you could query the OAI interface with something like: http://hostname:port/oai/request?verb=ListRecordsmetadataPrefix=uketd_dc 2. Filtering and Metadata Format decoupled This solution decouples the Item Selection phase from the Formatting phase. It requires a 2 steps: 1 - Configure one specific set (or context) to select only Thesis items. 2 - Modify the uketd_dc format accordingly. So then it would be possible to query the OAI interface for thesis items using that format. Something like: http://hostname:port/oai/request?verb=ListRecordsset=thesismetadataPrefix=uketd_dc On 30 October 2013 13:07, João Melo jm...@lyncode.com wrote: Hi Michael, My understanding is that this is in dc.type - I'm currently liaising with a number of other DSpace users that participate in the EThOS service (the primary consumers of uketd_dc metadata) as there may well be more than one value - I'm hoping though that all the different variations will, at the very least, all contain the word Thesis, so my first question is to ask if you know if it is possible to use pattern matching to carry out the filtering in xoai.xsl? I am intending to investigate this further, I just haven't got to it yet, but if anyone knows the answer it would be helpful at this stage! Just a simple question. Makes sense to use uketd_dc schema for non-thesis types? On 30 October 2013 11:51, Michael White michael.wh...@stir.ac.uk wrote: Hi, Please, file a new Jira issue for this: With apologies for the delay getting around to it, but I have now done this: https://jira.duraspace.org/i#browse/DS-1740 - this is my first time adding a JIRA ticket, so I hope everything is OK, but feel free to let me know or change anything if not :-) - the output is not limited to only Theses What metadata field and value(s) in DSpace specifies that the item is a thesis? My understanding is that this is in dc.type - I'm currently liaising with a number of other DSpace users that participate in the EThOS service (the primary consumers of uketd_dc metadata) as there may well be more than one value - I'm hoping though that all the different variations will, at the very least, all contain the word Thesis, so my first question is to ask if you know if it is possible to use pattern matching to carry out the filtering in xoai.xsl? I am intending to investigate this further, I just haven't got to it yet, but if anyone knows the answer it would be helpful at this stage! In terms of dc.type - I've also noted an issue with this attribute - it looks to me like any dc.type or dc.type.* attributes are being concatenated into a single dc.type attribute before the data reaches the uketd_dc crosswalk (? Please correct me if I'm wrong!) - I don't think this behaviour is correct in uketd_dc as there are a couple of qualified dc.type attributes that are mapped to their own uketd_dc elements, so I'm hoping that it will be possible to prevent this behaviour when generating uketd_dc OAI metadata (again, not had a chance to look myself yet, but will!)? Please, provide the mapping of DSpace fields to uketd_dc fields (this will be an update to uketd_dc.xsl). I am currently working on this specification, which is nearly complete, and liaising with other institutions to ensure that the specified mapping is as generic as possible and so will work for the majority of institutions out of the box - alongside this I'm also creating a uketd_dc.xsl crosswalk that implements that specification, and, once complete, hopefully the folk from EThOS will be able to validate the output for us. I'm hoping that all this will only take a couple of weeks to sort out
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
Hi Paul, * EThOS does expect *only* theses to be exposed using uketd_dc via OAI-PMH * '1. Filtering and Metadata Format tied' is the preferred solution in this instance Many thanks for the confirmation/clarification - and, thanks to the fully formed example provided by João Melo (cheers!), I now have this working in my v3 DEV repository - i.e. I'm now providing (pretty good, although not yet perfect) uketd_dc for the theses only via http://dspace3.stir.ac.uk/oai/request?verb=ListRecordsmetadataPrefix=uketd_dc :-) The next problem is dis-aggregating the dc.type.* attributes - I'm about to start investigating this, but if anyone has any pointers as to where to look (is this code or configuration?) that would be very helpful. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: Needham, Paul [mailto:p.a.need...@cranfield.ac.uk] Sent: 30 October 2013 14:10 To: Michael White; João Melo Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] DSpace v3 and uketd_dc OAI? Hi Mike Just to confirm: * EThOS does expect *only* theses to be exposed using uketd_dc via OAI- PMH * '1. Filtering and Metadata Format tied' is the preferred solution in this instance Cheers Paul -Original Message- From: Michael White [mailto:michael.wh...@stir.ac.uk] Sent: 30 October 2013 13:50 To: João Melo Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3 and uketd_dc OAI? Because, there are 2 possible solutions, and the solution depends on what makes sense :) Many thanks for these pointers, that's really helpful, and all makes sense (on first reading anyway) ;-) My first though is that the first approach is probably what we want in this instance, so I take a look at the example and see how far I get! Thanks again, much appreciated. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
I was checking, looks like this functionality (multiple fields) ins't implemented in DSpace v3, it will be available for v4 - currently under development. Ah, OK, that's a shame because I was just getting excited about this as one of the institutions that provide uketd_dc are using a different field to hold the type value they want to filter on - oh well, never mind, one for the future :) Thanks for the info though - I'm learning a lot about XOAI in a very short time! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: João Melo [mailto:jm...@lyncode.com] Sent: 30 October 2013 15:47 To: Michael White Cc: Needham, Paul; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3 and uketd_dc OAI? Sorry Micheal, I was checking, looks like this functionality (multiple fields) ins't implemented in DSpace v3, it will be available for v4 - currently under development. On 30 October 2013 15:42, João Melo jm...@lyncode.commailto:jm...@lyncode.com wrote: Filter id=thesisFilter Classorg.dspace.xoai.filter.DSpaceAtLeastOneMetadataFilter/Class Parameter key=field Valuedc.type/Value Valuedc.type.other/Value /Parameter Parameter key=operator Valuecontains/Value /Parameter Parameter key=value Valuethesis/Value /Parameter /Filter On 30 October 2013 15:42, João Melo jm...@lyncode.commailto:jm...@lyncode.com wrote: Hi Micheal, you could provide multiple fields do be checked, let's say (for example): Filter id=thesisFilter Classorg.dspace.xoai.filter.DSpaceAtLeastOneMetadataFilter/Class Parameter key=field Valuedc.type/Value /Parameter Parameter key=operator Valuecontains/Value /Parameter Parameter key=value Valuethesis/Value /Parameter /Filter On 30 October 2013 14:37, Michael White michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk wrote: Hi Paul, * EThOS does expect *only* theses to be exposed using uketd_dc via OAI-PMH * '1. Filtering and Metadata Format tied' is the preferred solution in this instance Many thanks for the confirmation/clarification - and, thanks to the fully formed example provided by João Melo (cheers!), I now have this working in my v3 DEV repository - i.e. I'm now providing (pretty good, although not yet perfect) uketd_dc for the theses only via http://dspace3.stir.ac.uk/oai/request?verb=ListRecordsmetadataPrefix=uketd_dc :-) The next problem is dis-aggregating the dc.type.* attributes - I'm about to start investigating this, but if anyone has any pointers as to where to look (is this code or configuration?) that would be very helpful. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877tel:%2B44%20%280%29%201786%20466877 Fax: +44 (0) 1786 466880tel:%2B44%20%280%29%201786%20466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: Needham, Paul [mailto:p.a.need...@cranfield.ac.ukmailto:p.a.need...@cranfield.ac.uk] Sent: 30 October 2013 14:10 To: Michael White; João Melo Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] DSpace v3 and uketd_dc OAI? Hi Mike Just to confirm: * EThOS does expect *only* theses to be exposed using uketd_dc via OAI- PMH * '1. Filtering and Metadata Format tied' is the preferred solution in this instance Cheers Paul -Original Message- From: Michael White [mailto:michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk] Sent: 30 October 2013 13:50 To: João Melo Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3 and uketd_dc OAI? Because, there are 2 possible solutions, and the solution depends on what makes sense :) Many thanks for these pointers, that's really helpful, and all makes sense (on first reading anyway) ;-) My first though is that the first approach is probably
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
The next problem is dis-aggregating the dc.type.* attributes - I'm about to start investigating this, but if anyone has any pointers as to where to look (is this code or configuration?) that would be very helpful. D'oh! OK, I now officially feel stupid :-) It turns out that in ye olden days before our EThOS integration, we used to keep the Publication Type, Qualification Type, and Qualification Level in dc.type as a single, concatenated string, but, for thesis records added after the integration, these were separated out into the appropriate dc.type, dc.type.qualificationname, and dc.type.qualificationlevel attributes. So, I was expecting to see these three separate attributes in the OAI-PMH metadata, but, of course, the first records returned are our oldest, where all this data is in the single field - if I page through a few records, I come to those where this info is held in separate attributes in DSpace, and these 3 attributes do, correctly, appear in the OAI-PMH mapped to their corresponding uketd_dc terms :-) So, this is not an issue that needs to be looked into and was merely me being stupid (or, perhaps being slightly kinder, a little forgetful) :-) Apologies for the noise and any confusion or concern! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: Michael White Sent: 30 October 2013 14:37 To: 'Needham, Paul'; João Melo Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] DSpace v3 and uketd_dc OAI? Hi Paul, * EThOS does expect *only* theses to be exposed using uketd_dc via OAI-PMH * '1. Filtering and Metadata Format tied' is the preferred solution in this instance Many thanks for the confirmation/clarification - and, thanks to the fully formed example provided by João Melo (cheers!), I now have this working in my v3 DEV repository - i.e. I'm now providing (pretty good, although not yet perfect) uketd_dc for the theses only via http://dspace3.stir.ac.uk/oai/request?verb=ListRecordsmetadataPrefix=uke td_dc :-) The next problem is dis-aggregating the dc.type.* attributes - I'm about to start investigating this, but if anyone has any pointers as to where to look (is this code or configuration?) that would be very helpful. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: Needham, Paul [mailto:p.a.need...@cranfield.ac.uk] Sent: 30 October 2013 14:10 To: Michael White; João Melo Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] DSpace v3 and uketd_dc OAI? Hi Mike Just to confirm: * EThOS does expect *only* theses to be exposed using uketd_dc via OAI- PMH * '1. Filtering and Metadata Format tied' is the preferred solution in this instance Cheers Paul -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] DSpace v3 and uketd_dc OAI?
Hi, We participate in the British Library's EThOS service which harvests eTheses metadata from our DSpace repository over OAI in uketd_dc format - this has been working well in our Production system running DSpace v1.6. We are working on migrating to DSpace v3.1 and I have been testing the OAI uketd_dc output on my DSpace v3.1 DEV system but it does not appear to be producing OAI data in the correct uketd_dc format. If you compare the uketd_dc OAI output of our v1.6 PROD system (http://dspace.stir.ac.uk/oai/request?verb=ListRecordsmetadataPrefix=uketd_dc) against our v3.1 DEV system (http://dspace3.stir.ac.uk/oai/request?verb=ListRecordsmetadataPrefix=uketd_dc) a number of problems are evident: - the output is not limited to only Theses - the supervisor (from dc.contributor.advisor) is mapping to dc.contributor instead of uketdterms:advisor - a number of other uketc_dc specific terms (e.g. qualificationlevel, qualificationname, etc) are not being included I have been in contact with the EThOS folks, and they have confirmed that my DSpace v3.1 DEV system is not providing uketd_dc metadata in the correct format for them. So I'm presuming this is an issue with the uketc_dc.xsl stylesheet, but my XSLT knowledge has always been pretty basic, and these days is very rusty, so I'm loathe to start trying to dissect this to find out how it works if I don't have to! So, has anyone else come across this problem? And, I guess more importantly, has anyone got a solution? If not, any XSLT whizzes out there who would give us a hand fixing this so that the uketd_dc metadata being provided by DSpace v3.1 (and therefore presumably subsequent versions) matches the spec? Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60135991iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace v3 and uketd_dc OAI?
Hi helix84, I could modify the stylesheet if you can test the changes. Please, file a new Jira issue for this: https://jira.duraspace.org/browse/DS That's great, many thanks, and yes, happy to help with development/testing in any way I can - once I have all the required info, I'll add a new JIRA issue as requested. What metadata field and value(s) in DSpace specifies that the item is a thesis? (This will be a modification to [dspace]/config/crosswalks/oai/xoai.xml) We use Thesis or Dissertation which (from memory!) is what is specified by in the EThOS profile - I will get confirmation of this though and will include in the ticket. Please, provide the mapping of DSpace fields to uketd_dc fields (this will be an update to uketd_dc.xsl). I will find out what this mapping is and will include it in the ticket. I'll confirm once I have all the required information and the ticket has been added. Thanks again! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60135991iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] SOLR: stats-log-importer NullPointerException
email = ? with parameters: anonymous Anyone have any ideas as to why this isn’t working? Could it be because I’m importing PROD logs into a DEV system (even though it is an up to date copy of PROD)? Am I doing anything obviously wrong/stupid? Any pointers, suggestions, insights etc more than welcome as I’m a bit stuck just now :-( Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99! 1,500+ hours of tutorials including VisualStudio 2012, Windows 8, SharePoint 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack includes Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13. http://pubads.g.doubleclick.net/gampad/clk?id=58041151iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] SOLR: stats-log-importer NullPointerException
Hi helix84, I see nothing obviously wrong in what you're doing. The high-level procedure is correct. OK, thanks - always good to know that I'm on the right track at least and not doing anything obviously stupid :-) The NullPointerException happens on this line [1], which indicates that metadataStorageInfo.keySet() is null. But I don't see where metadataStorageInfo is actually being set in the whole DSpace codebase. So I don't understand it myself. OK, fair enough - I also had a quick peek at the code, but I'm not familiar enough with it to pick it apart ... And just as a sanity check, have others successfully used the stats-log-importer in v3.1 to import (old format) log files (i.e. is this a general problem, or am I just lucky)? If anyone else has any thoughts or insights, they are, of course, most welcome! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling has been ranked in the top 12 of UK universities for graduate employment*. 94% of our 2012 graduates were in work and/or further study within six months of graduation. *The Telegraph The University of Stirling is a charity registered in Scotland, number SC 011159. -- LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99! 1,500+ hours of tutorials including VisualStudio 2012, Windows 8, SharePoint 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack includes Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13. http://pubads.g.doubleclick.net/gampad/clk?id=58041151iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Request a copy and v3.1?
Hi Emilio, we have ready the 3.1 version for XMLUI Many thanks for your reply - unfortunately I'm using JSPUI so your XMLUI implementation won't help me. However, I think Request a copy is an incredibly useful feature and so it is good to know that it will be available for v3.1 XMLUI users should they wish to implement it. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: emilio lorenzo [mailto:elore...@arvo.es] Sent: 25 June 2013 21:07 To: dspace-tech@lists.sourceforge.net; Michael White Subject: Re: [Dspace-tech] Request a copy and v3.1? Hi Michael, I ignore if it is useful for you, but we have ready the 3.1 version for XMLUI, Jira DS-1585. We expect to push to the git system ending this week The jira Issue DS 1585 is the translation to XMLUI of the request copy add-on of the University of Minho (for JSPUI) . It is related to DS-830https://jira.duraspace.org/browse/DS-830 and also has some of the functionality described in DS-824https://jira.duraspace.org/browse/DS-824. Regards Emilio Lorenzo El 25/06/2013 16:04, Michael White escribió: Hi, I'm in the process of implementing a DSpace v3.1 DEV system with a view to migrating our live service from v1.6.2 once all our local customisations etc are complete in v3.1. The next task on my list is to re-implement the Request a copy add-on (https://wiki.duraspace.org/display/DSPACE/RequestCopy) which we've been using successfully in our live system since its earliest days. When we moved to v1.6.2 there wasn't a version of the add-on available for that version of DSpace, so I just mucked about with the original version of the add-on until I got it working in v1.6.2. Now I'm moving to v3.1 I note that on the Wiki page for the Addon it says: Available soon for DSpace 3. - so first question is, is anyone actively working on this, and, if so, is there an ETA for it (days, weeks, months)? If there is work on-going, it goes without saying that I'd be happy to help if I can (although I probably know just about enough to be dangerous ;-) ) If it is not on the immediate horizon, I'm happy to have a go at getting one of the earlier versions working in v3 - my first thought is just to try and get my current version of the add-on (originally for DSpace v1.3, then reworked locally for v1.6.2) working in v3.1 as it includes a number of minor tweaks to the original behaviour, but perhaps I should be starting from scratch with v3 of the Addon (intended for DSpace v1.8.2) . . . . (?) Does anyone have any experience implementing this Addon in DSpace v3(.1)? If so, did you migrate from an existing implementation or start from scratch with the latest version of the add-on? Anyone know of any good reason not to simply re-implement the version I have working in v1.6.2 in v3.1 (e.g. it won't work because of database change X that came in v1.7/8; the latest version is much better because it includes feature X, etc) . . . Just thought I'd ask before heading down a road that might take me nowhere, especially if others have already blazed a trail elsewhere that I can follow :-) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Request a copy and v3.1?
Hi, I'm in the process of implementing a DSpace v3.1 DEV system with a view to migrating our live service from v1.6.2 once all our local customisations etc are complete in v3.1. The next task on my list is to re-implement the Request a copy add-on (https://wiki.duraspace.org/display/DSPACE/RequestCopy) which we've been using successfully in our live system since its earliest days. When we moved to v1.6.2 there wasn't a version of the add-on available for that version of DSpace, so I just mucked about with the original version of the add-on until I got it working in v1.6.2. Now I'm moving to v3.1 I note that on the Wiki page for the Addon it says: Available soon for DSpace 3. - so first question is, is anyone actively working on this, and, if so, is there an ETA for it (days, weeks, months)? If there is work on-going, it goes without saying that I'd be happy to help if I can (although I probably know just about enough to be dangerous ;-) ) If it is not on the immediate horizon, I'm happy to have a go at getting one of the earlier versions working in v3 - my first thought is just to try and get my current version of the add-on (originally for DSpace v1.3, then reworked locally for v1.6.2) working in v3.1 as it includes a number of minor tweaks to the original behaviour, but perhaps I should be starting from scratch with v3 of the Addon (intended for DSpace v1.8.2) . . . . (?) Does anyone have any experience implementing this Addon in DSpace v3(.1)? If so, did you migrate from an existing implementation or start from scratch with the latest version of the add-on? Anyone know of any good reason not to simply re-implement the version I have working in v1.6.2 in v3.1 (e.g. it won't work because of database change X that came in v1.7/8; the latest version is much better because it includes feature X, etc) . . . Just thought I'd ask before heading down a road that might take me nowhere, especially if others have already blazed a trail elsewhere that I can follow :-) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Adding banner image in v3.1?
Hi, DSpace v3.1/JSPUI. I'm trying to add my own banner image(s) but I presume I must be doing something stupid or missing a step (been a while since I did this in v1.6 but I don't recall it being this hard ;-) ) . . . . I put my image(s) in: /usr/src/dspace-3.1-src-release/dspace-jspui/src/main/webapp/image - but when I rebuild dspace: mvn package ant -Dconfig=/usr/local/dspace/config/dspace.cfg update [remove old WAR files/clear cache, redeploy, restart tomcat] - the new images aren't included (broken images in my modified header-default.jsp, and if I do a 'find' for one of my images, it still only exists in this src directory) . . . I also tried with: mvn clean package - but still no joy. My modified jsps are showing up, so the system is definitely being rebuilt/redeployed, but the images don't seem to be included? Am I putting the images in the correct directory? Am I missing something/doing something stupid? Any pointers or insights welcome :) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Adding banner image in v3.1?
You need to keep your banner image inside the jspui/image/ folder Thanks, yes, I think you're saying that I can add my images to the jspui/image folder inside the compiled webapp - and I've just tried that, and yes, it does work - however, I'm going to be doing a lot of local development/customisation of the DSpace source code, so will be rebuilding constantly, so I really want my images included in the compiled webapp automatically . . . . I assume it is just a case of putting them in the correct place in the source tree, but I put them in the obvious place and it didn't seem to work. Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: jayachandra B [mailto:jayachandra1...@gmail.com] Sent: 14 June 2013 12:27 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Adding banner image in v3.1? You need to keep your banner image inside the jspui/image/ folder On Fri, Jun 14, 2013 at 4:52 PM, Michael White michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk wrote: Hi, DSpace v3.1/JSPUI. I'm trying to add my own banner image(s) but I presume I must be doing something stupid or missing a step (been a while since I did this in v1.6 but I don't recall it being this hard ;-) ) . . . . I put my image(s) in: /usr/src/dspace-3.1-src-release/dspace-jspui/src/main/webapp/image - but when I rebuild dspace: mvn package ant -Dconfig=/usr/local/dspace/config/dspace.cfg update [remove old WAR files/clear cache, redeploy, restart tomcat] - the new images aren't included (broken images in my modified header-default.jsp, and if I do a 'find' for one of my images, it still only exists in this src directory) . . . I also tried with: mvn clean package - but still no joy. My modified jsps are showing up, so the system is definitely being rebuilt/redeployed, but the images don't seem to be included? Am I putting the images in the correct directory? Am I missing something/doing something stupid? Any pointers or insights welcome :) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Regards Jayachandra -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Adding banner image in v3.1?
If you want to replace the logo, the source location is: [dspace-source]/dspace-jspui/src/main/webapp/image/dspace-blue.gif Thanks - I'm not actually replacing that image, rather I've got a modified header-default.jsp that builds a banner from a number of separate images that I've placed in [dspace-source]/dspace-jspui/src/main/webapp/image/ - so your response appears to confirm that I've put them in the right place, so it must be something else stupid that I'm doing . . . . . My images don't get copied over to [dspace]/webapps/jspui/image when I rebuild DSpace, so the issue appears to be before my webapps ever get as far as tomcat . . . . I'll continue to investigate, but if anyone else has any thoughts as to why this isn't working, they would be most welcome :-) Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 14 June 2013 12:47 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Adding banner image in v3.1? If you want to replace the logo, the source location is: [dspace-source]/dspace-jspui/src/main/webapp/image/dspace-blue.gif the installed location is [dspace]/webapps/jspui/image/dspace-blue.gif Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Adding banner image in v3.1?
Sorry, I have no idea why, I just tried and it works just fine. Are you running mvn package from [dspace-source], not from [dspace-source]/dspace/? Thanks - yes, I have been running from [dspace-source]/dspace/ - I've been investigating the usual suspects (permissions, files older than latest build etc), but no joy . . . The next thing I was going to suggest overlays, as Claudia did. That worked! I placed my images in [dspace-src]/dspace/modules/jspui/src/main/webapp/image, and then rebuilt using the same commands as before, and low and behold, images appeared - thanks Claudia :-) So, no idea why images weren't picked up when placed directly in the source, but the overlays have worked for me, so tick, and on to the next challenge! Thanks all for the help. Regards, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 14 June 2013 13:28 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Adding banner image in v3.1? On Fri, Jun 14, 2013 at 2:04 PM, Michael White michael.wh...@stir.ac.uk wrote: Thanks - I'm not actually replacing that image, rather I've got a modified header-default.jsp that builds a banner from a number of separate images that I've placed in [dspace-source]/dspace-jspui/src/main/webapp/image/ - so your response appears to confirm that I've put them in the right place, so it must be something else stupid that I'm doing . . . . . My images don't get copied over to [dspace]/webapps/jspui/image when I rebuild DSpace, so the issue appears to be before my webapps ever get as far as tomcat . . . . Sorry, I have no idea why, I just tried and it works just fine. Are you running mvn package from [dspace-source], not from [dspace-source]/dspace/? The next thing I was going to suggest overlays, as Claudia did. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Adding banner image in v3.1?
Thanks, And where did you get the information that you should run maven in [dspace-source]/dspace/ (which is not the recommended way anymore)? I've mostly been using: https://wiki.duraspace.org/display/DSDOC3x/Installation - which says (https://wiki.duraspace.org/display/DSDOC3x/Installation#Installation-Installation): 7.Build the Installation Package: As the dspace UNIX user, generate the DSpace installation package. cd [dspace-source]/dspace/ mvn package That Rebuild page looks useful (thanks!), but reading down it (very quickly!), I see (in the Full Refresh/Rebuild): 2.Open a command prompt (if you don't have one already), and cd [dspace-source]/dspace/ - this is the path that also features in all the Upgrade documentation (e.g. https://wiki.duraspace.org/display/DSDOC3x/Upgrading+From+3.0+to+3.x): 4.Build DSpace. Run the following commands to compile DSpace: cd [dspace-source]/dspace/ mvn -U clean package - so that is why I thought that was the correct path :-) Hope that helps. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 14 June 2013 14:39 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Adding banner image in v3.1? And where did you get the information that you should run maven in [dspace-source]/dspace/ (which is not the recommended way anymore)? Maybe we have some outdated documentation somewhere. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Separating application and database server?
Hi, We are currently running DSpace v1.6.2 (JSPUI) with c6300 records, all full text items, and the repository is still growing steadily . . . I'm currently planning a migration to v3.1 - until now we've been running DSpace within the library, but, as DSpace is now much more of a core system at the institution, I've brought our institutional DBAs on board in order to start mainstreaming support for DSpace here . . . The first question that I've been asked is should we be putting DSpace and Postgres on separate application and database (virtual) servers? I've had a look through the Wiki, but couldn't see any specific mention of running separate application and database servers. My gut feeling is that this is not a massive system and that separate servers is probably overkill in this instance (and it ain't broke so I'm not sure it needs fixing) - but I'm not a proper DBA so my gut feeling probably isn't enough . . . ;-) I've also heard rumours of performance issues when running postgres on a separate virtual server (in general, not specifically related to DSpace) . . . . ? So, I was just wondering what other folk do? Do you run separate servers? If yes, why? If no, why not (and what size of repositories are folk running on a single bit of kit)? Obviously if we go with a single (virtual) server, we would ensure that, at the very least, it meets the recommended DSpace Production system requirements. I'm meeting with our DBAs tomorrow to discuss all this, so any information folk can provide in relation to running on a single server or separate application and database servers would be helpful. Many thanks as ever, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- How ServiceNow helps IT people transform IT departments: 1. A cloud service to automate IT design, transition and operations 2. Dashboards that offer high-level views of enterprise services 3. A single system of record for all IT processes http://p.sf.net/sfu/servicenow-d2d-j___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Separating application and database server?
Hi, here's a recent thread on the issue that discusses things you're asking: http://dspace.2283337.n4.nabble.com/Postgres-configuration-with-DSpace-td4663937.html Many thanks for this (and others for their replies) . . . This is exactly the information I was after and have noted it all to take to my DBAs tomorrow :-) Much appreciated, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 05 June 2013 10:17 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Separating application and database server? Hi Mike, here's a recent thread on the issue that discusses things you're asking: http://dspace.2283337.n4.nabble.com/Postgres-configuration-with-DSpace-td4663937.html Pointing DSpace to use Postgres on another machine is trivial (assuming you have firewalls, vlans, DNS and routing set up properly), in dspace.cfg, change db.url to point to the appropriate server. That's all. I do not see almost any benefit in running the DB server on a separate VM if there's only the DSpace database there. OTOH, if you already have a Postgres server with other databases, adding the dspace database and having the DBA taking care of them all can be beneficial. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- How ServiceNow helps IT people transform IT departments: 1. A cloud service to automate IT design, transition and operations 2. Dashboards that offer high-level views of enterprise services 3. A single system of record for all IT processes http://p.sf.net/sfu/servicenow-d2d-j ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] DSpace v3.1 and Postgres v9?
Hi, I'm just in the process of planning a migration from DSpace v1.6.2 to v3.1 - as part of this move we are planning to upgrade as many of the underlying components as we can (as we are currently running DSpace on an OS that has just gone end of life . . ). So, having checked the docs I see that postgres 8.4 or higher seems to be the recommendation, but I was just wondering what the story is with v9? Is anyone running v3.1 on postgres v9? A search of the archives suggest one or two were trying it, but I can see no reports of anyone currently running it in production . . . ? Anyone doing it? Or know of any reason not to try it? Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace v3.1 and Postgres v9?
Hi, I answered this question here: https://wiki.duraspace.org/display/DSDOC3x/Installation?focusedCommentId=34637101#comment-34637101 Thanks for this - I was on that page, but hadn't scrolled all the way to the bottom, D'oh! :-) I shall give postgres v9 a go then and will report back! Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 03 June 2013 11:45 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace v3.1 and Postgres v9? Hi Michael, I answered this question here: https://wiki.duraspace.org/display/DSDOC3x/Installation?focusedCommentId=34637101#comment-34637101 In short - you're free to try, I wouldn't expect any problems. If you do, please report back. When we have enough confirmations, we'll add it as a recommended version. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Returning a taken task back to Pool?
Hi, We have some items in Workflow that a member of staff has taken and so they are in their Owned tasks, but this member of staff is now on holiday and so we would like to recover these items and return them to the Workflow pool so that they can be picked up by another member of staff during their absence. Is this possible? I see that I can Abort the item and return it to the original submitters personal workspace, but this is not what we want - I can't see a way to do this via the GUI (but perhaps I've just missed something?), but would be happy to poke the database directly to achieve this if anyone can provide any pointers (or fully formed SQL!). We are on DSpace v1.6.2 using JSPUI. Thanks in advance for any help or assistance. Regards, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Returning a taken task back to Pool?
Hi, before we dig into SQL, does this help? http://dspace.2283337.n4.nabble.com/Authorizations-and-Workflow-Steps-tp4656873p4656898.html Thanks for the suggestion but I don't think this addresses the problem I've got - from my reading of the above I think this is addressing the problem of how to add someone to a Workflow Group so that they can see the existing Tasks in the Workflow Pool that are visible to that Group (the solution being to get someone else already in that Group to take the Tasks and then return them to the Pool . . . )? The problem I have is that someone who is not around at the moment has taken the Task, and now I need to put it back in the Pool so that someone else in the Group can take it instead . . . Cheers, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 27 May 2013 12:40 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Returning a taken task back to Pool? Hi Michael, before we dig into SQL, does this help? http://dspace.2283337.n4.nabble.com/Authorizations-and-Workflow-Steps-tp4656873p4656898.html Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace cleanup error
Hi, if you can confirm that Brian's solution indeed works, then we can file this as a bug. OK, I’ve been investigating and testing and this approach does appear to work for me – the following cleared the primary_bitstream_id from the bundles that had primary bitstreams that were marked for deletion in the bitstream table: Update bundle set primary_bitstream_id = NULL where bundle_id in (select bundle_id from bundle, bitstream where deleted = TRUE and primary_bitstream_id = bitstream_id) Before running this (on my DEV system), following the clean up yesterday, I picked things apart to see what needed to happen. There were 16 bitstreams that caused errors during my cleanup of my DEV system yesterday – to get around these errors, I reset the deleted value for each of these to FALSE so cleanup would skip them, but I had the foresight to take a note of them, so I knew the bitstream IDs of the problem bitstreams – so, visually checking the bundle table, I could see that these were all listed in the (mostly empty) primary_bitstream_id column. I then reset the deleted value back to “TRUE” for the bitstreams in question and checked the bundles again via SQL, using the following to return bundles that had a primary bitstream that had “deleted=TRUE”: select bundle_id from bundle, bitstream where deleted = TRUE and primary_bitstream_id = bitstream_id - and, cross checking from the other side, bitstreams that had “deleted=TRUE” that were also primary bitstreams: select bitstream_id from bitstream, bundle where deleted = TRUE and primary_bitstream_id = bitstream_id As all this data seemed to cross check, I then ran the Update SQL suggested by Brian (with a couple of minor syntactic tweaks) which fixed up the problem primary_bitstream_ids in the bundle table. I then ran the cleanup script again, and it happily removed the previously problematic bitstreams (and their records in the bitstream table) – excellent! This is all with DSpace v1.6.2 on Postgres . . . Hope that helps. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: 14 March 2013 13:11 To: Ivan Masár Cc: Michael White; Brian Freels-Stendel; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace cleanup error Nope. It does not work on a new test system using DSpace 1.8.2. My bundle table has blanks for primary_bitstream_id. See attached. On 14 March 2013 13:58, helix84 heli...@centrum.skmailto:heli...@centrum.sk wrote: Michael, if you can confirm that Brian's solution indeed works, then we can file this as a bug. This problem never occurred to me. It is also possible that those items with a primary bitstream set (that wasn't cleared when they were deleted or during the cleanup run) come from an older version of DSpace, in which case we still should check for it in the cleanup code. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Hilton Gibson Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://library.sun.ac.za http://scholar.sun.ac.za http://ar1.sun.ac.za http://aj1.sun.ac.za -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace cleanup error
Hi, I get this error when doing a cleanup with -v. Error: ERROR: update or delete on table bitstream violates foreign key constraint bundle_primary_bitstream_id_fkey on table bundle Detail: Key (bitstream_id)=(67984) is still referenced from table bundle. Is there a query that can fix this and is this a bug? I've also been plagued by this error today (slightly different text, but using v1.6.2 not v1.8.2?) whilst experimenting with cleanup on my DEV system (which is an old and probably slightly mangled copy of our PROD system). I've now completed the assetstore cleanup of our DEV system, but I'm building up to doing it on our PROD system (which has 3 times as many records) so I would also be interested if there is a nice bit of SQL that can find the problem records and sort them out in one go :). The first few times I got this error, I checked our bundle2bitstream table, but there was no reference to the bitstreams in question, so I wasn't sure where the (foreign key) reference from the bundle table could be coming from . . . Being a bit of philistine, I've just been watching the output from the job with one eye, and when it fails with the above error, sorting out the bitstream record in question by simply updating the delete flag to FALSE - i.e. forcing the cleanup task to just ignore the bitstream record in question, e.g.: UPDATE bitstream SET deleted = 'FALSE' WHERE bitstream_id = 67984 - then kick off the job again. This manual intervention is not ideal though, as you say, but it has got me past the problem records. As I said, I have no idea why this error is being generated as I could find no references to the problematic bitstreams elsewhere, so it felt like a bug to me, but this is our DEV system, and I have done lots of strange things with it over the years, so anything is possible! Regards, Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- Message: 1 Date: Wed, 13 Mar 2013 12:23:41 +0200 From: Hilton Gibson hilton.gib...@gmail.commailto:hilton.gib...@gmail.com Subject: [Dspace-tech] DSpace cleanup error To: dspace-tech dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Message-ID: caav1wv6de_qybsmakw7wqsufw13hntgwqevyukwbsamhokk...@mail.gmail.commailto:caav1wv6de_qybsmakw7wqsufw13hntgwqevyukwbsamhokk...@mail.gmail.com Content-Type: text/plain; charset=utf-8 Hi All I get this error when doing a cleanup with -v. Error: ERROR: update or delete on table bitstream violates foreign key constraint bundle_primary_bitstream_id_fkey on table bundle Detail: Key (bitstream_id)=(67984) is still referenced from table bundle. The fault is in the bundle2bitstream table. This table lists the order of the bitstreams, but the bitstream listed as 0 does not appear in the bundle table as the bitstream_id. Is there a query that can fix this and is this a bug? I think there are many records like this and it would take forever to fix manually. DSpace 1.8.2 and XMLUI. -- *Hilton Gibson* Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://library.sun.ac.za http://scholar.sun.ac.za http://ar1.sun.ac.za http://aj1.sun.ac.za -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Assetstore clean-up? Advice/reassurance/gotchas?
Hi, Running DSpace v1.6.2 (JSPUI). Our DSpace server ran out of disk space unexpectedly (as we thought we had allowed for substantial growth) and I have now determined it is because of a huge amount of orphaned content in our Assetstore. Looking at our bitstream table, there are 38,488 rows but 22,287 of them are marked as deleted=true. I have determined that this orphaned content is a result of the integration between our CRIS system (Converis) and DSpace - each time a Publication record (that has full text attached and that has already been exported to DSpace) is updated in our CRIS it updates the corresponding record in DSpace - only it does this by deleting the existing record and creating a new one with the same handle, which results in the files belonging to the deleted record lying around in the Assetstore as orphaned bitstreams. So, I've been reading up in the manual, and I note the existence of the /dspace/bin/cleanup script which I believe will resolve this problem by deleting the old rows from the bitstream table and the corresponding files in the assetstore (?). However, before I run this and potentially muck everything up, I was hoping that someone could confirm that this script will do what I'm after, and that it will be able to handle such a large cleanup? And if there are any other gotchas or advice relating to this that anyone out there can offer? I'll backup the assetstore and DB before doing anything, but any advice or reassurance would be most welcome as I'm obviously nervous about running something that could, potentially, do more harm than good :-). Cheers, Mike P.S. If there is anyone else out there with an integration between Converis and DSpace, you might also want to look into this! Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester Wave(TM): Endpoint Security, Q1 2013 and remains a good choice in the endpoint security space. For insight on selecting the right partner to tackle endpoint security challenges, access the full report. http://p.sf.net/sfu/symantec-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Assetstore clean-up? Advice/reassurance/gotchas?
Many thanks helix84 (such an enigmatic nomenclature ;-) ) and Hilton for your reassuring replies, and for the -v tip . . . I now feel confident enough to give this a bash :-) Much appreciated. Mike Michael White eLearning Liaison and Development (eLD) Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.stir.ac.uk/is/staff/about/teams/aldt/#eld -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 12 March 2013 14:41 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Assetstore clean-up? Advice/reassurance/gotchas? Hi Mike, yes, the cleanup script deletes bitstreams which are marked as deleted='t'. I wouldn't have any worries about running it, it works just fine. Tip: run it with the -v parameter to see which files it's currently deleting. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- The University of Stirling is ranked in the top 50 in the world in The Times Higher Education 100 Under 50 table, which ranks the world's best 100 universities under 50 years old. The University of Stirling is a charity registered in Scotland, number SC 011159. -- Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester Wave(TM): Endpoint Security, Q1 2013 and remains a good choice in the endpoint security space. For insight on selecting the right partner to tackle endpoint security challenges, access the full report. http://p.sf.net/sfu/symantec-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Turning off SOLR stats
Hi, Our SOLR stats have been flaky for a while but have now reached the point where they are bringing our server down, so I want to turn them off completely (until I can find time to work on it and get them working properly), but this doesn't seem as simple as I hoped it would be! It was a long time ago that I set this up, so can't remember how I turned them on (and can't find anything specific in the documentation). I've tried a couple of things in dspace.cfg (e.g. commenting out solr.log.server), but, although this seems to have stopped the errors, I still see LoggerUsageEventListener lines in the logs, and the View Statistics button is still there (using JSPUI). Anyone have any pointers how to completely disable the SOLR stats (so that DSpace isn't trying to log events, and, perhaps more importantly, so that the View Statistics button disappears)? Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Turning off SOLR stats
Thanks George, so what I did to (sort of) shut them down is simply remove the button from the Community, Collection and Item pages OK - I had hoped that I could get rid of these via Configuration, but I'm guessing not :-( One problem I have is that one of our sys admins recently deleted the DSpace source code from my server (he thought he was helping to clear disk space, not realising that I have substantially customised our DSpace source code! Oh, and he deleted it from both DEV and PRODUCTION - don't ask!), so, until I have time to reconstruct my customised code I am a little handicapped in what I can do - I guess I could just update these JSPs in the expanded WAR file though (Yuck!) . . . Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -Original Message- From: George S Kozak [mailto:g...@cornell.edu] Sent: 28 November 2011 14:53 To: Michael White; DSpace-tech@lists.sourceforge.net Subject: RE: Turning off SOLR stats Michael: Our Solr Stats at Cornell University, also, began to give us troubles, so what I did to (sort of) shut them down is simply remove the button from the Community, Collection and Item pages. That way, the Solr stats run in the background but since no one is requesting any reports, the CPU usage is normal and we no longer have any problems. I am not sure if this will be of help to you or whether you are using the XMLUI or JSPUI, but I found it fairly easy in the JSPUI to remove the buttons requesting statistics and can give you the exact lines to remove, if you want. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Michael White [mailto:michael.wh...@stir.ac.uk] Sent: Monday, November 28, 2011 7:38 AM To: DSpace-tech@lists.sourceforge.net Subject: [Dspace-tech] Turning off SOLR stats Hi, Our SOLR stats have been flaky for a while but have now reached the point where they are bringing our server down, so I want to turn them off completely (until I can find time to work on it and get them working properly), but this doesn't seem as simple as I hoped it would be! It was a long time ago that I set this up, so can't remember how I turned them on (and can't find anything specific in the documentation). I've tried a couple of things in dspace.cfg (e.g. commenting out solr.log.server), but, although this seems to have stopped the errors, I still see LoggerUsageEventListener lines in the logs, and the View Statistics button is still there (using JSPUI). Anyone have any pointers how to completely disable the SOLR stats (so that DSpace isn't trying to log events, and, perhaps more importantly, so that the View Statistics button disappears)? Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Turning off SOLR stats
If you don't have the source, what you could do, in the time being, is go into your tomcat directory tomcat/webapps/jspui/ Then you can modify collection-home.jsp community-home.jsp display-item.jsp Thanks George, This is what I was hoping to avoid, but I guess it's what I'll have to do (as it doesn't seem to be possible to turn this off via config) - as I said, Yuck! ;-) Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] SolrException: Service Unavailable
Hi, Since we recently went live with v1.6.2 I've noticed a large number of the following in our logs: --- 2011-03-08 00:14:16,592 ERROR org.dspace.statistics.SolrLogger @ Service Unavailable Service Unavailable request: http://127.0.0.1:8080/solr/statistics/update org.apache.solr.common.SolrException: Service Unavailable Service Unavailable request: http://127.0.0.1:8080/solr/statistics/update at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85) at org.dspace.statistics.SolrLogger.post(SolrLogger.java:247) ... --- They occur seemingly randomly, sometimes every few minutes, and sometimes every hour or so (so possibly related to load?). SOLR stats are working fine otherwise - I can see Usage Events being successfully logged between failures, and View Statistics for items shows views and downloads being counted (but presumably not all, due to the frequent failures?). I searched the archives and found a couple of other mentions of the problem, but no hint of a solution beyond making sure your SOLR webapp is reachable (which mine appears to be generally, and access also tested from the command line with curl). Anyone have any ideas? I also wondered if the optimisations discussed here, http://atmire.com/statistics_performance.php, might fix this issue? Any assistance/pointers welcome. Cheers, Mike Michael White Research Information System (RIS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- What You Don't Know About Data Connectivity CAN Hurt You This paper provides an overview of data connectivity, details its effect on application quality, and explores various alternative solutions. http://p.sf.net/sfu/progress-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Edit Item Template Error
Hi Claudia, Are you trying this as instance admin or with a different role? I'm a member of the main Administrator group, so I assume that means I am an instance admin. Did you change any of the dspace.cfg delegation setting in this section # Authorization system configuration - Delegate ADMIN # especially #core.authorization.community-admin.collection.template-item = true #core.authorization.collection-admin.template-item = true No, I hadn't changed either of these from the installation defaults, although I note that collection-admin.template-item was false (by default?) - anyway, I tried changing this to true, and I also uncommented the community-admin.collection.template-item=true line, just to make this explicit (you never know!). Unfortunately neither of these changes appeared to have any effect :-( On a vanilla instance of 1.6.2 jspui this works fine for the instance administrator and a collection administrator (default, no delegation rules set). OK, so, as I guessed, this isn't an issue generally, so presumably has something to do with the fact that this is a migrated instance - I set up a dev 1.6.2 alongside our old live v1.4, made all our local changes and additions on 1.6 (Request a copy, home grown auth module, and a few other minor bits and pieces), and then migrated 1.4 to 1.6 by copying over the assetstore and other key directories, pgdumping the 1.4 database, deleting the 1.6 DB and copying over the 1.4 DB and running the upgrade scripts (including removing the spurious constraints) - after re-indexing, everything seemed to be working fine - this is the first major problem I've hit . . . . Does anyone have any ideas what might cause this behaviour? Any assistance very welcome! Cheers, Mike Michael White Research Information System (RIS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php Date: Fri, 11 Feb 2011 17:24:15 +0100 From: Claudia J?rgen claudia.juer...@ub.tu-dortmund.de Subject: Re: [Dspace-tech] Edit Item Template Error To: dspace-tech@lists.sourceforge.net Message-ID: 4d5562af.3060...@ub.tu-dortmund.de Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hello Michael, your values for the template item are correct, it is not in_archive, not withdrawn and got no owning collection nor a submitter. On a vanilla instance of 1.6.2 jspui this works fine for the instance administrator and a collection administrator (default, no delegation rules set). Are you trying this as instance admin or with a different role? Did you change any of the dspace.cfg delegation setting in this section # Authorization system configuration - Delegate ADMIN # especially #core.authorization.community-admin.collection.template-item = true #core.authorization.collection-admin.template-item = true Hope that helps Claudia J?rgen Am 11.02.2011 15:15, schrieb Michael White: Hi, Using JSP UI on v1.6.2 (recently migrated from v1.4.2) - I'm trying to edit Item Templates, but I'm getting an Internal Server Error whenever I click the Edit button to access an existing Item Template (all our Collections are created with templates in order to automatically populate a type attribute): -- URL Was: https://dspace.stir.ac.uk/tools/edit-item?item_id=263 -- Method: GET -- Parameters were: -- item_id: 263 Exception: java.lang.NullPointerException at org.dspace.app.util.AuthorizeUtil.authorizeWithdrawItem(AuthorizeUtil. java:590) at org.dspace.app.webui.servlet.admin.EditItemServlet.showEditForm(EditItemServlet.java:494) at org.dspace.app.webui.servlet.admin.EditItemServlet.doDSGet(EditItemSer vlet.java:167) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli cationFilterChain.java:269)etc I did a search on the DSpace tech archives but couldn't find anything - I also did a search in JIRA and turned up something that may be similar/related: https://jira.duraspace.org/browse/DS-184 NPE from Edit Collection, Item Template, Edit Authorizations - however, this appears to be related to the XMLUI, relates to v1.5 and states that the issue was fixed in v1.6 - but as I can't even get into the item template, I'm not sure this is related! I also had a poke around the database for things with item_id=263 - when I look in the item table I see: item_id submitter_id in_archive withdrawn last_modified owning_collection 263 NULL FALSE FALSE 2008-03-03 16:37:26.636+00 NULL - I don't know if this is what
[Dspace-tech] Edit Item Template Error
Hi, Using JSP UI on v1.6.2 (recently migrated from v1.4.2) - I'm trying to edit Item Templates, but I'm getting an Internal Server Error whenever I click the Edit button to access an existing Item Template (all our Collections are created with templates in order to automatically populate a type attribute): -- URL Was: https://dspace.stir.ac.uk/tools/edit-item?item_id=263 -- Method: GET -- Parameters were: -- item_id: 263 Exception: java.lang.NullPointerException at org.dspace.app.util.AuthorizeUtil.authorizeWithdrawItem(AuthorizeUtil.java:590) at org.dspace.app.webui.servlet.admin.EditItemServlet.showEditForm(EditItemServlet.java:494) at org.dspace.app.webui.servlet.admin.EditItemServlet.doDSGet(EditItemServlet.java:167) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)etc I did a search on the DSpace tech archives but couldn't find anything - I also did a search in JIRA and turned up something that may be similar/related: https://jira.duraspace.org/browse/DS-184 NPE from Edit Collection, Item Template, Edit Authorizations - however, this appears to be related to the XMLUI, relates to v1.5 and states that the issue was fixed in v1.6 - but as I can't even get into the item template, I'm not sure this is related! I also had a poke around the database for things with item_id=263 - when I look in the item table I see: item_id submitter_id in_archive withdrawn last_modified owning_collection 263 NULL FALSE FALSE 2008-03-03 16:37:26.636+00 NULL - I don't know if this is what this should look like, but it suggests to me (but I'm only guessing) that this item id does relate to a Collection (or an item template)? - and looking at the Collection table, I see that the item with the template_item_id=263 relates to the Collection in question (i.e. the one whose template I was trying to edit that caused the above error). However, if I go to the Items section in the admin interface in the jsp ui, if I enter the item_id 263 into the Internal ID search box, when I try and find the item, I get a similar Internal Server Error: -- URL Was: https://dspace.stir.ac.uk/tools/edit-item?handle=item_id=263submit=Find -- Method: GET -- Parameters were: -- handle: -- submit: Find -- item_id: 263 Exception: java.lang.NullPointerException at org.dspace.app.util.AuthorizeUtil.authorizeWithdrawItem(AuthorizeUtil.java:590) at org.dspace.app.webui.servlet.admin.EditItemServlet.showEditForm(EditItemServlet.java:494) etc - but, if I enter the handle for the collection that this item_id belongs to (as gleaned from the error when I try and edit that collections Item Template), which is 1893/213, I get (correctly) taken to a page that says: The ID you entered isnt a valid item ID. If you're trying to edit a community or collection, you need to use the communities/collections admin page. - which seems like much better behaviour, and does suggest some kind of problem with resolving the item_id for a collection (or, more like, a misunderstanding on my part as to what is actually going on here :-) )? I've also tried this with Collections copied over from v1.4.2 and new collections created in v1.6.2, but it fails in both cases. I'm guessing this isn't a general problem, otherwise I would have found other reports, so it may relate to the fact that this is a new v1.6.2 installation, and I migrated over the database from v1.4.2 (by copying over the assetstore etc, wiping the v1.6 DB, and then restoring a pgdump from v1.4 DB into the v1.6 DB and running the upgrade scripts)? Everything else (at least everything else that I've tested!) seems to be working as expected though . . . Has anyone else encountered anything like this? Anyone have any suggestions how I can fix it or work around it? I'm fairly desperate to make these changes to the Item Templates, so any assistance very gratefully accepted! Cheers, Mike Michael White Research Information System (RIS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen
Re: [Dspace-tech] SOLR import - not found error
Hi, Just to tie up this thread. I'm still getting the Not Found error. However, I'm not sure that I haven't accidentally broken something somewhere else whilst trying to fix this earlier As usual, my problems were due to a combination of factors, but the main gotcha that caught me out was that I tried to reset my SOLR stats (to clear out old data and do a fresh import from log files) by deleting the *contents* of the solr/statistics/data directory rather than deleting the directory itself. Turns out that, if the directory isn't there, SOLR will recreate it and create a nice, fresh, empty index for you - however, if you just delete the contents, SOLR sees the directory, assumes it contains stuff, and then quietly falls over when it can't find what it wants . . . So, if you are planning to reset your SOLR stats at any point, delete the data directory, not just its contents!!! Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -Original Message- From: Michael White Sent: 27 January 2011 20:38 To: 'Andrea Schweer' Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] SOLR import - not found error The usual suggestion seems to be to use 127.0.0.1 instead of localhost. Thanks Andrea, good suggestion! I've just tried it but still no joy unfortunately - I'm still getting the Not Found error. However, I'm not sure that I haven't accidentally broken something somewhere else whilst trying to fix this earlier as I've just noticed that I'm not even getting a response now from curl http://localhost/solr;, which I was earlier. So I'll need to go back through and see if I can get that working again before I give 127.0.0.1 another go. Thanks for the pointer though, here's hoping it will solve my problem :-) Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -Original Message- From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: 27 January 2011 20:17 To: dspace-tech@lists.sourceforge.net Cc: Michael White Subject: Re: [Dspace-tech] SOLR import - not found error Hi, On 28/01/11 02:19, Michael White wrote: When I run stats-log-importer (as the tomcat user that DSpace runs under) I get a Not Found error: [...] request: http://localhost/solr/statistics/update?wt=javabinversion=2.2 org.apache.solr.common.SolrException: Not Found SOLR appears to be accessible via localhost - if I curl http://localhost/solr/; from the command line, it dumps back HTML that looks like what I'd expect . . From what I've seen, accessing solr via 'localhost' can cause problems. Something related to the way 'localhost' is resolved to an IP address by the Java code. The usual suggestion seems to be to use 127.0.0.1 instead of localhost. Also, it may be a good idea to give the port as well to make solr requests bypass apache -- so 127.0.0.1:8080 or whatever port your tomcat listens to. cheers, Andrea -- Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] SOLR import - not found error
Hi, [I'm on Digest and need to fix this as a matter of urgency, so please cc me in any reply :-) ] I'm trying to import converted log files into SOLR (prior to going live with v1.6.2 tomorrow morning!) but have hit a snag. I did run this successfully a couple of months ago during set up and testing but was only running with Tomcat then and have since added Apache. I also deleted everything from the dspace/solr/statistics/data directory before doing this (hope that didn't break anything?) as I originally tested with a sample of old log files, but now want to start from scratch using all the log files copied over from my current live server. When I run stats-log-importer (as the tomcat user that DSpace runs under) I get a Not Found error: --- $ /usr/local/dspace/bin/dspace stats-log-importer -v -i /usr/local/dspace/converted-logs/dspace-conv.log -m Writing to solr server at: http://localhost/solr/statistics dspace-conv.log.153 Processing file: /usr/local/dspace/converted-logs/dspace-conv.log.153 Line:20101012110752608,view_bitstream,1156,2010-10-12T11:07:52,anonymous,193.62.3.251 ip addr = 193.62.3.251, dns name = partyboy.edgehill.ac.uk., country = United Kingdom, city = Hill Not Found Not Found request: http://localhost/solr/statistics/update?wt=javabinversion=2.2 org.apache.solr.common.SolrException: Not Found Not Found request: http://localhost/solr/statistics/update?wt=javabinversion=2.2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:63) at org.dspace.statistics.util.StatisticsImporter.load(StatisticsImporter.java:363) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:495) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:212) Processed 1 log lines - 0 entries added to solr: 0% - 1 errors: 100% - 0 search engine activity skipped: 0% About to commit data to solr...Exception: Not Found Not Found request: http://localhost/solr/statistics/update org.apache.solr.common.SolrException: Not Found Not Found request: http://localhost/solr/statistics/update at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85) at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:74) at org.dspace.statistics.util.StatisticsImporter.load(StatisticsImporter.java:389) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:495) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:212) - SOLR appears to be accessible via localhost - if I curl http://localhost/solr/; from the command line, it dumps back HTML that looks like what I'd expect . . I've checked permissions on the various directories involved and they all seem OK. I desperately need to get this working so if anyone has any suggestions/pointers etc, they would be more than welcome as I've run out of ideas . . . Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code
Re: [Dspace-tech] SOLR import - not found error
The usual suggestion seems to be to use 127.0.0.1 instead of localhost. Thanks Andrea, good suggestion! I've just tried it but still no joy unfortunately - I'm still getting the Not Found error. However, I'm not sure that I haven't accidentally broken something somewhere else whilst trying to fix this earlier as I've just noticed that I'm not even getting a response now from curl http://localhost/solr;, which I was earlier. So I'll need to go back through and see if I can get that working again before I give 127.0.0.1 another go. Thanks for the pointer though, here's hoping it will solve my problem :-) Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -Original Message- From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: 27 January 2011 20:17 To: dspace-tech@lists.sourceforge.net Cc: Michael White Subject: Re: [Dspace-tech] SOLR import - not found error Hi, On 28/01/11 02:19, Michael White wrote: When I run stats-log-importer (as the tomcat user that DSpace runs under) I get a Not Found error: [...] request: http://localhost/solr/statistics/update?wt=javabinversion=2.2 org.apache.solr.common.SolrException: Not Found SOLR appears to be accessible via localhost - if I curl http://localhost/solr/; from the command line, it dumps back HTML that looks like what I'd expect . . From what I've seen, accessing solr via 'localhost' can cause problems. Something related to the way 'localhost' is resolved to an IP address by the Java code. The usual suggestion seems to be to use 127.0.0.1 instead of localhost. Also, it may be a good idea to give the port as well to make solr requests bypass apache -- so 127.0.0.1:8080 or whatever port your tomcat listens to. cheers, Andrea -- Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] dstat statistics directory in v1.6.2?
Hi, I'm just preparing to go live with a new instance v1.6.2 (moving from v1.4) - it's all working fine but I was just attempting to regenerate all the general statistics (as we had in v1.4) and hit a minor snag. I copied all the log files across and ran stat-initial to re-create all the .dat files but note that these have been created within the log directory, rather than in a dstat directory (as happened in v1.4). Whilst this isn't a show stopper, I would rather put these .dat files in a separate directory (as there can be a lot of them), but, despite looking in dspace.cfg and dstat.cfg, I can't see a configuration option to specify where to put these files. Have I missed something? Is this location configurable? On a related note - now that I'm ready to go live, I also want to (re)generate the SOLR stats from the log files - I have some junk in here from earlier playing and testing - am I right in thinking that I can simply delete the dspace/solr/statistics/data directory in order to clear this out in preparation for regenerating the SOLR stats from scratch (using the log converter)? Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Messages.properties customisation
I'm trying to edit some items in Messages.properties (and add some new ones) for a new v1.6 development instance but I'm struggling to understand how to get my updated Messages.properties file picked up by DSpace. Thanks everyone for the thoughts and pointers - turned out to be the old chestnut, permissions :-) Poking around my install directory I discovered a few files owned by root - which made me think that I must have done a rebuild/redeploy at some point under root yesterday by mistake (rather than my dspace/tomcat user). I wasn't seeing any obvious errors or warnings when rebuilding so this wasn't immediately apparent. I chown -Red the src and install directories back to my tomcat user, and it started working like a charm - my updated Messages.properties file is now being picked up and the changes are being reflected in DSpace. Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Messages.properties customisation
Hi folks, I'm trying to edit some items in Messages.properties (and add some new ones) for a new v1.6 development instance but I'm struggling to understand how to get my updated Messages.properties file picked up by DSpace. I've done this in v1.4 before without problems, but I'm new to 1.6 and struggling to get this to work. I've been through the manual and searched the archives but nothing I'm trying is working so far - hopefully someone will be able to see what I'm doing wrong and point me in the right direction! If I'm understanding correctly, I should: - put my updated Messages.properties file here: /usr/src/dspace-1.6.2-src-release/dspace/modules/jspui/src/main/resources - cd /usr/src/dspace-1.6.2-src-release/dspace/ - run mvn package - cd /usr/src/dspace-1.6.2-src-release/dspace/target/dspace-1.6.2-build.dir - run ant -Dconfig=/usr/local/dspace/config/dspace.cfg update - stop tomcat, redeploy my WAR files, start tomcat However, after doing this, I don't see the modified text on the screen, and I'm still seeing the placeholder labels, such as ???metadata.dc.citation.peerreviewed???, all over the place (even though I've now defined these in Messages.properties). I've also tried making the changes to Messages.properties directly at /usr/src/dspace-1.6.2-src-release/dspace-api/src/main/resources/Messages.properties (and rebuilding/redeploying), but to no avail. I have successfully modified some jsps using a local copy in /usr/src/dspace-1.6.2-src-release/dspace/modules/jspui/src/main/webapp, so I know that the mvn, ant, redeploy procedure works in general. Am I doing anything obviously wrong? If not, then are there any other gotchas that I might be falling foul of? Any assistance very welcome! Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] v1.6 updating dspace.cfg?
Hi, I just installed a vanilla DSpace 1.6.2 and had it running in the most basic way (i.e. just updating the basic config with the info required to get it up and running, before the application was built using “ant fresh_install”). I had the application responding at http://dspacedev.stir.ac.uk:8080/jspui/ and was able to log on using my newly created admin account, but didn’t do anything to the system (in terms of setting up Communities and Collections etc). The next thing I tried to do was to make a minor config change (just a simple change to “dspace.name”) in order to test the process of making config changes and getting them into DSpace 1.6 . . . Unfortunately, despite banging my head against it for quite a while I’ve not been able to incorporate this simple change into DSpace :-( Following the manual, I made the change to dspace.cfg in [dspace-source]/dspace/config As the user running Tomcat, I did the following: cd /usr/src/dspace-1.6.2-src-release/dspace/target/dspace-1.6.2-build.dir ant update_configs - and expected this to update the config file in [dspace]/dspace/config, however, when I check this file, it is still the old version (i.e. doesn't contain the updated dspace.name value) . . . I see that there are 2 new files in the [dspace]/config directory – dspace.cfg.default and dspace.cfg.new, but neither of these contains the updated value for dspace.name that appears in the config file in [dspace-source]/dspace/config . . . I've checked permissions (always the first place to start ;-) ), and everything appears to be owned by my tomcat user, so I don't think that is the issue . . . Have I misunderstood the process? Or perhaps I’m doing something wrong? Any pointers, hints, or tips welcome :-) Cheers, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace as RePEc data provider
Hi Andrea, On Sun, 21 Mar 2010 12:10:04 +0100, Andrea Bollini wrote: Apologies for cross posting, I like to receive feedback on both technical aspects and user needs. At CILEA, we are exploring the opportunity to expose DSpace data to the RePEc network, Just to say that we already do this here at Stirling. Our Economics department wanted to expose their Working Papers to RePEC, so I created a PHP application (that lives outside of DSpace) that extracts the metadata directly from the DSpace database for our Economics Department Working Papers collection (https://dspace.stir.ac.uk/dspace/handle/1893/477) and re-writes it in RePEC format (ReDIF) and places it on a web server for RePEC to harvest (via http) and add to RePEC/IDEAS (http://ideas.repec.org/s/stl/stledp.html). My script runs each night, checks to see if there have been any modifications to the collection (or any items in the collections) since the last time it was checked - if there have, then the RePEC files are re-generated - RePEC checks the files during their next scheduled check, sees that they have been modified since the last time they were harvested and re-harvests them - this picks up new additions or any items that have been updated since the last harvest, but avoids anyone doing anything if nothing has changed or been added. I've set up an author name to RePEC authorID mapping (in an external file) for those authors that have a RePEC ID set up. This ensures publications are formally linked to our authors within RePEC (via the Author-Person field - http://ideas.repec.org/e/pbe71.html). I've also abstracted out the mapping from the required RePEC elements to the corresponding DSpace metadata fields (this also allows you to specify more than one DSpace field per RePEC element - if first is empty, use second etc - ideal way to deal with Creation-Date whose value can come from dc.citation.date or dc.date.issued in our case). I will admit that this was thrown together in an afternoon or two just to solve an immediate need so is very specific to our set-up and requirements (lots of hardwired stuff, single item type, so currently not very customisable or generalisable), but it has been working well for us for a couple of years. We are currently on DSpace v1.4.1 here, but I am hoping to upgrade to v1.6 over the coming months, and, as part of this, I will need to redo the RePEC integration, so I am definitely interested in the work that you are doing and would be happy to feed in our requirements and help in any way that I can. As I said, my stuff is all PHP (and pretty specific to our needs), but happy to share if this is of interest or use. Regards, Mike Michael White eLearning Developer eLearning Liaison Development (eLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php Date: Sun, 21 Mar 2010 12:10:04 +0100 From: Andrea Bollini boll...@cilea.it Subject: [Dspace-tech] DSpace as RePEc data provider To: DSpace General dspace-gene...@mit.edu,DSpace Tech dspace-tech@lists.sourceforge.net Message-ID: 4ba5fe8c.5060...@cilea.it Content-Type: text/plain; charset=ISO-8859-15 Apologies for cross posting, I like to receive feedback on both technical aspects and user needs. At CILEA, we are exploring the opportunity to expose DSpace data to the RePEc network, http://repec.org/ googling I have found some results mostly related to the dspace2redif.pl script http://ideas.repec.org/c/rpc/script/dspace2redif.html this approach is of course simpler but imho it can't fit general requirements. The RePEc metadata for the archive and the series need to be entered manually, the script needs to be slightly modified to reflect your metadata configuration (if you have changed it...) and you have of course to setup a public ftp area. Also the performance could be better because without modification the script touch all the document in your archive also if no changes are occurred. This overload your dspace instance and the RePEc network that need to harvest any time all the records. The script is good for users that already have a RePEc repository and only want to increase it with records from one or more DSpace collections. Instead, for new users, there is no help, the setup of the RePEc repository is all on their hands (it is not much hard ;-) ) but it is more complex to deploy the dspace-oai.war and send the OAI-PMH base url. So, I'm thinking of building a webapp dspace-repec that, making fully use of the dspace datastructure, could simplify the building of new RePEc repository providing the most wide support to the RePEc format (all document types, multi series, multi archive for the same dspace repository and so on). The dspace-repec webapp should implement the httpserver RePEc approach: http://ideas.repec.org/t
[Dspace-tech] Bad robot! Googlebot and Internal Server Errors
Hi, Our DSpace (v1.4.1) has recently started logging a lot of Internal Server Errors that appear to be being caused by a Googlebot. They appear to be happening like clockwork every 14 minutes and come in blocks (sometimes lasting several hours). They are all associated with the IP Address 66.249.71.176, which, when looked up, appears to be crawl-66-249-71-176.googlebot.com. The errors all have the form: 2010-02-11 11:34:07,739 WARN org.dspace.app.webui.servlet.InternalErrorServlet @ :session_id=9E40BFD899A2AA5C23E81404AF5B97A5:internal_error:-- URL Was: https://dspace.stir.ac.uk/dspace/browse-title?bottom=1893/214 -- Method: GET -- Parameters were: -- bottom: 1893/214 java.lang.ClassCastException at org.dspace.app.webui.servlet.BrowseServlet.doDSGet(BrowseServlet.java:282) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) == I have checked our robots.txt file (from /usr/src/dspace-1.4.1-source/jsp), which contains: User-agent: * Disallow: /browse-author Disallow: /items-by-author Disallow: /browse-date Disallow: /browse-subject I'm not that familiar with robots.txt, but I surmise that adding: Disallow:/browse-title - might do the trick? However, on further investigation, it appears that the googlebot is not obeying any of the rules as it appears that it is accessing other Disallowed browse interfaces - I see a lot of this kind of thing in the DSpace logs: 2010-02-11 02:09:16,746 INFO org.dspace.app.webui.servlet.BrowseServlet @ anonymous:session_id=FBC689A1F89C3B962F0D9BFEC0B4D8ED:ip_addr=66.249.71.176:browse_author:starts_with=Farkas, Jozsef Z.,results=21 - and mapping this to the Tomcat logs: 66.249.71.176 - - [11/Feb/2010:02:09:16 +] GET /dspace/browse-author?starts_with=Farkas%2C+Jozsef+Z. HTTP/1.1 200 16836 So, 2 (related?) issues here - googlebot is causing errors when it is crawling the site, and it also appears to me that the googlebot is not obeying the robots.txt file at all :-( - or am I misunderstanding anything? Given that this has only just started happening (we have had no trouble with bots or spiders in the past), I was wondering if anyone else had noticed anything like this related to the googlebot, or if anyone was aware of anything that may have changed to cause this to start happening? More importantly, rather than me randomly trying things, any bot/robots.txt experts out there able to tell me how I can stop this but still allow legitimate crawling of the site for indexing purposes? Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad robot! Googlebot and Internal Server
Thanks Dorothea, You found my favorite oldie bug! I'm guessing that item 1893/214 has been withdrawn or deleted. I must admit, I didn't think to check, but having checked it now, I see that it is actually a Collection homepage (as are the others that I checked from a random sample) - not sure why it would be trying to access a Collection homepage via browse-title . . . . ? 1.4.1 throws a fit when a crawler tries to browse a page that should begin with a withdrawn or deleted item. - or a Community or Collection homepage! At least that explains the Internal Server Errors (although it doesn't explain why it has just started happening with such regularity). I've forgotten the fix (other than upgrade to 1.4.2, in which the bug was squashed), I'm really hoping to upgrade to v1.6 later in the year, so we can limp along until then, although I would ideally like to get googlebot behaving itself better via robots.txt if I can. but it may make you feel better to know that this bug can *only* be caused by crawlers; a human being browsing your site will never encounter it. Fab - it would be good to stop it though as it is filling my mailbox up with Internal Server Error messages :) Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad robot! Googlebot and Internal Server Errors
Tom De Mulder wrote: You should also ensure that the robots.txt is available at the root of the server... ie. https://dspace.stir.ac.ukhttps://dspace.stir.ac.uk/dspace/browse-title?bottom=1893/214/robots.txt and not just https://dspace.stir.ac.ukhttps://dspace.stir.ac.uk/dspace/browse-title?bottom=1893/214/dspace/robots.txt Ah, thanks Tom. I had just tried Graham's suggestion of adding /dspace to the Disallow values, but was still getting spammed with Errors so was just wondering why it wasn't working . . . I note that my robots.txt is available at: https://dspace.stir.ac.uk/dspace/robots.txt - but not: https://dspace.stir.ac.uk/robots.txt Any pointers how to make it visible at that location? Thanks, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.ukmailto:michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ From: Graham Triggs [mailto:grahamtri...@gmail.com] Sent: 11 February 2010 15:11 To: Tom De Mulder Cc: Michael White; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Bad robot! Googlebot and Internal Server Errors On 11 February 2010 14:37, Tom De Mulder td...@cam.ac.ukmailto:td...@cam.ac.uk wrote: You should add /dspace to the start of those disallowed patterns, because your DSpace URLs start with /dspace after the hostname. You should also ensure that the robots.txt is available at the root of the server... ie. https://dspace.stir.ac.ukhttps://dspace.stir.ac.uk/dspace/browse-title?bottom=1893/214/robots.txt and not just https://dspace.stir.ac.ukhttps://dspace.stir.ac.uk/dspace/browse-title?bottom=1893/214/dspace/robots.txt G -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad robot! Googlebot and Internal Server Errors
Hi Joseph, Are you sure you want to disallow Google from crawling your browse-titles or your entire repository? I like being able to find our items on Google. Your absolutely correct, I do need Google to index the site! I was a bit fixated on simply stopping it crawling browse-titles in order to stop it spamming me with errors but on reflection, I'm guessing this browse interface is the best way to ensure Google reaches all the items . . . ? It may be that a mail rule to auto delete DSpace Internal Server errors of this kind is the way to go! Move your robots.txt like this (sorry if this is duh-obvious but I had that moment myself a few months back so no worries!): # cp [tomcat]/webapps/dspace/robots.txt [tomcat]/ROOT/robots.txt D'oh! Yup, I think I'm having a day full of senior moments ;-) Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) 3V3a, Cottrell University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -Original Message- From: Joseph Greene [mailto:joseph.gre...@ucd.ie] Sent: 11 February 2010 15:49 To: dspace-tech@lists.sourceforge.net; Michael White Subject: RE: Bad robot! Googlebot and Internal Server Errors Are you sure you want to disallow Google from crawling your browse-titles or your entire repository? I like being able to find our items on Google. Move your robots.txt like this (sorry if this is duh-obvious but I had that moment myself a few months back so no worries!): # cp [tomcat]/webapps/dspace/robots.txt [tomcat]/ROOT/robots.txt I've been getting a similar one, related to collection pages' handles -- URL Was: http://irserver.ucd.ie/dspace/browse-title?top=10197/853 -- Method: GET -- Parameters were: -- top: 10197/853 Bad robot indeed! Joseph Greene Institutional Repository Project Manager 325 James Joyce Library University College Dublin Belfield, Dublin 4 353 (0)1 716 7398 joseph.gre...@ucd.ie http://irserver.ucd.ie/dspace/ Message: 1 Date: Thu, 11 Feb 2010 12:30:04 + From: Michael White michael.wh...@stir.ac.uk Subject: [Dspace-tech] Bad robot! Googlebot and Internal Server Errors To: dspace-tech@lists.sourceforge.net dspace-tech@lists.sourceforge.net Message-ID: 7c43cb6f3460394f9b5236c0f68d7b6a5d6baa4...@exch2007.ad.stir.ac.uk Content-Type: text/plain; charset=us-ascii Hi, Our DSpace (v1.4.1) has recently started logging a lot of Internal Server Errors that appear to be being caused by a Googlebot. They appear to be happening like clockwork every 14 minutes and come in blocks (sometimes lasting several hours). They are all associated with the IP Address 66.249.71.176, which, when looked up, appears to be crawl-66-249-71-176.googlebot.com. The errors all have the form: 2010-02-11 11:34:07,739 WARN org.dspace.app.webui.servlet.InternalErrorServlet @ :session_id=9E40BFD899A2AA5C23E81404AF5B97A5:internal_error:-- URL Was: https://dspace.stir.ac.uk/dspace/browse-title?bottom=1893/214 -- Method: GET -- Parameters were: -- bottom: 1893/214 java.lang.ClassCastException at org.dspace.app.webui.servlet.BrowseServlet.doDSGet(BrowseServlet.java:282) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java :151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) == I have checked our robots.txt file (from /usr/src/dspace-1.4.1-source/jsp), which contains: User-agent: * Disallow: /browse-author Disallow: /items-by-author Disallow: /browse-date Disallow: /browse-subject I'm not that familiar with robots.txt, but I surmise that adding: Disallow:/browse-title - might do the trick? However, on further investigation, it appears that the googlebot is not obeying any of the rules as it appears that it is accessing other Disallowed browse interfaces - I see a lot of this kind of thing in the DSpace logs: 2010-02-11 02:09:16,746 INFO org.dspace.app.webui.servlet.BrowseServlet @ anonymous:session_id=FBC689A1F89C3B962F0D9BFEC0B4D8ED:ip_addr=66.249.71.176: browse_author:starts_with=Farkas, Jozsef Z.,results=21 - and mapping this to the Tomcat logs: 66.249.71.176 - - [11/Feb/2010:02:09:16 +] GET /dspace/browse-author?starts_with=Farkas%2C+Jozsef+Z. HTTP/1.1 200 16836 So, 2 (related?) issues here - googlebot is causing errors when it is crawling the site, and it also appears to me that the googlebot is not obeying the robots.txt file at all :-( - or am I misunderstanding anything? Given that this has only just started happening (we have had no trouble with bots or spiders in the past), I was wondering if anyone else had noticed anything like this related to the googlebot, or if anyone was aware of anything that may have changed to cause this to start happening? More importantly, rather than
Re: [Dspace-tech] Unplanned user access
Hi Nigel, You wrote: While experimenting with groups and restricting user access to various collections I noted that it is possible to log out the system then attempt to access an item in a collection which is not normally publicly accessible. The system will indicated that the user that created the item is logged in one instance and in another similar experiment a user who was made part of a group with the required access rights will then appear as logged on thus allowing the unprivileged user access to the item. Has anyone encountered this before?? Not sure if you got a response to this as I've been off for a while so doing a very high speed trawl through a couple of weeks worth of various mailing lists . . . Anyway, this may or may not be related, but one thing that still catches me out occasionally is the caching of DSpace pages - we have an embargo feature implemented that only allows admins access to embargoed items. If I log on as Admin, access a restricted item's Simple Metadata page (from where I can open the item), log out, then revisit the item display page I find that is says that I'm still logged on (my email address shows in the top left even though I've logged out and the link to the item is still displayed) - however, this is just a cached version of the page, and if I attempt to open the item, I get (correctly) taken to our You can't access this item but you can request it from the original depositor page . . . Whenever I encounter something like this (appearing to be logged on when I don't think I am, or vice versa), I use Ctrl-refresh (hold down the Ctrl key whilst clicking the browser refresh) and that forces the page to completely reload (rather than using the cached version). As I say, may not be related to what you're experiencing, but thought I'd mention it just in case :-) Regards, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling (a charity registered in Scotland, number SC 011159) is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Unplanned user access
Hi Nigel, my concern is that unprivileged users accessing the item form the outside will in certain cases get access to restricted content In my experience I don't think this can happen - even if I'm looking at a cached version of a page that seems to suggest I'm logged on when I'm not, as soon as I click to try and access protected content, the authentication/authorisation bits of DSpace kick in and start looking for a valid authentication context - as this context isn't actually there (despite what the cached version of the page is telling me), I can't get access to the protected content . . . and see themselves logged in as a privileged user... Again, I don't *think* this can happen - as Christophe pointed out, it's not DSpace that is serving a cached version of the page, but the browser reusing a locally cached version - so a user will only see themselves logged on if they (or someone else) has previously logged on to the system, and then logged off again, in the same browser session . . . I've certainly not heard of anything like the scenarios you describe actually happening - the problems I hear about are usually the other way around - I've had numerous enquiries from our workflow staff relating to things like the Edit button not being visible on an item view page - these are always problems relating to a cached version of the item view page - they access an item page, then subsequently log on and go back to that page, but don't get access to the admin features (the give away is always the absence of the Logged in as message). Hope that helps. Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling (a charity registered in Scotland, number SC 011159) is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Indexing of scanned PDFs
Thanks guys, (I'm on v1.4.1 here for our main repository). Your right - I only tried index-all from the command line earlier when I was trying to figure out why this wasn't working - apologies, an example of brain freeze!! I had a quiet D'oh moment when someone mentioned filter-media :-) I tried filter-media from the command line and it did indeed bomb out fairly early on due to a protected PDF/bouncy castle type error which is presumably why the cron filter-media wasn't doing its' job. I dropped the bouncy castle PDF jars into the lib directory (copied over from a v1.4.2 repo I'm also running), re-ran filter-media and that seems to have done the trick - my PDF has now been filtered and indexed and can be search from within DSpace :-). Interestingly I did still get a couple of errors, but these didn't stop the filter-media process as was the case previously (I don't know if this is because of the new jars or if these are less serious errors than the one that previously caused filter-media to bomb out) - just for reference, these are the errors I'm seeing: ERROR filtering, skipping bitstream #364 java.util.NoSuchElementException java.util.NoSuchElementException at java.util.AbstractList$Itr.next(AbstractList.java:426) at org.textmining.text.extraction.WordExtractor.extractText(WordExtractor.j ava:150) at org.dspace.app.mediafilter.WordFilter.getDestinationStream(WordFilter.ja va:97) at org.dspace.app.mediafilter.MediaFilter.processBitstream(MediaFilter.java :155) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilte rManager.java:327) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterMana ger.java:296) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilt erManager.java:266) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(Media FilterManager.java:234) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.ja va:185) ERROR filtering, skipping bitstream #169 java.io.IOException: Error decrypting document, details: Error: The supplied password does not match either the owner or user password in the document. java.io.IOException: Error decrypting document, details: Error: The supplied password does not match either the owner or user password in the document. at org.pdfbox.util.PDFTextStripper.writeText(PDFTextStripper.java:208) at org.pdfbox.util.PDFTextStripper.getText(PDFTextStripper.java:149) at org.dspace.app.mediafilter.PDFFilter.getDestinationStream(PDFFilter.java :110) at org.dspace.app.mediafilter.MediaFilter.processBitstream(MediaFilter.java :155) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilte rManager.java:327) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterMana ger.java:296) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilt erManager.java:266) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(Media FilterManager.java:234) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.ja va:185) Thanks again for all the useful advice and pointers, and for helping me to sort this out (and getting me past my brain freeze!). Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling (a charity registered in Scotland, number SCO11159) is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Implicit authentication issues . . .
Hi Simon,
You wrote:
It might be worthwhile, at least as a workaround, to change the code
to attempt an implicit auth at the beginning of the request rather
than waiting for it to fail at the end. Something like this:
In DSpaceServlet.processRequest(), after the lines:
// Obtain a context - either create one, or get the one created by
// an authentication filter
context = UIUtil.obtainContext(request);
insert (copied from Authenticate.java):
if (AuthenticationManager.authenticateImplicit(context, null,
null,
null, request) == AuthenticationMethod.SUCCESS)
{
Authenticate.loggedIn(context, request,
context.getCurrentUser());
log.info(LogManager.getHeader(context, login,
type=implicit));
}
Which should, if my thinking is correct, set up the implicitly
authenticated user in the context before any of the actual request is
processed.
I should stress that I have not tested this and so it may not work,
but it's a problem we're about to hit here because we're currently
implementing an auth filter for the university's SSO system. So I
almost certainly *will* be testing this before the week is out.
Good thinking :-) I've just tried this, and whilst I haven't tested
extensively, it appears to work brilliantly, so thanks a million! I am,
officially, a happy bunny . . . . :-)
Now the last problem I have to solve is to capture and embed the
originally requested URL into the login form so that I can provide a
link to our portal SSO system (along with the original URL) to
authenticate un-authenticated users and then enable our portal to
redirect them back to the original URL - I do recall seeing the original
url being put into a session variable when I was perusing the
authentication code the other day, but if anyone has any pointers that
will save me digging through the code and hacking (fairly) aimlessly for
the rest of the afternoon, they would be more than welcome :-)
Cheers,
Mike
Michael White
eLearning Developer
Centre for eLearning Development (CeLD)
S7, The Library
University of Stirling
Stirling SCOTLAND
FK9 4LA
Email: [EMAIL PROTECTED]
Tel: +44 (0) 1786 466877
Fax: +44 (0) 1786 466880
http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/
--
The University of Stirling (a charity registered in Scotland, number
SCO11159) is a university established in Scotland by charter at Stirling,
FK9 4LA. Privileged/Confidential Information may be contained in this
message. If you are not the addressee indicated in this message (or
responsible for delivery of the message to such person), you may not
disclose, copy or deliver this message to anyone and any action taken or
omitted to be taken in reliance on it, is prohibited and may be unlawful.
In such case, you should destroy this message and kindly notify the sender
by reply email. Please advise immediately if you or your employer do not
consent to Internet email for messages of this kind.
-
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference
Don't miss this year's exciting event. There's still time to save $100.
Use priority code J8TL2D2.
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Implicit authentication issues . . .
authentication succeeds and returns true, but then DspaceServlet simply logs the exception (which happened before the user had authenticated, hence no user ID, but the logging call contains the up-to-date context with the user's email address) and then redirects to the Authorisation Required page . . . . All the above comes with the caveat that I am not at one with the DSpace code so could quite easily have misunderstood what is going on, so if that is the case, please feel free to correct me. I've tried a couple of (fairly random) hacks in various places to try and get the request re-routed back to the original URL, but I've had no joy :-(. The academic that I've implemented this repository for is doing a demo to the University community on May 8th, so I'm obviously very keen to try and fix this before then! If there is anyone out there who may be able to help, it would be very much appreciated!! Many thanks, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling (a charity registered in Scotland, number SCO11159) is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Implicit authentication issues . . .
Hi, I have integrated (one of) our DSpace instances (running v1.4.2) with our (home grown) portal authentication by creating an implicit authentication class that checks for our portal authentication cookies, and if they are there (and valid), it creates a DSpace authentication context for the user (creating an ePerson record on the fly if necessary) - it works pretty well, but I have 2 problems I can't get to the bottom of and wondered if anyone had any pointers etc. Problem 1: === If a user logs in to our portal and then accesses DSpace and clicks My DSpace, the authentication class kicks in and they end up at their My DSpace page . . . Fine. The bitstreams in DSpace are protected by a READ policy that only allows members of the group STIR_USERS to get access (and all new portal authenticated ePersons are automatically added to this group) - if a user has a DSpace authentication context in place (i.e. it says Logged in as at the top left), the user can access protected bitstreams no problem. Fine. However, if a user logs on to our portal, and then accesses DSpace (so not actually logged on to DSpace at this point but portal auth cookies in place), the first time they try to access a bitstream they get the page Authorisation Required - however, when presented with the Authorisation Required page, it appears that they have been authenticated because the logged in as message has appeared, and hitting refresh brings up the required bitstream (and subsequent access to bitstreams works fine). So it looks like the authentication class is being correctly called when they try to access the bitstream, and the authentication context is being set up, but for some reason I can't fathom, they don't get access to the bitstream but instead get redirected to the Authorisation Required screen . . . The logs give me this: 2008-03-28 16:09:12,594 INFO org.dspace.eperson.StirPortalAuthentication @ anonymous:session_id=1C92899D8684656C55C3EE88796A86CF:ip_addr=139.153.92 .71:login:type=StirPortalAuthentication 2008-03-28 16:09:12,594 INFO org.dspace.app.webui.util.Authenticate @ [EMAIL PROTECTED]:session_id=1C92899D8684656C55C3EE88796A86CF:ip_addr=139.1 53.92.71:login:type=implicit 2008-03-28 16:09:12,594 INFO org.dspace.app.webui.servlet.DSpaceServlet @ [EMAIL PROTECTED]:session_id=1C92899D8684656C55C3EE88796A86CF:ip_addr=139.1 53.92.71:authorize_error:org.dspace.authorize.AuthorizeException: Authorization denied for action READ on BITSTREAM:232 by user 0 - which seems to suggest some kind of problem - it recognises me as [EMAIL PROTECTED] but describes me as user 0. If I hit refresh, the item appears and the log shows the next line as: 2008-03-28 16:09:16,605 INFO org.dspace.app.webui.servlet.BitstreamServlet @ [EMAIL PROTECTED]:session_id=1C92899D8684656C55C3EE88796A86CF:ip_addr=139.1 53.92.71:view_bitstream:bitstream_id=232 Has anyone else ever seen this kind of behaviour with an implicit authentication class? Anyone have any idea why this may be happening? Am I doing something stupid with permissions? Any ideas where in the code I can dig about to learn more about what is happening, or any code hack suggestions to make this work the way I think it should? Problem 2: === Portal authentication is part of an authentication stack with normal authentication below (so external users can create accounts if needs be) - if a user who has NOT logged on to our portal attempts to access a bitstream the implicit authentication fails (correctly), and they are routed to the normal DSpace logon page - I've added a link to this page for our local users which goes to our portal logon page with a redirect back to the DSpace homepage - I would like, however, for this redirect to take the user back to whatever page/bitstream they were trying to access. So, is there anyway to pick up the URL of the page they were trying to access (where the authentication was required) from within the logon JSP page so that I can embed this in the link to our portal logon page? Another possibility is to remove the normal authentication class altogether (understanding that this means no external users can use this instance of DSpace) and have the portal authentication class automatically route them to our portal logon (along with an appropriate redirection URL back to DSpace) if the implicit authentication fails - is this doable? If so, anyone got any pointers on how best to achieve it? Thanks in advance for any suggestions/pointers anyone may have (and to anyone else who bothered to read to the end of this rather wordy request for help!). Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling (a charity registered in Scotland, number
Re: [Dspace-tech] Is the add-on for reprint request available for DSpace 1.4.2 ?
Hi Satya, The author of the add-on may have more up to date information, but when I moved to v1.4.1 there wasn't an up to date version of the add-on (just the v1.3 version). However, by simply analysing the contents of the patch, I was able to determine the code changes that it was applying to the files you mention and I was able to locate the corresponding places in the v1.4.1 versions of the appropriate files and add in the new code. This was a relatively simple task and the request a copy addon has been working fine for us in v1.4.1. Obviously, I tried this on a development system before applying to our production system (and of course I backed up the files that I changed, just in case!). Happy to provide you with v1.4.1 copies of the updated files if that would be helpful, but I don't know if these have changed between v1.4.1 and v1.4.2. So you may not be able to drop these files in as is, but they may help to identify the required changes to the v1.4.2 versions of the files . . . . . Regards, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -Original Message- Message: 3 Date: Thu, 25 Oct 2007 17:36:13 +0530 From: Satya Ranjan Sahu [EMAIL PROTECTED] Subject: [Dspace-tech] Is the add-on for reprint request available for DSpace 1.4.2 ? To: DSpace dspace-tech@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=iso-8859-1 Dear All, Is the add-on for reprint request available for DSpace 1.4.2 ? I downloaded request-copy-1.1 and found it is suitable for Dspace 1.3.2. The ItemTag.java BitstreamServlet.java are matches with DSpace1.3.2 not 1.4.2. If new version of this add-on is available please let me know. Till getting the new version of the add-on, I want to use Recommend this item option for Reprint Request. I want by default submitters name email come from database in the text field Name of recipient: and E-mail of recipient*: Thanking you With regards Satya Satya Ranjan Sahu National Information Centre for Marine Sciences National Institute of Oceanography Dona Paula, Goa - 403 004 Phone: 0832-2450370 (O) -- -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now http://get.splunk.com/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem editing News
Hi, Just an update on this for the record . . . 2007/9/28, Michael White [EMAIL PROTECTED]: Hi, I'm having problems using the Edit News function in the admin interface - when I click Edit News I'm getting the Internal Server Error detailed below. This is working fine on my DEV system (both production and DEV are v1.4.1). Turned out to be a full disk on the DSpace server!! Should have thought of that earlier :-) Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Problem editing News
Hi, I'm having problems using the Edit News function in the admin interface - when I click Edit News I'm getting the Internal Server Error detailed below. This is working fine on my DEV system (both production and DEV are v1.4.1). I don't think I've tried editing the news since we upgraded from v1.3.2 if that info is relevant. Any insights or pointers welcome! Cheers, Mike P.S. I'm on Digest, so if anyone has any suggestions, I'd appreciate being cc'd :-) -- -- URL Was: https://dspace.stir.ac.uk/dspace/dspace-admin/news-edit -- Method: GET -- Parameters were: Exception: java.lang.ClassNotFoundException: org.apache.jsp.news_0002dmain_jsp at org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:161) at org.apache.jasper.servlet.JasperLoader.loadClass(JasperLoader.java:83) at org.apache.jasper.JspCompilationContext.load(JspCompilationContext.java: 451) at org.apache.jasper.servlet.JspServletWrapper.getServlet(JspServletWrapper .java:102) at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.ja va:147) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:240) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:187) at javax.servlet.http.HttpServlet.service(HttpServlet.java:853) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatc her.java:627) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDisp atcher.java:382) at org.apache.catalina.core.ApplicationDispatcher.access$000(ApplicationDis patcher.java:66) at org.apache.catalina.core.ApplicationDispatcher$PrivilegedForward.run(App licationDispatcher.java:81) at java.security.AccessController.doPrivileged(Native Method) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispat cher.java:298) at org.dspace.app.webui.util.JSPManager.showJSP(JSPManager.java:91) at org.dspace.app.webui.servlet.admin.NewsEditServlet.doDSGet(NewsEditServl et.java:71) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet. java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:740) at javax.servlet.http.HttpServlet.service(HttpServlet.java:853) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:200) at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFi lterChain.java:51) at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterC hain.java:129) at java.security.AccessController.doPrivileged(Native Method) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:125) at org.dspace.app.webui.filter.AdminOnlyFilter.doFilter(AdminOnlyFilter.jav a:103) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:166) at org.apache.catalina.core.ApplicationFilterChain.access$000(ApplicationFi lterChain.java:51) at org.apache.catalina.core.ApplicationFilterChain$1.run(ApplicationFilterC hain.java:129) at java.security.AccessController.doPrivileged(Native Method) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:125) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValv e.java:209) etc, etc . . . . Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
Thanks Graham, Can you try upgrading to a new version of Tomcat? I'll put this on my to do list, but it may be a couple of (or maybe even a few!) weeks before I get around to it as I've a number of other projects on the go at the moment :-) Once I do though, I'll try this again and let the list know if it fixed the issue (or not!). Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -Original Message- From: Graham Triggs [mailto:[EMAIL PROTECTED] Sent: 07 June 2007 14:59 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Accented char in filename problem On Wed, 2007-06-06 at 14:16 +0100, Michael White wrote: a) If so, what version? 4.1.31 I may have misinterpreted the information I saw about Tomcat. It's possible that the bug was only filed against 4.0.4, not actually fixed in that release. The bug appears to have been closed on the 16th Nov 2004 - that would be 2 months after version 4.1.31 was released. Can you try upgrading to a new version of Tomcat? If you have to stick with the 4.x series, you could try 4.1.36, released earlier this year: http://www.apache.org/dist/tomcat/tomcat-4/v4.1.36/bin/ G -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
Thanks Stuart, 2) Add another copy of the bitstream to the item, without the accented char in the filename, using the Add Bitstream functionality and Remove the bitstream that has the dodgy title - not sure though if the Remove function will also fail because of the accented char(?) To me, this seems the best option. The old file should delete cleanly as I suspect (although haven't looked) that it uses its ID rather than its filename to identify it in the delete request. I can confirm that this is what I did in the end - I had a play around on my DEV system (with a file with an accented char in the filename) and was able to delete and replace the offending bitstream without problems - the hardest part was working out how to find a copy of the offending file in the asset store! I managed to pick my way through the database and track it down though. Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Accented char in filename problem
Hi Graham, 1) Is http://dspace.stir.ac.uk running Tomcat? Yes. a) If so, what version? 4.1.31 2) Can it be confirmed absolutely that the URIEncoding option is set correctly in Tomcat's server.xml? Hmm, I took a look and it didn't in fact, appear to be defined at all in server.xml, so I added it - not an expert so can't guarantee that is set correctly! Connector className=org.apache.ajp.tomcat4.Ajp13Connector port=8009 minProcessors=5 maxProcessors=75 acceptCount=10 debug=0 address=127.0.0.1 URIEncoding=UTF-8 / Anyway, restarted Tomcat and then did an upload of a dummy file with an accented char in the filename (on my DEV system) - unfortunately it still doesn't work. On the Simple Item View page (https://dspace3.stir.ac.uk/dspace/handle/123456789/89), the URL appears as: https://dspace3.stir.ac.uk/dspace/bitstream/123456789/89/1/Roberto%20Ros %c3%a0%20dummy.pdf - but when this URL is accessed, DSpace returns an Invalid Identifier error: The identifier 123456789/89/1/Roberto Ros?? dummy.pdf does not correspond to a valid Bitstream in the Repository. As I say, I can't guarantee that everything is set correctly, but accented chars appear to work in most other places as you say . . . . I hope that helps. Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] select E-people option
Hi Jayan, When I try to view e-persons through the select E-people button option it gives me an internal error. But other options like select group etc works fine. The same error I get while creating a collection and trying to give access to e-persons. Please suggest. I don't know if this is related or not, but I had a similar problem when I was working on our AD authentication integration - I can't remember the exact cause, but I think it related to the ePerson table getting corrupted during failed account creation (there was some bit of it that wasn't quite working at that stage). I think accounts were being created but the email address field wasn't being filled in. Anyway, I went into the ePerson table and made sure that all the entries had both an email address and a Net ID value (this was my development system so there weren't too many accounts), and that fixed it. Hope that helps. Regards, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] AD Authentication and Choose login page?
Hi, I am trying to get Active Directory LDAP integration up and running with DSpace v1.4.1. Jayan Chirayath Kurian has kindly provided me with a copy of an ADAuthentication.java plugin written by Kyle Brenthall (along with implementation instructions - thanks Kyle, by the way :-) ). Following Kyle's instructions to Jayan, I have added the plug-in code, made the required code additions to Utils.java, added the config info to dspace.cfg, and added ADAuthentication to the authentication plugin sequence (as the first option followed by PasswordAuthentication). However, when I now try to access My DSpace to test it out, rather than being presented with a login page, I am getting a Choose a Login Method page, which asks me to 'choose one of these ways to login' - however there are no options to choose from, so I am not able to proceed. Anyone know what I'm doing wrong, or what I should be tweaking in order to get past this screen? In his email to Jayan, Kyle says The module uses the 'normal' screen to gather the username and password, so this is what I'm trying to get at . . . . Any thoughts, suggestions, or pointers welcome! Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] FIXED: Request copy Admin email problems
Hi Bjorn, I've been trawling through the Request Copy addon source code and have found the source of the problem that was preventing us from receiving the Request item be made Open Access administrator emails. The problem was line 473 of RequestItemServlet.java ([dspace-src]/src/pt/uminho/sdum/dspace/requestItem/servlet/RequestItemS ervlet.java) which was set to use the mail.from.address rather than mail.admin (and as our mail.from.address is a 'dud' address, messages just disappeared down a black hole). Changing line 473 to: adm.setField(email.FIELD_TO, ConfigurationManager.getProperty(mail.admin)); - appears to have fixed the problem for me. I hope that helps, Mike P.S. What version of DSpace are you using? I was initially unable to compile this addon with v1.4.1 due to uncaught exceptions in one of the DSpace servlets that the addon replaced (ItemTag.java or BitstreamServlet.java, can't remember which now) - on closer inspection I realised that the addon was using older versions of these servlets (the later version in DSpace v1.4.1 appeared to have significant differences), so I ended up going through the addon versions of the servlets and copying over the addon code to the DSpace v1.4.1 versions - it all appears to be working fine now, but I wondered if this was just me or if it was something that others ought to look out for . . . . Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Admin/feedback email problems?
Thanks Bjorn, Not very helpful, but I have the exact same problem. I've contacted the add-on developers at the University of Minho, but have not received a fix yet. That's actually very helpful - at least I know it's not just something stupid that I've done :-) If you receive a fix, or any further information, I would, of course, be grateful if you could pass it on. If I make any progress, I'll let you know. Regards, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] FW: visibility bug - is it just me?
Hi there, I didn't get any responses to this question - can I assume from this that no-one is actually using the visibilityworkflow/visibility attribute in input-forms.xml to hide a onebox or textarea field during submission? - if that isn't the case and you are using this feature successfully, perhaps you could let me know? If no-one is actually doing this in production, is there any chance that someone out there with a v1.4.1 dev server could try this out and confirm whether or not it is a bug, or if it's just me :-) Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ From: Michael White Sent: 19 February 2007 16:31 To: 'dspace-tech@lists.sourceforge.net' Subject: visibility bug - is it just me? Hi, I want to make use of the visibility attribute in the input-forms.xml but we're running v1.3.2 in production (which doesn't include it out of the box), so I've upgraded my dev system to 1.4.1 to try it out. However, whenever I make a onebox or textarea element only visible in workflow (using visibilityworkflow/visibility) it works to a point in that the element is hidden on the input form, however, when I hit the Next button to move on to the next page (away from the page containing the hidden element), I get an Internal Server Error . . . The workflow visibility setting works just fine for name, twobox, date, dropdown, and qualdrop_value elements (elements are hidden during input and only visible in workflow forms), but as soon as I try to 'hide' a onebox or textarea, everything disappears in a puff of blue smoke . . . . I'm trying this out using the default input-forms.xml in v1.4.1 to make sure it isn't anything else fancy I've previously added to the form setup. Is it just me, or has anyone else seen this? Are others successfully hiding onebox or textarea fields on their input forms? Here is the snippet from the logs just in case this helps . . . . Exception: java.lang.NullPointerException at org.dspace.app.webui.servlet.SubmitServlet.readText(SubmitServlet.java:2 429) at org.dspace.app.webui.servlet.SubmitServlet.processEditMetadata(SubmitSer vlet.java:890) at org.dspace.app.webui.servlet.SubmitServlet.doDSPost(SubmitServlet.java:3 82) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet. java:147) at org.dspace.app.webui.servlet.DSpaceServlet.doPost(DSpaceServlet.java:105 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java:760) Any insights etc welcome. Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Tapir add-on usage
Hi Brian, Not sure if you've had any responses to this, so I'll chip in with our experiences . . . When we originally set up our eTheses repository it was done on DSpace v1.2.1 with the TAPIR plug-in (v0.3 I think) - we were only using the system to enable students to deposit final versions of their theses (i.e. we weren't using the supervisor workspaces etc). Last year we upgraded to v1.3.2 - the TAPIR plug-in wasn't compatible with this DSpace version at the time (don't know if that is still the case), but we were able to replicate everything we wanted to do (pretty much) with DSpace out of the box - the main thing was being able to set up custom submission forms for our eTheses collections using the input-forms.xml mechanism. Don't know if that helps, but happy to attempt to answer any specific questions you may have. Regards, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- Message: 2 Date: Tue, 20 Feb 2007 16:02:06 -0700 From: Brian Freels-Stendel [EMAIL PROTECTED] Subject: [Dspace-tech] Tapir add-on usage To: dspace-tech@lists.sourceforge.net Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=US-ASCII Hello Everyone, We're considering how to begin ingesting dissertations and theses into DSpace. I've looked at the Tapir add-on, and it appears it would suffice for our needs. I have a few questions, though. First, we're running DSpace 1.4.0 (soon moving to 1.4.1), and it hasn't (yet) been updated to work with it. (It looks like there are plans to make it work with the coming AddOn Mech, but the fire's under my seat now, so.) Second, looking at the code, it appears that many things from the Tapir add-on have made it into the core, but I'm not sure how much. Any info there would be useful. I know that things can move slowly, particularly if they need to get done right, so I was wondering if there's a guess as to the timeline involved. If it looks like it will be a relatively long time, and there are no objections, I would be willing to look into twisting it to work with DSpace 1.4.1. Thanks in advance for any information out there. Brian Freels-Stendel Customer Technologies University Libraries University of New Mexico Albuquerque, NM 87131 -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] visibility bug - is it just me?
Hi, I want to make use of the visibility attribute in the input-forms.xml but we're running v1.3.2 in production (which doesn't include it out of the box), so I've upgraded my dev system to 1.4.1 to try it out. However, whenever I make a onebox or textarea element only visible in workflow (using visibilityworkflow/visibility) it works to a point in that the element is hidden on the input form, however, when I hit the Next button to move on to the next page (away from the page containing the hidden element), I get an Internal Server Error . . . The workflow visibility setting works just fine for name, twobox, date, dropdown, and qualdrop_value elements (elements are hidden during input and only visible in workflow forms), but as soon as I try to 'hide' a onebox or textarea, everything disappears in a puff of blue smoke . . . . I'm trying this out using the default input-forms.xml in v1.4.1 to make sure it isn't anything else fancy I've previously added to the form setup. Is it just me, or has anyone else seen this? Are others successfully hiding onebox or textarea fields on their input forms? Here is the snippet from the logs just in case this helps . . . . Exception: java.lang.NullPointerException at org.dspace.app.webui.servlet.SubmitServlet.readText(SubmitServlet.java:2 429) at org.dspace.app.webui.servlet.SubmitServlet.processEditMetadata(SubmitSer vlet.java:890) at org.dspace.app.webui.servlet.SubmitServlet.doDSPost(SubmitServlet.java:3 82) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet. java:147) at org.dspace.app.webui.servlet.DSpaceServlet.doPost(DSpaceServlet.java:105 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java:760) Any insights etc welcome. Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ http://www.is.stir.ac.uk/celd/ -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Metadata fields only visible during workflow?
Many thanks Richard, Very useful! I did revisit the input-forms.xml configuration documentation before I emailed the list (http://www.dspace.org/technology/system-docs/submission.html), but don't recall seeing the visibility attribute listed . . . Cheers, Mike Michael White eLearning Developer Centre for eLearning Development (CeLD) S7, The Library University of Stirling Stirling SCOTLAND FK9 4LA Email: [EMAIL PROTECTED] Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/celd/ -Original Message- From: Richard Jones [mailto:[EMAIL PROTECTED] Sent: 26 January 2007 16:06 To: Michael White Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Metadata fields only visible during workflow? Hi Michael, I can't see a way to do this out of the box, but thought I'd ask anyway (because my colleagues in bibliographic services have asked me!). Is it possible to define metadata elements that are not visible on the input forms to ordinary punters during submission, but are visible during the edit metadata workflow step? Yup, your input-forms.xml should be set up so that the relevant fields are marked with: visibilityworkflow/visibility This should be in the documentation under how to configure your input-forms.xml file. We want to do this as we have some metadata elements that will confuse/frustrate submitters, but that we want our metadata staff to complete during workflow. That's why I wrote it too ;) Also, is it possible to control the availability of additional fields dependant on the choices made on the initial questions page (beyond the fields that are automatically skipped)? We have some additional data we want to collect when an item has been published before, but it would be better to skip these fields if the item has not been published. We're on v1.3.2. Ah - I don't recall if this is in 1.3.2, but if not, you will find a patch on SF (browse closed patches for some sensible wording like visibility) which you will be able to apply. Cheers, -- Richard Richard Jones| t: +44 (0)20 759 [48614 / 41815] Web Database | e: [EMAIL PROTECTED] Technology Specialist | b: http://chronicles-of-richard.blogspot.com/ Imperial College London | -- The University of Stirling is a university established in Scotland by charter at Stirling, FK9 4LA. Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not disclose, copy or deliver this message to anyone and any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
