[Dspace-tech] Search problem in DSpace 5.2 Mirage2
Hi, Everyone: I wrote to the list back in July about a search problem that we were having with DSpace 5.2 XMLUI Mirage 2 theme. The problem was that if you did a search of a phrase (such as Cornell University), your search results would contain the word Cornell and the word University. In effect, the search was ignoring the quotes and giving you an OR search instead of an AND search. Bram Luyten confirmed that this was happening on the demo site. I haven't heard anything since then, and I wonder if this is planned to be fixed. I have some users pretty upset about this and the complaints are making their way up my management chain :( Anyway help that I can get would be great! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Search problem in DSpace 5.2 Mirage2
Andrea: I haven't tested outside of Mirage2 XMLUI, but I will. George From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Wednesday, August 26, 2015 6:06 PM To: George Stanley Kozak g...@cornell.edu; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Search problem in DSpace 5.2 Mirage2 Hi George, On 27/08/15 04:43, George Stanley Kozak wrote: I wrote to the list back in July about a search problem that we were having with DSpace 5.2 XMLUI Mirage 2 theme. The problem was that if you did a search of a phrase (such as Cornell University), your search results would contain the word Cornell and the word University. In effect, the search was ignoring the quotes and giving you an OR search instead of an AND search. Bram Luyten confirmed that this was happening on the demo site. I haven't heard anything since then, and I wonder if this is planned to be fixed. I have some users pretty upset about this and the complaints are making their way up my management chain :( Anyway help that I can get would be great! I filed a search-related bug report a little while ago (though I could probably have picked a better title): https://jira.duraspace.org/browse/DS-2699 -- this issue currently needs a volunteer. I wouldn't be surprised if what you're seeing is caused by the same thing, basically, somewhat overzealous escaping of special characters in the search (which was introduced to fix a bug I had unfortunately snuck into DSpace 5.2, which in turn was intended to fix issues with searching for phrases containing colons). Is the behaviour you're seeing limited to Mirage 2/XMLUI? cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about search in DSpace 5.2
Bram: Yes, that is exactly what I am seeing. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: Tuesday, August 04, 2015 8:35 AM To: George Stanley Kozak g...@cornell.edu Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about search in DSpace 5.2 Hi George, thanks for the report. Not a solution yet, but I was able to reproduce this on demo.dspace.orghttp://demo.dspace.org: http://screencast.com/t/WavlwEPNt Search Advanced filters Title Contains Test Word. And it still gives you Test Webpage as the first hit after applying the filter. Is this the exact behaviour you wanted to report? thanks, Bram -- [logo] Bram Luyten 250-B Suite 3A, Lucius Gordon Drive, West Henrietta, NY 14586 Esperantolaan 4, Heverlee 3001, Belgium www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On 30 July 2015 at 23:08, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi… I am using DSpace 5.2 XMLUI (Mirage 2 theme - modified). Some users have reported to me that search doesn't seem to respect quoted phrases, to mean an exact phrase search. If you search on Cornell University within, say, title. You get a lot of titles without that exact phrase. Is there a setting in one of the config files that is causing this, or is this being caused by something else? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about search in DSpace 5.2
Hi... I am using DSpace 5.2 XMLUI (Mirage 2 theme - modified). Some users have reported to me that search doesn't seem to respect quoted phrases, to mean an exact phrase search. If you search on Cornell University within, say, title. You get a lot of titles without that exact phrase. Is there a setting in one of the config files that is causing this, or is this being caused by something else? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about lists in DSpace 5.2 Mirage 2
So, we are using DSpace 5.2 (Mirage 2 XMLUI). When in Admin mode and you want to change a group, or move an item or any function that requires displaying a list of groups or users or collections, the lists displayed are not ordered in any way. We have a LOT of collections and groups and users and so the unordered lists are almost unmanageable. Is there any plans to fix these lists so that they display in some order? Thanks. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about lists in DSpace 5.2 Mirage 2
Thanks, Hilton! George Kozak From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Tuesday, July 28, 2015 10:47 AM To: George Stanley Kozak g...@cornell.edu Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about lists in DSpace 5.2 Mirage 2 Hi George, Our operational people also complained bitterly about this fact. This is a UX regression, hopefully a fix is on the way. Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator Stellenbosch University Library http://staff.lib.sun.ac.za/~hgibson/docs/cv/cv.html On 28 July 2015 at 16:13, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: So, we are using DSpace 5.2 (Mirage 2 XMLUI). When in Admin mode and you want to change a group, or move an item or any function that requires displaying a list of groups or users or collections, the lists displayed are not ordered in any way. We have a LOT of collections and groups and users and so the unordered lists are almost unmanageable. Is there any plans to fix these lists so that they display in some order? Thanks. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about Totals of Items
Hilton: Hmmm…I will have to think about that. I assumed that Titles displayed all titles (even the restricted ones). Thanks for the tip. I will need to do a bit more investigation. George From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Tuesday, July 14, 2015 9:39 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Totals of Items Hi George, What about items with resource policies that are restrictive? How do you count those? Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator Stellenbosch University Library http://staff.lib.sun.ac.za/~hgibson/docs/cv/cv.html On 14 July 2015 at 15:34, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi… I am running DSpace 5.2 modified Mirage2 theme XMLUI in production (http://ecommons.cornell.edu) . One of the things that I am doing is running a script daily that counts the number of items and places them on the home page. The script that I run executes this command: select item_id from item where withdrawn='f' and in_archive='t' ; The number that I get currently is : 33,307 However, if I go to Browse by titles: http://ecommons.cornell.edu/browse?type=title It shows the current number of items as being: 33,177 So, my calculations appear to be 130 items off. Does anyone have any ideas why there would be this discrepancy? I am already weeding out withdrawn and deleted items, so what could I be ignoring that I should be excluding from my calculations? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about database values
Hi... Back in DSpace 1.8.2, I executed a bunch of SQL queries to generate reports for people at my site. One of my reports relied on getting the name and description of a bitstream. The report that I generated used this SQL query: select bitstream_id,name,description,sequence_id,size_bytes from bitstream; I see now in DSpace 5.2 that name and description are no longer part of the bitstream table. Where are these values now held? Also, is there a document out there that details the SQL changes in DSpace 5.2? Thanks in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about Totals of Items
Hi... I am running DSpace 5.2 modified Mirage2 theme XMLUI in production (http://ecommons.cornell.edu) . One of the things that I am doing is running a script daily that counts the number of items and places them on the home page. The script that I run executes this command: select item_id from item where withdrawn='f' and in_archive='t' ; The number that I get currently is : 33,307 However, if I go to Browse by titles: http://ecommons.cornell.edu/browse?type=title It shows the current number of items as being: 33,177 So, my calculations appear to be 130 items off. Does anyone have any ideas why there would be this discrepancy? I am already weeding out withdrawn and deleted items, so what could I be ignoring that I should be excluding from my calculations? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about database values
Thanks, Mark! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Tuesday, July 14, 2015 2:38 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about database values On Tue, Jul 14, 2015 at 03:36:12PM +, George Stanley Kozak wrote: Back in DSpace 1.8.2, I executed a bunch of SQL queries to generate reports for people at my site. One of my reports relied on getting the name and description of a bitstream. The report that I generated used this SQL query: select bitstream_id,name,description,sequence_id,size_bytes from bitstream; I see now in DSpace 5.2 that name and description are no longer part of the bitstream table. Where are these values now held? Bitstreams can now have metadata, and those fields moved to the metadatavalue table. You can for example: JOIN metadatavalue md WHERE resource_id = bitstream_id AND resource_type_id = 0 AND metadata_field_id = ( SELECT metadata_field_id FROM metadatafieldregistry WHERE metadata_schema_id = ( SELECT metadata_schema_id FROM metadataschemaregistry WHERE short_id = 'dc') AND element = 'title' AND qualifier IS NULL ) Also, is there a document out there that details the SQL changes in DSpace 5.2? I don't recall one, but the main idea is that metadata support moved from Item to DSpaceObject, and then all extends DSpaceObject had their interesting fields changed into metadata. I went and looked at Bitstream.getName() to recall that that is now stored in dc.title. What is left in the object tables is mainly internal bookkeeping stuff like checksums. -- Mark H. Wood Lead Technology Analyst University Library Indiana University - Purdue University Indianapolis 755 W. Michigan Street Indianapolis, IN 46202 317-274-0749 www.ulib.iupui.edu -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about Browse By in DSpace 5.2
Thank you, Tim: I will manually apply the Pull Request. Thank you for the information. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Monday, July 06, 2015 11:56 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Browse By in DSpace 5.2 Hi George, The bug described in DS-2602 definitely exists in 5.2. So, it's really up to you and your users can live with it for a brief period of time...or you can manually apply the Pull Request to your local installation to fix it locally, if you want to upgrade to 5.2 but don't want to experience this bug. Again, here's the fix: https://github.com/DSpace/DSpace/pull/981 The 5.3 release is not yet scheduled, but the developers are actively working on fixing several other minor bugs in 5.x. My hope is that 5.3 will be ready to release in the next few weeks. We are progressing nicely on 5.3 at this point, but I cannot guarantee a particular release date quite yet. The best I can do is say it should be out in July, and hopefully in mid-July. - Tim On 7/6/2015 10:43 AM, George Stanley Kozak wrote: Tim: This is exactly what I am seeing. We were planning on going live with DSpace 5.2 this week or next week. Would you recommend that I wait until 5.3 is ready? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Monday, July 06, 2015 10:34 AM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Browse By in DSpace 5.2 Hi George, To me, this sounds very similar to DS-2602: https://jira.duraspace.org/browse/DS-2602 While 2602 describes this as clicking on a letter, it's actually performing the same sort of jump to that would occur if you entered something into the Starts with box and pressed Go. I'm able to see this same general behavior on http://demo.dspace.org/xmlui/ . Either clicking on a letter or entering something in the starts with box don't function properly for Browse by Title or Browse by Issue Date. But, it does still work for Browse by Authors and Browse by Subjects (as far as I can see). I can also see the same behavior in my local test instance. However, if I (locally) apply the PR which fixes DS-2602, then everything seems to work for me: https://github.com/DSpace/DSpace/pull/981 We are planning to fix this DS-2602 in a DSpace 5.3 release coming soon (hopefully in the next few weeks here). So, I *think* this will fix the problems you are seeing in 5.2. Is this the same thing you are seeing? Or am I misunderstanding the issue here? Thanks, Tim On 7/2/2015 9:17 PM, George Stanley Kozak wrote: Hi... I am almost ready to cutover out DSpace 1.8.2 JSPUI system to DSpace 5.2 XMLUI (Mirage 2 theme), but our user testing uncovered a problem that I didn't notice before. Testers found that if they put anything in the input fields of Browse by Title, Browse by Author, Browse by Date or Browse by Subject, that the search results in a display of the whole index and the starts on the last page of the index. The fields that I am talking about are input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_withfield in the Browse by Title or Browse by Author or Browse by Subject And select id=aspect_artifactbrowser_ConfigurableBrowse_field_year and input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_with in Browse by Date Has anyone seen this before at their site? I am assuming that there is something wrong with my index, but I did a ./dspace index-discovery -b and it didn't help. George Kozak Cornell University -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com
Re: [Dspace-tech] Question about Browse By in DSpace 5.2
Tim: This is exactly what I am seeing. We were planning on going live with DSpace 5.2 this week or next week. Would you recommend that I wait until 5.3 is ready? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Monday, July 06, 2015 10:34 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Browse By in DSpace 5.2 Hi George, To me, this sounds very similar to DS-2602: https://jira.duraspace.org/browse/DS-2602 While 2602 describes this as clicking on a letter, it's actually performing the same sort of jump to that would occur if you entered something into the Starts with box and pressed Go. I'm able to see this same general behavior on http://demo.dspace.org/xmlui/ . Either clicking on a letter or entering something in the starts with box don't function properly for Browse by Title or Browse by Issue Date. But, it does still work for Browse by Authors and Browse by Subjects (as far as I can see). I can also see the same behavior in my local test instance. However, if I (locally) apply the PR which fixes DS-2602, then everything seems to work for me: https://github.com/DSpace/DSpace/pull/981 We are planning to fix this DS-2602 in a DSpace 5.3 release coming soon (hopefully in the next few weeks here). So, I *think* this will fix the problems you are seeing in 5.2. Is this the same thing you are seeing? Or am I misunderstanding the issue here? Thanks, Tim On 7/2/2015 9:17 PM, George Stanley Kozak wrote: Hi... I am almost ready to cutover out DSpace 1.8.2 JSPUI system to DSpace 5.2 XMLUI (Mirage 2 theme), but our user testing uncovered a problem that I didn't notice before. Testers found that if they put anything in the input fields of Browse by Title, Browse by Author, Browse by Date or Browse by Subject, that the search results in a display of the whole index and the starts on the last page of the index. The fields that I am talking about are input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_withfield in the Browse by Title or Browse by Author or Browse by Subject And select id=aspect_artifactbrowser_ConfigurableBrowse_field_year and input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_with in Browse by Date Has anyone seen this before at their site? I am assuming that there is something wrong with my index, but I did a ./dspace index-discovery -b and it didn't help. George Kozak Cornell University -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] RES: Question about Browse By in DSpace 5.2 (George Stanley Kozak)
Michelangelo: Yes, this is exactly what I am seeing, but as Hilton and I reported, we are using XMLUI, while the original bug report was for JSPUI (unless I'm mistaken). Hopefully, there is a bug fix for this as well? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Michelangelo M M Viana mvi...@pucrs.br Sent: Friday, July 3, 2015 7:15 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] RES: Question about Browse By in DSpace 5.2 (George Stanley Kozak) Hi George, Maybe is this case, already tracked: - http://sourceforge.net/p/dspace/mailman/message/34083569/ Re: [Dspace-tech] Error when browse Title, Author, Issue Date in Communities or Collections From: Andrea Schweer schweer@wa... - 2015-05-05 02:30:31 Hi, On 05/05/15 14:10, Nguyen Hung Thanh wrote: I install DSpace 5.1 on windows, using jspui. When I browse DSpace via Title, Author, Issue Date in Communities or Collections, DSpace show all item in DSpace instead show item in this Communities/Collections This is a known bug in DSpace 5.1: https://jira.duraspace.org/browse/DS-2482 It will be fixed in DSpace 5.2, which will hopefully be released in the next few weeks. If you can't wait for DSpace 5.2, you could try applying the original bugfix to your code base: https://github.com/DSpace/DSpace/pull/876/files cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand - I did apply the bugfix on our 5.1 and now browse is working as expected. Regards, Michelângelo -Mensagem original- De: dspace-tech-requ...@lists.sourceforge.net [mailto:dspace-tech-requ...@lists.sourceforge.net] Enviada em: sexta-feira, 3 de julho de 2015 05:08 Para: dspace-tech@lists.sourceforge.net Assunto: DSpace-tech Digest, Vol 111, Issue 4 Send DSpace-tech mailing list submissions to dspace-tech@lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/dspace-tech or, via email, send a message with subject or body 'help' to dspace-tech-requ...@lists.sourceforge.net You can reach the person managing the list at dspace-tech-ow...@lists.sourceforge.net When replying, please edit your Subject line so it is more specific than Re: Contents of DSpace-tech digest... Today's Topics: 1. Question about Browse By in DSpace 5.2 (George Stanley Kozak) 2. problem wth pdf thumbnail creation - imagemagick (dspace user) 3. PDF Thumbnails not generated (ImageMagick on CentOS) (Alena Woods) 4. not able to create administrator for dspace (Code 2 dogears) 5. Re: Solr stats queries - limiting by date (alastair.dun...@stfc.ac.uk) 6. Re: Question about Browse By in DSpace 5.2 (Hilton Gibson) -- Message: 1 Date: Fri, 3 Jul 2015 02:17:59 + From: George Stanley Kozak g...@cornell.edu Subject: [Dspace-tech] Question about Browse By in DSpace 5.2 To: dspace-tech@lists.sourceforge.net dspace-tech@lists.sourceforge.net Message-ID: by2pr0401mb1688ec0c80e024df1e2dcb979f...@by2pr0401mb1688.namprd04.prod.outlook.com Content-Type: text/plain; charset=iso-8859-1 Hi... I am almost ready to cutover out DSpace 1.8.2 JSPUI system to DSpace 5.2 XMLUI (Mirage 2 theme), but our user testing uncovered a problem that I didn't notice before. Testers found that if they put anything in the input fields of Browse by Title, Browse by Author, Browse by Date or Browse by Subject, that the search results in a display of the whole index and the starts on the last page of the index. The fields that I am talking about are input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_withfield in the Browse by Title or Browse by Author or Browse by Subject And select id=aspect_artifactbrowser_ConfigurableBrowse_field_year and input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_with in Browse by Date Has anyone seen this before at their site? I am assuming that there is something wrong with my index, but I did a ./dspace index-discovery -b and it didn't help. George Kozak Cornell University -- next part -- An HTML attachment was scrubbed... -- Message: 2 Date: Fri, 3 Jul 2015 08:45:16 +0530 From: dspace user dspace.us...@gmail.com Subject: [Dspace-tech] problem wth pdf thumbnail creation - imagemagick To: dspace-tech@lists.sourceforge.net Message-ID: CABTkaNWMt49N=p1v0-atrddgvktyy5oodmvr+ldnya3so4o
Re: [Dspace-tech] Changing embargo dates in DSpace 5.2
Thank you, Pascal. We are using DSpace 5.2 XMLUI Mirage 2 (I should have mentioned that earlier). It would be nice to change the dates in the Admin interface, but this is helpful. I guess my process now will be: 1) Login in as Admin 2) Open and item and edit 3) Click on Authorizations 4) Find the bitstream in the list and note the bitstream ID 5) If I plan to change the Embargo date, then from the command line I will go to psql and do a. update resorcepolicy set end_date=whatever you want where resource_id=bitstream id noted above; Again, thanks for your help (and to Hilton Gibson, too!) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Becker, Pascal-Nicolas [mailto:p.bec...@tu-berlin.de] Sent: Thursday, July 02, 2015 4:44 AM To: dspace-tech@lists.sourceforge.net Cc: George Stanley Kozak Subject: RE: Changing embargo dates in DSpace 5.2 Hi, if you use the JSPUI this should be fixed in DSpace 5.2. See the ticket in Jira describing the problem and its solution: https://jira.duraspace.org/browse/DS-1965. Starting with DSpace 5.2 you should see the date fields in the administrator interface you use to edit authorizations (login as admin, open an item, click on edit, click on edit, click on authorizations, look for the policy you want to change and click on edit). While writing this mail I see that the dates are not part of the table listing all authorizations of an item. We should change this too. I create the ticket DS-2638 and marked it as needs volunteer. Kind regards, Pascal From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Wednesday, July 01, 2015 8:09 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Changing embargo dates in DSpace 5.2 Hi... How do people handle changing the Embargo dates in DSpace 5.2? As far as I can tell, once an item has been submitted as embargoed, it can only be changed by manually modifying the resourcepolicy table. Am I wrong of is there a programmatic way to change the dates? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Changing embargo dates in DSpace 5.2
Thank you, Pascal. From: Becker, Pascal-Nicolas [mailto:p.bec...@tu-berlin.de] Sent: Thursday, July 02, 2015 11:12 AM To: dspace-tech@lists.sourceforge.net Cc: George Stanley Kozak Subject: RE: Changing embargo dates in DSpace 5.2 Hi, DSpace currently has two Embargo mechanisms: one that work with lift date and a cronjob (named as Pre Dspace 3 Embargo) and one that works with start date on policies (named as past DSpace 3 Embargo functionality). The latter one sets resource policies whenever an embargo is set but it restricts their validity by dates. So if you're updating the psql table manually you probably should change the *start_date* and not the end date as we do not have policies that forbid something but only policies that allow g.e. the read access (beginning with the specified start_date). Regards, Pascal From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Thursday, July 02, 2015 3:45 PM To: Becker, Pascal-Nicolas; dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: RE: Changing embargo dates in DSpace 5.2 Thank you, Pascal. We are using DSpace 5.2 XMLUI Mirage 2 (I should have mentioned that earlier). It would be nice to change the dates in the Admin interface, but this is helpful. I guess my process now will be: 1) Login in as Admin 2) Open and item and edit 3) Click on Authorizations 4) Find the bitstream in the list and note the bitstream ID 5) If I plan to change the Embargo date, then from the command line I will go to psql and do a. update resorcepolicy set end_date=whatever you want where resource_id=bitstream id noted above; Again, thanks for your help (and to Hilton Gibson, too!) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Becker, Pascal-Nicolas [mailto:p.bec...@tu-berlin.de] Sent: Thursday, July 02, 2015 4:44 AM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Cc: George Stanley Kozak Subject: RE: Changing embargo dates in DSpace 5.2 Hi, if you use the JSPUI this should be fixed in DSpace 5.2. See the ticket in Jira describing the problem and its solution: https://jira.duraspace.org/browse/DS-1965. Starting with DSpace 5.2 you should see the date fields in the administrator interface you use to edit authorizations (login as admin, open an item, click on edit, click on edit, click on authorizations, look for the policy you want to change and click on edit). While writing this mail I see that the dates are not part of the table listing all authorizations of an item. We should change this too. I create the ticket DS-2638 and marked it as needs volunteer. Kind regards, Pascal From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Wednesday, July 01, 2015 8:09 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Changing embargo dates in DSpace 5.2 Hi... How do people handle changing the Embargo dates in DSpace 5.2? As far as I can tell, once an item has been submitted as embargoed, it can only be changed by manually modifying the resourcepolicy table. Am I wrong of is there a programmatic way to change the dates? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about Browse By in DSpace 5.2
Hi... I am almost ready to cutover out DSpace 1.8.2 JSPUI system to DSpace 5.2 XMLUI (Mirage 2 theme), but our user testing uncovered a problem that I didn't notice before. Testers found that if they put anything in the input fields of Browse by Title, Browse by Author, Browse by Date or Browse by Subject, that the search results in a display of the whole index and the starts on the last page of the index. The fields that I am talking about are input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_withfield in the Browse by Title or Browse by Author or Browse by Subject And select id=aspect_artifactbrowser_ConfigurableBrowse_field_year and input id=aspect_artifactbrowser_ConfigurableBrowse_field_starts_with in Browse by Date Has anyone seen this before at their site? I am assuming that there is something wrong with my index, but I did a ./dspace index-discovery -b and it didn't help. George Kozak Cornell University -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Changing embargo dates in DSpace 5.2
Hi... How do people handle changing the Embargo dates in DSpace 5.2? As far as I can tell, once an item has been submitted as embargoed, it can only be changed by manually modifying the resourcepolicy table. Am I wrong of is there a programmatic way to change the dates? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] New Problem building DSpace 5.2
Hi... I have DSpace 5.2 running fine on a development server. I am now trying to bring it up in production. I am using the latest ZIP source from Sourceforge (so I don't think I am running into the previously reported build problems). In any case, when I execute: mvn -U clean -Pxpdf-mediafilter-support -Dmirage2.on=true package I get the following error: [ERROR] Failed to execute goal on project additions: Could not resolve dependencies for project org.dspace.modules:additions:jar:5.2: The following artifacts could not be resolved: com.sun.media:jai_imageio:jar:1.0_01, javax.media:jai_core:jar:1.1.2_01: Could not find artifact com.sun.media:jai_imageio:jar:1.0_01 in sonatype-releases (https://oss.sonatype.org/content/repositories/releases/), try downloading from http://java.sun.com/products/java-media/jai/downloads/download-iio-1_0_01.html - [Help 1] I don't have this problem on my development server. Any advice that you can give me will be appreciated. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] New Problem building DSpace 5.2 (updated!)
OK... I actually figured out the problem. It appears to be in using -Pxpdf-mediafilter-support is causing my error. I forgot about the installation of the jai_imageio.jar that was required. Sorry for bothering everyone. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Friday, June 26, 2015 11:21 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] New Problem building DSpace 5.2 Hi... I have DSpace 5.2 running fine on a development server. I am now trying to bring it up in production. I am using the latest ZIP source from Sourceforge (so I don't think I am running into the previously reported build problems). In any case, when I execute: mvn -U clean -Pxpdf-mediafilter-support -Dmirage2.on=true package I get the following error: [ERROR] Failed to execute goal on project additions: Could not resolve dependencies for project org.dspace.modules:additions:jar:5.2: The following artifacts could not be resolved: com.sun.media:jai_imageio:jar:1.0_01, javax.media:jai_core:jar:1.1.2_01: Could not find artifact com.sun.media:jai_imageio:jar:1.0_01 in sonatype-releases (https://oss.sonatype.org/content/repositories/releases/), try downloading from http://java.sun.com/products/java-media/jai/downloads/download-iio-1_0_01.html - [Help 1] I don't have this problem on my development server. Any advice that you can give me will be appreciated. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (additional information)
Hi, This is an update to a problem with search results that I reported for my DSpace 5.2 Mirage2 XMLUI installation. To make a long story short, I found that if I do a search on a term and that term appears in the bitstream name, then the extracted text’s bitstream name will appear in the snippet results of the search (as part of the fulltext). I don’t know if this is a misconfiguration on my part or if this is how the fulltext searching is expected to display in the snippets. Below is an example that will detail what I am talking about. If anyone has any thoughts that they would like to share on this, I will be grateful. Example: I did a search on the term “Westbrooks” and in the search results, I saw: Language Data and Rights Westbrooks, Elaine (2006-03-31) stream_source_info MWG_2006-03-31_Westbrooks.ppt.txt stream_content_type text/plain stream_size 9868 Content-Encoding UTF-8 stream_name MWG_2006-03-31_Westbrooks.ppt.txt Content-Type text/plain; charset=UTF-8 Language... Data and Rights Elaine L. Westbrooks March 31, 2006 Overview Ethics Undocumented Rights : Problems Rights Expression (Solutions) Ethics (1) Language Documentation facets of ethical research Code of Conduct Informed consent Ethics (2) Language Archiving... (bitstream name: stream_source_info MWG_2006-03-31_Westbrooks.ppt.txt – this is the name of the extracted text which contains the fulltext and which fulfills the search criteria) Another search, let’s say for the phrase “Overview Ethics Undocumented Rights” which appears within the extracted text will result in: Language Data and Rights Westbrooks, Elaine (2006-03-31) Data and Rights Elaine L. Westbrooks March 31, 2006 Overview Ethics Undocumented Rights : Problems Rights Expression (Solutions) Ethics (1) Language Documentation facets of ethical research Code of Conduct Informed consent Ethics (2) Language Archiving... Intellectual property rights International Protected groups Preserve data Access management Human Subjects Institutional Review Board Confidentiality, privacy Problems Institutions/archives are responsible Linguists knowledgeable of access rights Documented... (the name of the extracted text file does not appear because it does not meet the search criteria) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about Embargo
Hello: This may be a dumb question, but I want to make sure that I understand the difference between the DSpace 1.8.2 Embargo and the DSpace 5.2 Embargo. In our DSpace 1.8.2 setup we created a metadata field called: dc.description.embargo which we used to place the end date of the embargo. I ran the embargo-lifter daily to check and clear out the embargoes (if any). Do I still need to run the embargo-lifter daily in DSpace 5.2? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Page cannot be not found error in DSpace 5.2
Hi... We are going live with DSpace 5.2 (XMLUI with modified Mirage 2 theme) at Cornell University (after years on DSpace 1.8.2 JSPUI) in a couple of weeks and I am trying to clean up some issues from our testing. One issue that we are seeing is that, if a person is doing a Submission and they let it sit for a while (so that a login timeout happens), if they try and click on Next or Previous, they get a Page cannot be found error message. In DSpace 1.82. JSPUI, we normally are presented with a login screen and after logging in again, the person could continue. My question is, is there something in the Config that I need to set so that a person can continue and not get the Page cannot be found error message, or is this the way it is? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Problem with Search Result display in Mirage2 theme (update)
Hi, I previously reported a problem with search results that I was seeing with my DSpace 5.2 Mirage2 XMLUI installation. helix84 and Hilton Gibson pointed me to the search snippets and the solr index. I’ve done some poking around, and I can’t seem to find what’s causing this. So, I am going to see if anyone can help. Here is the problem: In the search results display (if the item has no abstract), the search snippets displays field names in the search results, such as “stream_source_info” and “stream_content_type” and “stream_size” Here’s an example (I did a search on the term “vineyard”): Pellegrini Vineyards Hearn, Russell (2008) stream_source_info Hearn_PellegriniVineyards_WIWP_2008.pdf.txt stream_content_type text/plain stream_size 2036 Content-Encoding UTF-8 stream_name Hearn_PellegriniVineyards_WIWP_2008.pdf.txt Content-Type text/plain; charset=UTF-8... Pellegrini Vineyards 4/30/08 Pellegrini Vineyards • FIRST VINTAGE: 1991 • OPERATED BY: Bob and Joyce Pellegrini • WINEMAKER: Russell Hearn • WINES: • East End Select- Chardonnay, Rosé, Merlot • Pellegrini Vineyards- Chardonnay, Merlot... If I add an abstract to the item (Let’s say, “This is a draft of the Vineyard Report from 2008”, then the search displays changes to: Pellegrini Vineyards Hearn, Russell (2008) This is a draft of the Vineyard Report from 2008 Does anyone have any ideas why these field names would appear in my search results? I rebuilt my solr indexes (dspace index-discovery –b) and that didn’t seem to help. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (update)
Thanks, Brian: I’ll take a look. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Thursday, June 18, 2015 6:25 PM To: George Stanley Kozak; 'dspace-tech@lists.sourceforge.net' Subject: RE: [Dspace-tech] Problem with Search Result display in Mirage2 theme (update) Good afternoon, I'm not positive, but I think there's a chance it may be coming from dspace-xmlui-mirage2\src\main\webapp\xsl\aspect\discovery\discovery.xsl, lines 272-280. B-- From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Thursday, June 18, 2015 3:07 PM To: 'dspace-tech@lists.sourceforge.net' Subject: [Dspace-tech] Problem with Search Result display in Mirage2 theme (update) Hi, I previously reported a problem with search results that I was seeing with my DSpace 5.2 Mirage2 XMLUI installation. helix84 and Hilton Gibson pointed me to the search snippets and the solr index. I’ve done some poking around, and I can’t seem to find what’s causing this. So, I am going to see if anyone can help. Here is the problem: In the search results display (if the item has no abstract), the search snippets displays field names in the search results, such as “stream_source_info” and “stream_content_type” and “stream_size” Here’s an example (I did a search on the term “vineyard”): Pellegrini Vineyards Hearn, Russell (2008) stream_source_info Hearn_PellegriniVineyards_WIWP_2008.pdf.txt stream_content_type text/plain stream_size 2036 Content-Encoding UTF-8 stream_name Hearn_PellegriniVineyards_WIWP_2008.pdf.txt Content-Type text/plain; charset=UTF-8... Pellegrini Vineyards 4/30/08 Pellegrini Vineyards • FIRST VINTAGE: 1991 • OPERATED BY: Bob and Joyce Pellegrini • WINEMAKER: Russell Hearn • WINES: • East End Select- Chardonnay, Rosé, Merlot • Pellegrini Vineyards- Chardonnay, Merlot... If I add an abstract to the item (Let’s say, “This is a draft of the Vineyard Report from 2008”, then the search displays changes to: Pellegrini Vineyards Hearn, Russell (2008) This is a draft of the Vineyard Report from 2008 Does anyone have any ideas why these field names would appear in my search results? I rebuilt my solr indexes (dspace index-discovery –b) and that didn’t seem to help. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (resend)
Hi… I sent this to the list back when Open Repositories was goingon, and I suspect that it was lost in the shuffle, because I haven’t heard anything. So, I am resending. I am not sure if this has already been reported, but I found something strange with my DSpace 5.2 install which I have in development and am planning to move to production. I am using the XMLUI with Mirage2 theme. I found that in the search results display, if there is no abstract, the system displays random information. For instance: Pellegrini Vineyards Hearn, Russell (2008) stream_source_info Hearn_PellegriniVineyards_WIWP_2008.pdf.txt stream_content_type text/plain stream_size 2036 Content-Encoding UTF-8 stream_name Hearn_PellegriniVineyards_WIWP_2008.pdf.txt Content-Type text/plain; charset=UTF-8... Pellegrini Vineyards 4/30/08 Pellegrini Vineyards • FIRST VINTAGE: 1991 • OPERATED BY: Bob and Joyce Pellegrini • WINEMAKER: Russell Hearn • WINES: • East End Select- Chardonnay, Rosé, Merlot • Pellegrini Vineyards- Chardonnay, Merlot... If I add an abstract to the item, then the search displays changes to: Pellegrini Vineyards Hearn, Russell (2008) Added abstract here… Has anyone else seen this? Does anyone know what is going on or where I can go to fix this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (resend)
Hilton: Ahh, I see…so this is tied to the snippet view. Now I understand. My original example had no abstract, so the snippet view showed me data from the bitstream that had the keyword I was looking for and when I placed an abstract with the keyword, that was shown instead. Thanks for pointing this out to me. Now I can explain it to others here at Cornell. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Wednesday, June 17, 2015 9:23 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (resend) Hi George I understand the search as delivering snippets with the search term highlighted. See screenshot below. [cid:image002.jpg@01D0A8E2.80F50180] Perhaps this is a new behaviour with advanced search? Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator Stellenbosch University Library http://staff.lib.sun.ac.za/~hgibson/docs/cv/cv.html On 17 June 2015 at 15:15, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi… I sent this to the list back when Open Repositories was goingon, and I suspect that it was lost in the shuffle, because I haven’t heard anything. So, I am resending. I am not sure if this has already been reported, but I found something strange with my DSpace 5.2 install which I have in development and am planning to move to production. I am using the XMLUI with Mirage2 theme. I found that in the search results display, if there is no abstract, the system displays random information. For instance: Pellegrini Vineyards Hearn, Russell (2008) stream_source_info Hearn_PellegriniVineyards_WIWP_2008.pdf.txt stream_content_type text/plain stream_size 2036 Content-Encoding UTF-8 stream_name Hearn_PellegriniVineyards_WIWP_2008.pdf.txt Content-Type text/plain; charset=UTF-8... Pellegrini Vineyards 4/30/08 Pellegrini Vineyards • FIRST VINTAGE: 1991 • OPERATED BY: Bob and Joyce Pellegrini • WINEMAKER: Russell Hearn • WINES: • East End Select- Chardonnay, Rosé, Merlot • Pellegrini Vineyards- Chardonnay, Merlot... If I add an abstract to the item, then the search displays changes to: Pellegrini Vineyards Hearn, Russell (2008) Added abstract here… Has anyone else seen this? Does anyone know what is going on or where I can go to fix this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (resend)
Thanks, helix84! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, June 17, 2015 9:57 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Search Result display in Mirage2 theme (resend) The text being displayed stream_source_info ... is the literal value coming from the fulltext or fulltext_hl field value in your Solr search core. I'm not sure why the literal value is being shown instead of just the parts of fulltext containing the search terms, but this should give you an idea where to start looking. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Problem with Search Result display in Mirage2 theme
Hi… I am not sure if this has already been reported, but I found something strange with my DSpace 5.2 install which I have in development and am planning to move to production. I am using the XMLUI with Mirage2 theme. I found that in the search results display, if there is no abstract, the system displays random information. For instance: Pellegrini Vineyards Hearn, Russell (2008) stream_source_info Hearn_PellegriniVineyards_WIWP_2008.pdf.txt stream_content_type text/plain stream_size 2036 Content-Encoding UTF-8 stream_name Hearn_PellegriniVineyards_WIWP_2008.pdf.txt Content-Type text/plain; charset=UTF-8... Pellegrini Vineyards 4/30/08 Pellegrini Vineyards • FIRST VINTAGE: 1991 • OPERATED BY: Bob and Joyce Pellegrini • WINEMAKER: Russell Hearn • WINES: • East End Select- Chardonnay, Rosé, Merlot • Pellegrini Vineyards- Chardonnay, Merlot... If I add an abstract to the item, then the search displays changes to: Pellegrini Vineyards Hearn, Russell (2008) Added abstract here… Has anyone else seen this? Does anyone know what is going on or where I can go to fix this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Strange duplication in PostgreSQL
Hi... We had a strange thing happen yesterday in our production DSpace install, and I wonder if anyone else has had this problem. First off, we are at DSpace 1.8.2 (in production) moving to DSpace 5.2 next week. Someone submitted an item into our DSpace 1.8.2 production system, and when you looked in the Recent Submissions for the collection that it was submitted to, the item was displayed 4 times. I restarted PostGreSQL and tomcat, but that didn't help, so I went into the SQL tables. I found a duplicate entry in the handles table, the communities2items table and the bi-item table. After deleting the duplicates, everything was OK. I am wondering if anyone has ever seen this or has any ideas about what caused this, and whether something like this might happen in 5.2? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 5.1, Mirage2, Requested URL /solr/search/select was not found
Sorry that my solution didn’t work for you, Kyle. Tim Donohue, Graham Tiggs and Mark Wood helped me with my problem which first appeared to be a permission problem but ended up being a conflict in tomcat. Maybe they or someone else in the DSpace community has some ideas? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Kyle Harriss [mailto:kharr...@d.umn.edu] Sent: Monday, June 01, 2015 4:07 PM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] DSpace 5.1, Mirage2, Requested URL /solr/search/select was not found Thanks for the suggestion, George! Unfortunately, it seems to be a different case here. I only have one Host entry, which reads: Host name=localhost appBase=webapps unpackWARs=true autoDeploy=true Regards, Kyle -- Kyle Harriss Kathryn A. Martin Library University of Minnesota Duluth kharr...@d.umn.edumailto:kharr...@d.umn.edu (218) 726-6546 On Mon, Jun 1, 2015 at 2:35 PM, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Kyle: I am not sure if this is the answer to your problem, but I ran into the exact same problem when we did our upgrade to DSpace 5.1, and I discovered that the problem was in the tomcat server.xml file. At our site, I had 2 Host entries defined. One was for Host name=localhost that was configured to load *everything* under the webapps subdirectory. The other was for our development site: Host name=ecommons-test.library.cornell.eduhttp://ecommons-test.library.cornell.edu which was configured to load webapps/xmlui and webapps/jspui This worked fine for DSpace 1.8 through DSpace 4.3, but the minute that I went to DSpace 5.1, it caused the problem that you are describing. I had to change my server.xml file so that there is only one host defined, and that fixed my problem. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924tel:607-255-8924 From: Kyle Harriss [mailto:kharr...@d.umn.edumailto:kharr...@d.umn.edu] Sent: Monday, June 01, 2015 2:48 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] DSpace 5.1, Mirage2, Requested URL /solr/search/select was not found Hello, What we've set up and what works == We upgraded our test server from DSpace 3.1 to DSpace 5.1/Mirage2 I have tomcat running under the username dspace. The user dspace owns the [dspace] directory and all it's subdirectories. Everything that does not involve a search or an indexed list seems to work. I can enter the admin module and view stats. Additional item views and downloads show up in stats report the next day. I can follow a link to an item record, view the full item record, download the document (bitstream). What doesn't work If I try to browse a collection, I get: Expected mime type application/octet-stream but got text/html...404 Not Found..The requested URL /solr/search/select was not found on this server... If I search for a word that I know should produce a list of results, I get: Search produced no search results. Testing one solution - failed = I recently tried opening [dspace]/solr and removing the subdirectories search and statistics and then recompiled DSpace 5.1 and rebooted the server. The subdirectories were recreated - but there was no change in behavior. Trying to connect to solr == I set up an ssh tunnel from port 8080 on my desktop PC to port 8080 on the server running dspace. In a web browser, http://localhost:8080 opens the public home page for the repository. But trying to connect to http://localhost:8080/solr yields the message Page cannot be found. Could it be..? == Are there some solr config settings I might need to check? Or is this possibly a firewall problem on the test server? Any suggestions for what I should check next? All comments and suggestions are appreciated. Thank you! Kyle -- Kyle Harriss Kathryn A. Martin Library University of Minnesota Duluth kharr...@d.umn.edumailto:kharr...@d.umn.edu (218) 726-6546tel:%28218%29%20726-6546 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 5.1, Mirage2, Requested URL /solr/search/select was not found
Kyle: I am not sure if this is the answer to your problem, but I ran into the exact same problem when we did our upgrade to DSpace 5.1, and I discovered that the problem was in the tomcat server.xml file. At our site, I had 2 Host entries defined. One was for Host name=localhost that was configured to load *everything* under the webapps subdirectory. The other was for our development site: Host name=ecommons-test.library.cornell.edu which was configured to load webapps/xmlui and webapps/jspui This worked fine for DSpace 1.8 through DSpace 4.3, but the minute that I went to DSpace 5.1, it caused the problem that you are describing. I had to change my server.xml file so that there is only one host defined, and that fixed my problem. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Kyle Harriss [mailto:kharr...@d.umn.edu] Sent: Monday, June 01, 2015 2:48 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] DSpace 5.1, Mirage2, Requested URL /solr/search/select was not found Hello, What we've set up and what works == We upgraded our test server from DSpace 3.1 to DSpace 5.1/Mirage2 I have tomcat running under the username dspace. The user dspace owns the [dspace] directory and all it's subdirectories. Everything that does not involve a search or an indexed list seems to work. I can enter the admin module and view stats. Additional item views and downloads show up in stats report the next day. I can follow a link to an item record, view the full item record, download the document (bitstream). What doesn't work If I try to browse a collection, I get: Expected mime type application/octet-stream but got text/html...404 Not Found..The requested URL /solr/search/select was not found on this server... If I search for a word that I know should produce a list of results, I get: Search produced no search results. Testing one solution - failed = I recently tried opening [dspace]/solr and removing the subdirectories search and statistics and then recompiled DSpace 5.1 and rebooted the server. The subdirectories were recreated - but there was no change in behavior. Trying to connect to solr == I set up an ssh tunnel from port 8080 on my desktop PC to port 8080 on the server running dspace. In a web browser, http://localhost:8080 opens the public home page for the repository. But trying to connect to http://localhost:8080/solr yields the message Page cannot be found. Could it be..? == Are there some solr config settings I might need to check? Or is this possibly a firewall problem on the test server? Any suggestions for what I should check next? All comments and suggestions are appreciated. Thank you! Kyle -- Kyle Harriss Kathryn A. Martin Library University of Minnesota Duluth kharr...@d.umn.edumailto:kharr...@d.umn.edu (218) 726-6546 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about SQL query
Hi, Everyone: Is there a PostGreSQL query that can be run (DSpace 5.1) to find which items and/or bitstreams are controlled by which groups? Thanks in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about adding a Search Filter
Andrea and Hilton: Thank you. Sure enough, I forgot to re-index. My problem is solved. This proves that there are no stupid questions (just stupid programmers like me ;-) ) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Monday, May 11, 2015 5:19 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about adding a Search Filter Hi George, On 12/05/15 08:16, George Stanley Kozak wrote: I am using DSpace 5.1 with a Mirage 2 theme. I recently added a new browse and search filter based on dc.type. The browse for types works correctly. However, if I do a search and then add the advanced search filter of type, I get no hits. For the search filter, I updated dspace/config/spring/api/discovery.xml to add the Search Filter for type. Stupid question, but did you restart tomcat and do a reindex for discovery after the change to discovery.xml? I think both are needed for this type of change. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about SQL query
Thanks, helix84! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, May 12, 2015 10:44 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about SQL query On Tue, May 12, 2015 at 4:23 PM, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Is there a PostGreSQL query that can be run (DSpace 5.1) to find which items and/or bitstreams are controlled by which groups? It's all in the resourcepolicy table. So for bitstreams: SELECT * FROM resourcepolicy WHERE resource_type_id = '0' and for items (with item handle added): SELECT handle.handle, resourcepolicy.* FROM resourcepolicy, handle WHERE resourcepolicy.resource_type_id = '2' AND resourcepolicy.resource_id = handle.resource_id Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about adding a Search Filter
Hello, Everyone: I am using DSpace 5.1 with a Mirage 2 theme. I recently added a new browse and search filter based on dc.type. The browse for types works correctly. However, if I do a search and then add the advanced search filter of type, I get no hits. For the search filter, I updated dspace/config/spring/api/discovery.xml to add the Search Filter for type. Does anyone have any suggestions as to what I might be doing wrong? Thank you in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Creative Commons Question
Hello, Everyone: I was asked recently why DSpace uses Creative Commons 3.0 (https://creativecommons.org/licenses/by/3.0/) instead of Creative Commons 4.0 (https://creativecommons.org/licenses/by/4.0/). Can someone answer that? And are there any plans to go to using Creative Commons 4.0? Thanks George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Altering Advance Search in DSpace 5.1 XMLUI
Andrea and Peter: Thank you for your help. This is exactly what I needed to know. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer schw...@waikato.ac.nz Sent: Monday, May 4, 2015 5:33 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Altering Advance Search in DSpace 5.1 XMLUI Hi, On 05/05/15 07:38, George Stanley Kozak wrote: I need to add Type to the Filters and I'm pretty sure I know how to do that (by altering spring/api/discovery.xml), but I can't figure out where the modifiers: Contains, Equals, ID, etc. are coming from. I need to drop ID and Not ID. Can someone point me in the right direction? If you're happy to modify the Java code, it's here: https://github.com/DSpace/DSpace/blob/dspace-5.1/dspace-xmlui/src/main/java/org/dspace/app/xmlui/aspect/discovery/SimpleSearch.java#L249 (and line 246) I use grep/find for this sort of thing (just in case this helps someone down the line): [in dspace-src] rgrep 'Not ID' dspace-xmlui/src/main/ dspace-xmlui/src/main/resources/aspects/Discovery/i18n/messages.xml: message key=xmlui.Discovery.SimpleSearch.filter.notauthorityNot ID/message [in dspace-src] find . -name SimpleSearch.java ./dspace-xmlui/src/main/java/org/dspace/app/xmlui/aspect/discovery/SimpleSearch.java ./dspace-xmlui/src/main/java/org/dspace/app/xmlui/aspect/artifactbrowser/SimpleSearch.java and since the messages.xml entry refers to Discovery, you know you'll want the first of these two classes, and then search for where the message key is used. If you prefer to make XSL changes, the DRI is here: http://demo.dspace.org/xmlui/DRI/discover so you may just be able to get away with an empty template for something like dri:field[starts-with(@id, 'aspect.discovery.SimpleSearch.field.filter_relational_operator_')]/dri:option[@returnValue='notauthority' or @returnValue='authority'] in your theme.xsl file -- but I haven't tried that. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about statistics and Mirage2
Thanks, Hilton: I found the problem in my usage-statistics.cfg file. I had an incorrect setting. I am seeing my stats, now. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Monday, April 27, 2015 10:56 AM To: George Stanley Kozak Cc: Bram Luyten; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about statistics and Mirage2 Hi George Are you creating the reports using a daily script? See: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Daily_Admin/4.X If so, then these reports are normally only available to a super-admin AFAIK. I will add info to the statistics wiki page to clear up the confusion. Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator JS Gericke Library Room 1025C Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 On 27 April 2015 at 16:27, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Bram: Hmmm…I thought that I have the config set right, but I am not seeing the statistics link. I suspect I have some setting wrong. I will do some digging. Thank you for showing me the link. My thanks for to you and Hilton. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: bluy...@gmail.commailto:bluy...@gmail.com [mailto:bluy...@gmail.commailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: Friday, April 24, 2015 5:01 PM To: George Stanley Kozak Cc: Hilton Gibson; dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about statistics and Mirage2 Hi George, the button should be on the lower right in the right nav bar, as shown here: http://demo.dspace.org/xmlui/handle/10673/130 If the button is not there in your interface, check this property in your config, as the view might be restricted to admins only https://github.com/DSpace/DSpace/blob/master/dspace/config/modules/usage-statistics.cfg#L17 cheers, Bram -- [Image removed by sender. logo] Bram Luyten 2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010 Esperantolaan 4, Heverlee 3001, Belgium www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On 24 April 2015 at 22:44, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Thanks, Hilton: I’m not sure if that addresses my issue. I have the statistics set up properly, but in the Mirage2 theme, I don’t see any method for displaying them. I can get them to appear if I type: http://myhttp://%3cmy test server/handle/prefix/id/statistics but I don’t see anything in the Mirage2 nav bars or elsewhere that invokes this function. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Hilton Gibson [mailto:hilton.gib...@gmail.commailto:hilton.gib...@gmail.com] Sent: Friday, April 24, 2015 3:43 PM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about statistics and Mirage2 Hi George Perhaps this will help: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Statistics Also see: http://scholar.sun.ac.za/handle/10019.1/1/stats Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator JS Gericke Library Room 1025C Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100tel:%2B27%2021%20808%204100 | Cell: +27 84 646 4758tel:%2B27%2084%20646%204758 On 24 April 2015 at 21:36, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi… We are gearing up to cut over our production DSpace 1.8.2 JSPUI system to DSpace 5.1 XMLUI (using Mirage2 theme). In our DSpace 1.8.2 JSPUI system, we had a “view Statistics” button that was available on the Community, Collection and Item pages. I do not see a comparable function in Mirage2. Am I missing something, or does that feature not exist for Mirage2? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y ___ DSpace-tech mailing list DSpace-tech
Re: [Dspace-tech] Question about statistics and Mirage2
Thanks, Hilton: I’m not sure if that addresses my issue. I have the statistics set up properly, but in the Mirage2 theme, I don’t see any method for displaying them. I can get them to appear if I type: http://myhttp://%3cmy test server/handle/prefix/id/statistics but I don’t see anything in the Mirage2 nav bars or elsewhere that invokes this function. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Friday, April 24, 2015 3:43 PM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about statistics and Mirage2 Hi George Perhaps this will help: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Statistics Also see: http://scholar.sun.ac.za/handle/10019.1/1/stats Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator JS Gericke Library Room 1025C Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 On 24 April 2015 at 21:36, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi… We are gearing up to cut over our production DSpace 1.8.2 JSPUI system to DSpace 5.1 XMLUI (using Mirage2 theme). In our DSpace 1.8.2 JSPUI system, we had a “view Statistics” button that was available on the Community, Collection and Item pages. I do not see a comparable function in Mirage2. Am I missing something, or does that feature not exist for Mirage2? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Error when trying to login in DSpace 5.1
Hello: I recently upgraded from DSpace 4.3 to DSpace 5.1 (XMLUI) using a theme based on Mirage2. We just noticed a peculiar problem. In our theme, we place the name of the user on the screen when they log in. This worked fine in DSpace 4.3, but when I went to DSpace 5.1, I see the following errors when a person logs in: 2015-04-15 15:46:23,333 ERROR org.dspace.content.DSpaceObject @ Loading item - cannot find metadata field -1 for resourceType=7 and resourceId=5 2015-04-15 15:46:23,333 ERROR org.dspace.content.DSpaceObject @ Loading item - cannot find metadata field -1 for resourceType=7 and resourceId=5 2015-04-15 15:46:23,334 ERROR org.dspace.content.DSpaceObject @ Loading item - cannot find metadata field -1 for resourceType=7 and resourceId=5 2015-04-15 15:46:23,334 ERROR org.dspace.content.DSpaceObject @ Loading item - cannot find metadata field -1 for resourceType=7 and resourceId=5 And the user's name does not appear on the screen. Also, when a person tries to log in using Shibboleth (also worked in 4.3), we get AUTHENTICATION FAILED and I see the following in the logs: 2015-04-15 15:46:23,338 ERROR org.dspace.authenticate.ShibAuthentication @ Unable to successfully authenticate using shibboleth for user because of an exception. java.sql.SQLException: Invalid metadata field: [eperson.firstname] at org.dspace.content.DSpaceObject.updateMetadata(DSpaceObject.java:122) at org.dspace.eperson.EPerson.update(EPerson.java:1056) at org.dspace.authenticate.ShibAuthentication.updateEPerson(ShibAuthentication.java:825) at org.dspace.authenticate.ShibAuthentication.authenticate(ShibAuthentication.java:221) at org.dspace.authenticate.AuthenticationManager.authenticateInternal(AuthenticationManager.java:162) at org.dspace.authenticate.AuthenticationManager.authenticate(AuthenticationManager.java:99) at org.dspace.app.xmlui.utils.AuthenticationUtil.authenticate(AuthenticationUtil.java:107) at org.dspace.app.xmlui.aspect.eperson.ShibbolethAction.act(ShibbolethAction.java:64) (---etc) Has there been some change in the way the eperson data is handled between 4.3 and 5.1? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Tim and Graham: Here are excerpts from my tomcat sever.xml file (again, this works OK under DSpace 4.3 and lower): Engine name=Catalina defaultHost=localhost ... Host name=localhost appBase=webapps unpackWARs=true autoDeploy=true ... Host name=ecommons-test.library.cornell.edu debug=0 unpackWARs=true autoDeploy=false ... Context path= docBase=[tomcat]/webapps/xmlui / ... Context path=/jspui docBase=[ tomcat]/webapps/jspui / Do you think that this kind of configuration could cause the problem I am observing? And, if so, why doesn't it happen at a lower version of DSpace? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, April 09, 2015 9:24 AM To: George Stanley Kozak; Graham Triggs; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, On 4/8/2015 1:48 PM, George Stanley Kozak wrote: By the way, I run my webapps under tomcat, but I know that some of you run the webapps in their dspace directory. Is there any advantage to doing one or another? It's really just a matter of preference, it doesn't matter which way you load your webapps via Tomcat. But, as Graham notes, the one thing you don't want to do is have a single webapp loaded *twice*. So, if your XMLUI (or JSPUI) webapp is both under [tomcat]/webapps/ and configured under [tomcat]/config/Catalina/localhost/ , then Tomcat may be essentially running two copies of it. As Graham notes, this also could be a possible cause of the Solr lock errors. Out of curiosity, are you running both XMLUI and JSPUI in parallel? While I've never heard it reported, I wonder if doing so could be causing that same sort of issue -- one webapp obtains Solr access, and the other then hits lock errors. (Again though, this is complete speculation...just trying to determine what may be unique about your 5.1 setup) - Tim -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Thanks, Brian: I set my tomcat server.xml as you indicated, but I am still having the same problem with the indexes. I'm not sure what could be wrong. As I stated earlier, everything works fine if I am running DSpace 4.3 and I only have problems once I upgrade to 5.1. In any case, I thank you and Tim and Hilton and Andrea for your help so far. This problem has stumped me. -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Tuesday, April 07, 2015 4:40 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hey there, Sorry for not being descriptive enough. In tomcat.xml, there's a Host section where the DSpace app context fragments go: ___ Host name=localhost appBase=/opt/dspace/webapps unpackWARs=true autoDeploy=true xmlValidation=false xmlNamespaceAware=false !-- DEFINE A CONTEXT PATH FOR DSpace XML User Interface (Manakin) -- Context path=/ docBase=/opt/dspace/webapps/xmlui debug=0 reloadable=true cachingAllowed=false allowLinking=true/ ___ In that first line, the appBase may still be pointed to Tomcat's default. For us, it let DSpace start and function semi-well, but none of the SOLR stuff would work. B-- -Original Message- From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Tuesday, April 7, 2015 2:04 PM To: Brian Freels-Stendel; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi, Brian: Sorry for being dense, but what do you mean by updating the appBase directory? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Tuesday, April 07, 2015 3:47 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Good afternoon, We saw very similar errors (particularly Expected mime type application/octet-stream but got text/html) and found that we hadn't updated the appBase directory in tomcat.xml. Another symptom of ours was the code of the entire error page being written to the dspace log. It's a longshot, but perhaps something to check. B-- -Original Message- From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Tuesday, April 7, 2015 1:28 PM To: Tim Donohue; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi, Tim: To answer one of your questions: my original DSpace 1.8.2 solr statistics core did have data in it. Attached is a snapshot of the index directory. Now, I did as you asked. I deleted the all of the solr cores (actually everything under /cul/app/dspace/solr) I did the mvn and ant update and everything went well. I copied the webapps over to tomcat and restarted tomcat. I watched the DSpace log and the catalina.out log. Everything seemed to move along smoothly. When everything was done, I waited a few minutes before I went to my DSpace home page. When my home page came up, I began to see errors in my DSpace log: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=B3B12E105B95C8FB8E63E9FB94B5971F:ip_addr=128.84.117.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search Any attempt to do any browse or search results with errors. By the way, the errors on the web appear with org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. And then raw HTML after that. What has me stumped is that outside of the problem with the solr statistics, none of these problems appear in my DSpace 4.3 upgrade. I have no write lock problems in DSpace 4.3 install. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, April 07, 2015 2:33 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, On 4/7/2015 1:09 PM, George Stanley Kozak wrote: Hi, Tim: 1) I did the lucene-core-3.5.0.jar manual update of the indexes. For the search index, I got no errors, but for the statistics core, I got: Exception
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Graham: I guess if I had two tomcat processes interfering with each other, I believe it would happen in both my DSpace 4.3 upgrade and my DSpace 5.1 upgrade, but everything works OK under DSpace 4.3 and then breaks down when I go to DSpace 5.1 (no changes to tomcat). However, I will do a bit more digging. Perhaps the older DSpace configs are more “forgiving” of problematic tomcat configurations. By the way, I run my webapps under tomcat, but I know that some of you run the webapps in their dspace directory. Is there any advantage to doing one or another? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Graham Triggs [mailto:grahamtri...@gmail.com] Sent: Wednesday, April 08, 2015 2:30 PM To: George Stanley Kozak; Tim Donohue; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Is it at all possible that you have two separate processes / applications attempting to access the same Solr index - so one locks it, and the other is unable to? For example, maybe a context file under tomcat/config/Catalina/localhost and an application in tomcat/webapps? Regards, G On 08/04/2015 17:17:08, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi, Tim: Yes, this has me stumped. Here is the permissions on the writelock: -rw-rw-r-- 1 dspace dspace 0 Apr 8 09:59 write.lock Tomcat is owned by the dspace user: drwxr-xr-x 3 dspace dspace 4096 Apr 2 2014 tomcat Solr is owned by the dspace user: drwxrwxr-x 6 dspace dspace 4096 Apr 8 09:58 solr I did as you suggested and stopped tomcat, recursively changed the permissions on the solr indexes: sudo chown -R dspace:dspace /cul/app/dspace/solr I deleted the write.lock and restarted tomcat. I then did /cul/app/dspace/bin/dspace index-discovery -b Immediately, I received the write lock error and the re-index did not work. I restored the postgres database and solr indexes to what they were before and did a mvn build and ant update of my DSpace 4.3 source and everything works fine(?!?!) There is obviously some subtle difference on how DSpace 5.1 and DSpace 4.3 (and lower) are handling the solr indexes and my server set up is just right (or wrong) enough to cause this problem. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Wednesday, April 08, 2015 10:16 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, This really has me stumped. It almost starts to sound like a permissions issue in your index directory (though I know from looking back at this thread, you said you looked at that). Since you essentially started with a fresh index (no content), and it still doesn't work, this doesn't sound like an issue with the index files themselves. While DSpace 5.1 uses a newer version of Solr, it doesn't act that much different from DSpace 4.3. So, it's confusing to me that this works for you on DSpace 4.3 and not on DSpace 5.1. When you encounter that Index locked for write for core search, there should be a write.lock file sitting in your /cul/app/dspace/solr/search/data/index/ folder. What are the permissions on that write.lock file? Is it owned by your Tomcat user? Also is *everything* under /cul/app/dspace/solr/ owned by the Tomcat user (all files and subdirectories)? You may even want to try and do the following: 1. Stop Tomcat 2. Recursively change the ownership (just in case), e.g. chown -R [tomcat-user]:[tomcat-group] /cul/app/dspace/solr/ 3. Delete that write.lock 4. Start Tomcat again. 5. (You may also need to manually reindex: 'dspace index-discovery -b') Yea, I know you checked these permissions before, but I'm rather stumped as to why a fresh, empty index won't even work on your system. I've never seen that before, and it implies that there may be something lower level (like a permissions problem) causing problems with Solr. - Tim On 4/7/2015 2:28 PM, George Stanley Kozak wrote: Hi, Tim: To answer one of your questions: my original DSpace 1.8.2 solr statistics core did have data in it. Attached is a snapshot of the index directory. Now, I did as you asked. I deleted the all of the solr cores (actually everything under /cul/app/dspace/solr) I did the mvn and ant update and everything went well. I copied the webapps over to tomcat and restarted tomcat. I watched the DSpace log and the catalina.out log. Everything seemed to move along smoothly. When everything was done, I waited a few minutes before I went to my DSpace home page. When my home page
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Hi, Tim: Yes, this has me stumped. Here is the permissions on the writelock: -rw-rw-r-- 1 dspace dspace0 Apr 8 09:59 write.lock Tomcat is owned by the dspace user: drwxr-xr-x 3 dspace dspace 4096 Apr 2 2014 tomcat Solr is owned by the dspace user: drwxrwxr-x 6 dspace dspace 4096 Apr 8 09:58 solr I did as you suggested and stopped tomcat, recursively changed the permissions on the solr indexes: sudo chown -R dspace:dspace /cul/app/dspace/solr I deleted the write.lock and restarted tomcat. I then did /cul/app/dspace/bin/dspace index-discovery -b Immediately, I received the write lock error and the re-index did not work. I restored the postgres database and solr indexes to what they were before and did a mvn build and ant update of my DSpace 4.3 source and everything works fine(?!?!) There is obviously some subtle difference on how DSpace 5.1 and DSpace 4.3 (and lower) are handling the solr indexes and my server set up is just right (or wrong) enough to cause this problem. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Wednesday, April 08, 2015 10:16 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, This really has me stumped. It almost starts to sound like a permissions issue in your index directory (though I know from looking back at this thread, you said you looked at that). Since you essentially started with a fresh index (no content), and it still doesn't work, this doesn't sound like an issue with the index files themselves. While DSpace 5.1 uses a newer version of Solr, it doesn't act that much different from DSpace 4.3. So, it's confusing to me that this works for you on DSpace 4.3 and not on DSpace 5.1. When you encounter that Index locked for write for core search, there should be a write.lock file sitting in your /cul/app/dspace/solr/search/data/index/ folder. What are the permissions on that write.lock file? Is it owned by your Tomcat user? Also is *everything* under /cul/app/dspace/solr/ owned by the Tomcat user (all files and subdirectories)? You may even want to try and do the following: 1. Stop Tomcat 2. Recursively change the ownership (just in case), e.g. chown -R [tomcat-user]:[tomcat-group] /cul/app/dspace/solr/ 3. Delete that write.lock 4. Start Tomcat again. 5. (You may also need to manually reindex: 'dspace index-discovery -b') Yea, I know you checked these permissions before, but I'm rather stumped as to why a fresh, empty index won't even work on your system. I've never seen that before, and it implies that there may be something lower level (like a permissions problem) causing problems with Solr. - Tim On 4/7/2015 2:28 PM, George Stanley Kozak wrote: Hi, Tim: To answer one of your questions: my original DSpace 1.8.2 solr statistics core did have data in it. Attached is a snapshot of the index directory. Now, I did as you asked. I deleted the all of the solr cores (actually everything under /cul/app/dspace/solr) I did the mvn and ant update and everything went well. I copied the webapps over to tomcat and restarted tomcat. I watched the DSpace log and the catalina.out log. Everything seemed to move along smoothly. When everything was done, I waited a few minutes before I went to my DSpace home page. When my home page came up, I began to see errors in my DSpace log: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=B3B12E105B95C8FB8E63E9FB94B5971F:ip_addr=128.84.1 17.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search Any attempt to do any browse or search results with errors. By the way, the errors on the web appear with org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. And then raw HTML after that. What has me stumped is that outside of the problem with the solr statistics, none of these problems appear in my DSpace 4.3 upgrade. I have no write lock problems in DSpace 4.3 install. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, April 07, 2015 2:33 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Hi, Tim: 1) I did the lucene-core-3.5.0.jar manual update of the indexes. For the search index, I got no errors, but for the statistics core, I got: Exception in thread main org.apache.lucene.index.IndexNotFoundException: org.apache.lucene.store.MMapDirectory@/cul/app/dspace/solr/statistics/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e888d65 at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:118) at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:85) 2) I deleted the statistics core and did the ant update. I brought up my DSpace 5.1 test system and when I tried to do a search, I got no results. When I went to do a browse, I got: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=5749DBA88953D8B0ABDDA3FFD1DFF5F2:ip_addr=128.84.117.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search 3) I stopped tomcat, deleted the search index (as you suggested) and did the mvn build and ant update and then copied the new webapps over to tomcat. Everything looked good. I started tomcat and my site came up. Before doing anything more I ran ./dspace index-discovery -b. It ran to completion, but all searches return no hits and the browses give me the same write lock error as above. I made sure the permissions are correct (dspace user owns the solr indexes and tomcat) and removed the write lock and tried again, but again I get the same error. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, April 07, 2015 11:52 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, What happens if you do the following against your old 1.8.2 indexes: 1. wget http://search.maven.org/remotecontent?filepath=org/apache/lucene/lucene-core/3.5.0/lucene-core-3.5.0.jar; 2. java -cp lucene-core-3.5.0.jar org.apache.lucene.index.IndexUpgrader /cul/app/dspace/solr/statistics/data/index 3. java -cp lucene-core-3.5.0.jar org.apache.lucene.index.IndexUpgrader /cul/app/dspace/solr/search/data/index Do either of those IndexUpgrader commands succeed against your *old* 1.8.2 indexes? If not, could you send along the exception stacktrace? I'm just trying to determine if the issue is actually in these old 1.8.2 indexes. It may be either they are indexes from an unexpected, older version of Solr, or there's some minor index corruption here. -- To be honest, another thing to note here is that your *search* indexes can be easily rebuilt in DSpace 5.x (simply run ./dspace index-discovery -b). The only older index that really requires this upgrade process is the *statistics* index (as currently it doesn't have a reindex command). So, if your statistics index is of no importance, you could just delete both of these old indexes and upgrade to 5.1. As part of the 5.1 upgrade, a full reindex of the search index will be kicked off (when you start Tomcat). So, after a few minutes, your content should be fully reindexed and working. - Tim On 4/7/2015 10:12 AM, George Stanley Kozak wrote: Thanks for your help, Tim: I'm afraid that I keep hitting a wall when I try to upgrade to DSpace 5.1 I tried to go directly from DSpace 1.8.2 to DSpace 5.1 and got: ERROR occurred while checking Solr index version: Exception in thread main java.io.IOException: Could not read Lucene segments files in /cul/app/dspace/solr/statistics/data/index We have been using our own stats gathering system instead of the one within DSpace. So, I removed the statistics index but then I got: Exception in thread main java.io.IOException: Could not read Lucene segments files in /cul/app/dspace/solr/search/data/index This version of Lucene only supports indexes created with release 3.0 and later. So, I went ahead and used the DSpace 4.3 version of our solr indexes (without the statistics). It ran fine and everything got upgraded, but when I tried to do any searching, I get the write lock error. If I turn off tomcat, delete the write lock and restart things, I get the same thing. Also, I cannot update the discovery index because of the write lock problem. By the way, I did try the manual upgrade of the Solr indexes defined in the manual, but that didn't work for me, either. So, right now, it looks like I can only upgrade to DSpace 4.3, unless you have some more suggestions for me. George Kozak Digital Library Specialist
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Hi, Tim: To answer one of your questions: my original DSpace 1.8.2 solr statistics core did have data in it. Attached is a snapshot of the index directory. Now, I did as you asked. I deleted the all of the solr cores (actually everything under /cul/app/dspace/solr) I did the mvn and ant update and everything went well. I copied the webapps over to tomcat and restarted tomcat. I watched the DSpace log and the catalina.out log. Everything seemed to move along smoothly. When everything was done, I waited a few minutes before I went to my DSpace home page. When my home page came up, I began to see errors in my DSpace log: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=B3B12E105B95C8FB8E63E9FB94B5971F:ip_addr=128.84.117.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search Any attempt to do any browse or search results with errors. By the way, the errors on the web appear with org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. And then raw HTML after that. What has me stumped is that outside of the problem with the solr statistics, none of these problems appear in my DSpace 4.3 upgrade. I have no write lock problems in DSpace 4.3 install. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, April 07, 2015 2:33 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, On 4/7/2015 1:09 PM, George Stanley Kozak wrote: Hi, Tim: 1) I did the lucene-core-3.5.0.jar manual update of the indexes. For the search index, I got no errors, but for the statistics core, I got: Exception in thread main org.apache.lucene.index.IndexNotFoundException: org.apache.lucene.store.MMapDirectory@/cul/app/dspace/solr/statistics/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e888d65 at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:118) at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:85) This would imply that the search index upgraded fine (no errors). But, the error for your statistics index almost implies that it's not a valid Solr index. Do you use the statistics index? Is there anything in the /cul/app/dspace/solr/statistics/data/index directory or is it empty? 2) I deleted the statistics core and did the ant update. I brought up my DSpace 5.1 test system and when I tried to do a search, I got no results. When I went to do a browse, I got: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=5749DBA88953D8B0ABDDA3FFD1DFF5F2:ip_addr=128.84.1 17.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search 3) I stopped tomcat, deleted the search index (as you suggested) and did the mvn build and ant update and then copied the new webapps over to tomcat. Everything looked good. I started tomcat and my site came up. Before doing anything more I ran ./dspace index-discovery -b. It ran to completion, but all searches return no hits and the browses give me the same write lock error as above. I made sure the permissions are correct (dspace user owns the solr indexes and tomcat) and removed the write lock and tried again, but again I get the same error. These other two errors seem rather odd to me...like something else is accessing Solr at the same time in which you are trying to reindex, and those multiple simultaneous writes are throwing errors. Can you try something even more simplistic than what you've done above? 1. Stop Tomcat 2. Copy your 1.8.3 data over to where you will install DSpace 5 3. Immediately delete *everything* under /cul/app/dspace/solr/ (including the entire statistics and search subdirectories). This will wipe out all existing indexes, obviously. 4. Build DSpace 5.1 (mvn package). Then run ant update. This should complete, as you'll have no existing Solr indexes for it to complain about. 5. Finally, start Tomcat back up. Now, sit back and wait. Don't run any other commands. But, feel free to check the logs for any issues as Tomcat boots
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Hi, Brian: Sorry for being dense, but what do you mean by updating the appBase directory? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Tuesday, April 07, 2015 3:47 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Good afternoon, We saw very similar errors (particularly Expected mime type application/octet-stream but got text/html) and found that we hadn't updated the appBase directory in tomcat.xml. Another symptom of ours was the code of the entire error page being written to the dspace log. It's a longshot, but perhaps something to check. B-- -Original Message- From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Tuesday, April 7, 2015 1:28 PM To: Tim Donohue; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi, Tim: To answer one of your questions: my original DSpace 1.8.2 solr statistics core did have data in it. Attached is a snapshot of the index directory. Now, I did as you asked. I deleted the all of the solr cores (actually everything under /cul/app/dspace/solr) I did the mvn and ant update and everything went well. I copied the webapps over to tomcat and restarted tomcat. I watched the DSpace log and the catalina.out log. Everything seemed to move along smoothly. When everything was done, I waited a few minutes before I went to my DSpace home page. When my home page came up, I began to see errors in my DSpace log: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=B3B12E105B95C8FB8E63E9FB94B5971F:ip_addr=128.84.117.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search Any attempt to do any browse or search results with errors. By the way, the errors on the web appear with org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. And then raw HTML after that. What has me stumped is that outside of the problem with the solr statistics, none of these problems appear in my DSpace 4.3 upgrade. I have no write lock problems in DSpace 4.3 install. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, April 07, 2015 2:33 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, On 4/7/2015 1:09 PM, George Stanley Kozak wrote: Hi, Tim: 1) I did the lucene-core-3.5.0.jar manual update of the indexes. For the search index, I got no errors, but for the statistics core, I got: Exception in thread main org.apache.lucene.index.IndexNotFoundException: org.apache.lucene.store.MMapDirectory@/cul/app/dspace/solr/statistics/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e888d65 at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:118) at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:85) This would imply that the search index upgraded fine (no errors). But, the error for your statistics index almost implies that it's not a valid Solr index. Do you use the statistics index? Is there anything in the /cul/app/dspace/solr/statistics/data/index directory or is it empty? 2) I deleted the statistics core and did the ant update. I brought up my DSpace 5.1 test system and when I tried to do a search, I got no results. When I went to do a browse, I got: ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @ anonymous:session_id=5749DBA88953D8B0ABDDA3FFD1DFF5F2:ip_addr=128.84.1 17.195:Error in Discovery while setting up date facet range:date facet\colon; dateIssued.year SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search 3) I stopped tomcat, deleted the search index (as you suggested) and did the mvn build and ant update and then copied the new webapps over to tomcat. Everything looked good. I started tomcat and my site came up. Before doing anything more I ran ./dspace index-discovery -b. It ran
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Tim: Thank you for your advice. I did try the 5.1 ant update, but it failed. Maybe if I tried it going from DSpace 3.3 or 1.8.2 directly to DSpace 5.1 instead of doing the intermediate step to 4.3, this might work? I will try a few other things and let everyone know what works. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Tim Donohue tdono...@duraspace.org Sent: Monday, April 6, 2015 4:44 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information) Hi George, The error below is essentially saying that your Solr statistics index is too old for the version of Solr packages with DSpace 4.3 to upgrade. However, in the DSpace 5.1 upgrade process, during the ant update step, we've attempted to catch this scenario automatically -- we try to determine the version of a Solr index, and upgrade it automatically to the latest version. So, I'd recommend trying to point DSpace 5.1 at your old Solr index, and running ant update. It is supposed to upgrade an old index automatically. If that doesn't work for some reason, another option is to do a more manual upgrade, as described in the DSpace 5.x documentation. This manual upgrade essentially requires downloading multiple versions of the Solr/Lucene core JAR, and running it against your index in order to upgrade it to the latest compatible version (this is essentially the same process that is now automated by ant update though) https://wiki.duraspace.org/display/DSDOC5x/Upgrading+DSpace#UpgradingDSpace-ManuallyUpgradingSolrIndexes By the way, from your earlier messages, recently I also did encounter that odd Solr write.lock error (Index locked for write..) during a recent upgrade I tried to 5.1. In my situation, it seemed like it was a stale write.lock file which was somehow sitting around. After clearing it out, the upgrade proceeded. Admittedly, I still need to dig a bit further and ensure my analysis is correct. - Tim On 4/1/2015 3:16 PM, George Stanley Kozak wrote: Hi, Everyone: I have discovered that when I try to optimize my Solr indexes when I upgraded from DSpace 3.3 to 4.3 (wget ‘http://localhost:8080/solr/statistics/update?optimize=true’) I get the following errors in the solr logs: ERROR org.apache.solr.core.CoreContainer @ Unable to create core: statistics Format version is not supported (resource: segment _32 in resource ChecksumIndexInput(MMapIndexInput(path=/cul/app/dspace/solr/statistics/data/index/segments_1p0))): 2.x. This version of Lucene only supports indexes created with release 3.0 and later. If I later try to upgrade to 5.1, I see during the ant update: /cul/app/dspace/src/dspace-5.1-src-release/dspace/target/dspace-installer/build.xml:1061: ERROR occurred while checking Solr index version: Exception in thread main java.io.IOException: Could not read Lucene segments files in /cul/app/dspace/solr/statistics/data/index I know the 5.1 documentation states that you can manually update the Solr indexes. Should that be done in my 4.3 upgrade before I try to go to 5.1 or should it be done in the 5.1 upgrade? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT
Re: [Dspace-tech] Error after install of DSpace 5.1
Thanks, Andrea: I do backup everything with every upgrade and that has been a help since I have had to go back and forth from 4.x to 5.x multiple times. I might just drop teh stats since I am not using them for my test instance. I am planning on converting our production instance soon, and I may take the the indexes from that and try them and see if I get the same error. Thanks for your help. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer schw...@waikato.ac.nz Sent: Wednesday, April 1, 2015 11:09 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 Hi, On 02/04/15 12:50, George Stanley Kozak wrote: ?Andrea: I'm not sure if you saw my follow up post. Yes, I did see errors in the Solr log. It is: ERROR org.apache.solr.core.CoreContainer @ Unable to create core: statistics Format version is not supported (resource: segment _32 in resource ChecksumIndexInput(MMapIndexInput(path=/cul/app/dspace/solr/statistics/data/index/segments_1p0))): 2.x. This version of Lucene only supports indexes created with release 3.0 and later. If I later try to upgrade to 5.1, I see during the ant update: /cul/app/dspace/src/dspace-5.1-src-release/dspace/target/dspace-installer/build.xml:1061: ERROR occurred while checking Solr index version: Exception in thread main java.io.IOException: Could not read Lucene segments files in /cul/app/dspace/solr/statistics/data/index No sorry, I didn't see that. I did however run into a very similar problem with one of my own DSpace 5.1 development instances the other day. I'm not quite sure what state the solr indexes were in at that stage, so I'm not sure how to reproduce it. It does look like we should add a big warning to the upgrade instructions for people to back up their solr index first -- my problem went away when I re-set the usage stats data dir in my dev instance to a fresh copy from (4.2) production. I did try to manually update the Solr statistics using the instructions in the DSpace 5.1 Manual, but that didn't seem to help.. My suspicion is that once the upgrade fails halfway through for some reason, there is no way to recover from the situation. Hence the importance of the back-up! Is there a way to tell the DSpace that we don't want to use the Solr Stats? We have our own statistics gathering so I'm really not using them. It looks like you can disable adding new hits to the Solr statistics by commenting out the SolrLoggerUsageEventListener bean in dspace-xmlui/src/main/webapp/WEB-INF/spring/applicationContext.xml (XMLUI) / dspace-jspui/src/main/webapp/WEB-INF/spring//applicationContext.xml (JSPUI). Then you could delete the contents of [dspace]/solr/statistics/data (for anyone following along on this -- this _will_ wipe all your usage stats data! Do this only when you're sure that's what you want!) and that should be it. But I've never tried this, so it may break lots of things in lots of interesting ways. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Hi, Everyone: I have been working on debugging the problems that I had upgrading from DSpace 4.x to DSpace 5.x for several days. I went ahead and redid my installs on my development server starting with DSpace 1.82, then upgrading to DSpace 3.3 and then to DSpace 4.3. I am now preparing the upgrade from 4.3 to 5.1. However, I found a problem in my upgrade from 3.3 to 4.3. When I do the optimize of the solr indexes, my optimize of core search and oai work fine, but when I try to optimize statistics, I get an internal server error: wget 'http://localhost:8080/solr/statistics/update?optimize=true' results in Connecting to localhost|::1|:8080... connected. HTTP request sent, awaiting response... 500 Internal Server Error Does anyone have suggestions as to what I can do to fix this? (By the way, the 4.3 install seems to run OK even with this error). George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
?Andrea: I'm not sure if you saw my follow up post. Yes, I did see errors in the Solr log. It is: ERROR org.apache.solr.core.CoreContainer @ Unable to create core: statistics Format version is not supported (resource: segment _32 in resource ChecksumIndexInput(MMapIndexInput(path=/cul/app/dspace/solr/statistics/data/index/segments_1p0))): 2.x. This version of Lucene only supports indexes created with release 3.0 and later. If I later try to upgrade to 5.1, I see during the ant update: /cul/app/dspace/src/dspace-5.1-src-release/dspace/target/dspace-installer/build.xml:1061: ERROR occurred while checking Solr index version: Exception in thread main java.io.IOException: Could not read Lucene segments files in /cul/app/dspace/solr/statistics/data/index I did try to manually update the Solr statistics using the instructions in the DSpace 5.1 Manual, but that didn't seem to help.. Is there a way to tell the DSpace that we don't want to use the Solr Stats? We have our own statistics gathering so I'm really not using them. ? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer schw...@waikato.ac.nz Sent: Wednesday, April 1, 2015 6:11 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 Hi George, On 02/04/15 04:22, George Stanley Kozak wrote: I found a problem in my upgrade from 3.3 to 4.3. When I do the optimize of the solr indexes, my optimize of core search and oai work fine, but when I try to optimize statistics, I get an internal server error: wget 'http://localhost:8080/solr/statistics/update?optimize=true' results in Connecting to localhost|::1|:8080... connected. HTTP request sent, awaiting response... 500 Internal Server Error Does anyone have suggestions as to what I can do to fix this? (By the way, the 4.3 install seems to run OK even with this error). Is there any more information about the 500 error? Maybe in the solr log or in the tomcat log, either from the time you made the request or when you started up tomcat? cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional information)
Hi, Everyone: I have discovered that when I try to optimize my Solr indexes when I upgraded from DSpace 3.3 to 4.3 (wget 'http://localhost:8080/solr/statistics/update?optimize=true') I get the following errors in the solr logs: ERROR org.apache.solr.core.CoreContainer @ Unable to create core: statistics Format version is not supported (resource: segment _32 in resource ChecksumIndexInput(MMapIndexInput(path=/cul/app/dspace/solr/statistics/data/index/segments_1p0))): 2.x. This version of Lucene only supports indexes created with release 3.0 and later. If I later try to upgrade to 5.1, I see during the ant update: /cul/app/dspace/src/dspace-5.1-src-release/dspace/target/dspace-installer/build.xml:1061: ERROR occurred while checking Solr index version: Exception in thread main java.io.IOException: Could not read Lucene segments files in /cul/app/dspace/solr/statistics/data/index I know the 5.1 documentation states that you can manually update the Solr indexes. Should that be done in my 4.3 upgrade before I try to go to 5.1 or should it be done in the 5.1 upgrade? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Thank you, Monika. I do check to see that tomcat is shutdown. Also, I have been finding and deleting the write.lock file, as well, but I'll keep digging. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Monika C. Mevenkamp [mailto:moni...@princeton.edu] Sent: Thursday, March 26, 2015 9:59 AM To: Andrea Schweer Cc: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 my tomcat sometimes refuses to shutdown to make sure it is really gone I do ps -ef | frep omcat this may need to be ps -aux | fgrep omcat on your system . Maybe for some strange reason the locks were not removed properly ? Look for the lock files: ls DSPACE_INSTALLDIR/solr/*/data/index/write.lock ls DSPACE_INSTALLDIR/solr/*/data/spellchecker/write.lock you can use lsof command to see which process 'owns' a file lsof DSPACE_INSTALLDIR/solr/*/data/index/write.lock Monika Monika Mevenkamp phone: 609-258-4161 Lewis Library,Washington Road and Ivy Lane, Princeton University, Princeton, NJ 08544 On Mar 25, 2015, at 8:15 PM, Andrea Schweer schw...@waikato.ac.nzmailto:schw...@waikato.ac.nz wrote: Hi George, On 26/03/15 10:55, George Stanley Kozak wrote: Yes, it has me stumped. If I restore the Solr indexes and the postgres database back to the DSpace 4.2 versions and bring up DSpace 4.2, everything works fine. I do shutdown tomcat when I do the ant step. Here are my steps, and let me know if I have forgotten anything: That all looks good so far 1) Shutdown tomcat 2) Run mvn -U clear package (I also tried with the Mirage2 option) 3) After successful build, I go to the target/dspace-install directory and run ant update As which user do you run ant? Same as the one that tomcat is running as? 4) After that is successful, I copy the webpass over to tomcat 5) Restart tomcat 6) Go to view the system The system comes up and I have access to the database records, but all browses and searches generate the index lock error. When you look for the write locks after step 5, what are their permissions? You should be able to find them (assuming a Linux system) using find [dspace]/solr -name *.lock cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Thanks, Tim: I didn't notice any errors, but I will check. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, March 26, 2015 10:04 AM To: George Stanley Kozak; Andrea Schweer; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 George, Just a note: you may want to see if any other errors occur in the DSpace or Tomcat logs when you restart tomcat (your step #5). I'm especially curious if any errors are thrown besides those index lock errors. They may provide hints as to what may be going on. - Tim On 3/25/2015 4:55 PM, George Stanley Kozak wrote: Andrea: Yes, it has me stumped. If I restore the Solr indexes and the postgres database back to the DSpace 4.2 versions and bring up DSpace 4.2, everything works fine. I do shutdown tomcat when I do the ant step. Here are my steps, and let me know if I have forgotten anything: 1)Shutdown tomcat 2)Run mvn -U clear package (I also tried with the Mirage2 option) 3)After successful build, I go to the target/dspace-install directory and run ant update 4)After that is successful, I copy the webpass over to tomcat 5)Restart tomcat 6)Go to view the system The system comes up and I have access to the database records, but all browses and searches generate the index lock error. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 *From:*Andrea Schweer [mailto:schw...@waikato.ac.nz] *Sent:* Wednesday, March 25, 2015 5:03 PM *To:* George Stanley Kozak; dspace-tech@lists.sourceforge.net *Subject:* Re: [Dspace-tech] Error after install of DSpace 5.1 Hi George, On 26/03/15 03:42, George Stanley Kozak wrote: So, I double checked the permissions on my solr index and tomcat. They are both owned by the DSpace user. If I bring my system up in DSpace 4.2 (after a restore), I have no problems. If I bring it up in 5.1, I get the error: SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search I can't even do an re-index. I have to say that I'm kind of stumped here. Works OK in 4.2, doesn't work in 5.1 How odd. Are you running the ant step (with the 5.1 code) as the same user as tomcat? Also, when you run ant for the first time using the 5.1 code, tomcat *must not* be running -- ant will upgrade the solr indexes to the version used in DSpace 5.1 and it needs to have exclusive access to the index while that runs (and the mechanism for that is the write lock, which makes me suspect it's involved in the problem you're seeing). You have presumably checked already that the ant step with the 5.1 code doesn't throw any errors. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Hello, Andrea (and everyone else): So, I double checked the permissions on my solr index and tomcat. They are both owned by the DSpace user. If I bring my system up in DSpace 4.2 (after a restore), I have no problems. If I bring it up in 5.1, I get the error: SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search I can't even do an re-index. I have to say that I'm kind of stumped here. Works OK in 4.2, doesn't work in 5.1 George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Tuesday, March 24, 2015 5:26 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 Hi George, On 25/03/15 10:06, George Stanley Kozak wrote: Thank you for your suggestions. I did check and my tomcat (tomcat 7) is owned by my dspace user as is my solr index, so tomcat should be able to write to the solr directory (it works OK for 4.2). So, I am not sure what is causing the permission problem, but I will keep checking. Have you run a chown with the -c flag on your solr directory? That will tell you about any changes it makes. Might be worth it just so you can go from tomcat should be able to write to the solr directory to tomcat is definitely able to write to the solr directory. Just on the off-chance this is happening to you: I've had nasty surprises when the solr directory was on a different partition and symlinked into [dspace], chown -R didn't work across the symlink (it changed ownership of the symlink but not of the symlinked directory). Also, if the permissions have been wrong in the past at some point, sometimes the write.lock file sticks around with wrong write permissions. In that case, it helps to stop tomcat, delete the write.lock file, then start tomcat. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Andrea: Yes, it has me stumped. If I restore the Solr indexes and the postgres database back to the DSpace 4.2 versions and bring up DSpace 4.2, everything works fine. I do shutdown tomcat when I do the ant step. Here are my steps, and let me know if I have forgotten anything: 1) Shutdown tomcat 2) Run mvn -U clear package (I also tried with the Mirage2 option) 3) After successful build, I go to the target/dspace-install directory and run ant update 4) After that is successful, I copy the webpass over to tomcat 5) Restart tomcat 6) Go to view the system The system comes up and I have access to the database records, but all browses and searches generate the index lock error. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Wednesday, March 25, 2015 5:03 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 Hi George, On 26/03/15 03:42, George Stanley Kozak wrote: So, I double checked the permissions on my solr index and tomcat. They are both owned by the DSpace user. If I bring my system up in DSpace 4.2 (after a restore), I have no problems. If I bring it up in 5.1, I get the error: SolrCore 'search' is not available due to init failure: Index locked for write for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search' is not available due to init failure: Index locked for write for core search I can't even do an re-index. I have to say that I'm kind of stumped here. Works OK in 4.2, doesn't work in 5.1 How odd. Are you running the ant step (with the 5.1 code) as the same user as tomcat? Also, when you run ant for the first time using the 5.1 code, tomcat must not be running -- ant will upgrade the solr indexes to the version used in DSpace 5.1 and it needs to have exclusive access to the index while that runs (and the mechanism for that is the write lock, which makes me suspect it's involved in the problem you're seeing). You have presumably checked already that the ant step with the 5.1 code doesn't throw any errors. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Thanks for the tips, Andrea. I will definitely check it out. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Tuesday, March 24, 2015 5:26 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 Hi George, On 25/03/15 10:06, George Stanley Kozak wrote: Thank you for your suggestions. I did check and my tomcat (tomcat 7) is owned by my dspace user as is my solr index, so tomcat should be able to write to the solr directory (it works OK for 4.2). So, I am not sure what is causing the permission problem, but I will keep checking. Have you run a chown with the -c flag on your solr directory? That will tell you about any changes it makes. Might be worth it just so you can go from tomcat should be able to write to the solr directory to tomcat is definitely able to write to the solr directory. Just on the off-chance this is happening to you: I've had nasty surprises when the solr directory was on a different partition and symlinked into [dspace], chown -R didn't work across the symlink (it changed ownership of the symlink but not of the symlinked directory). Also, if the permissions have been wrong in the past at some point, sometimes the write.lock file sticks around with wrong write permissions. In that case, it helps to stop tomcat, delete the write.lock file, then start tomcat. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Error after install of DSpace 5.1
Hi... I upgraded our DSpace 4.2 XMLUI to DSpace 5.1 (using Mirage 2). The install went fine, but once the system came up, if I try to view any records, I get: The server encountered an internal error that prevented it from fulfilling this request. and Caused by: org.apache.solr.common.SolrException: Index locked for write for core search and Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core search Does anyone have any suggestions as to what I am doing wrong? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Error after install of DSpace 5.1
Andrea and Royopa: Thank you for your suggestions. I did check and my tomcat (tomcat 7) is owned by my dspace user as is my solr index, so tomcat should be able to write to the solr directory (it works OK for 4.2). So, I am not sure what is causing the permission problem, but I will keep checking. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Tuesday, March 24, 2015 4:00 PM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 Hi George, On 25/03/15 06:42, George Stanley Kozak wrote: I upgraded our DSpace 4.2 XMLUI to DSpace 5.1 (using Mirage 2). The install went fine, but once the system came up, if I try to view any records, I get: The server encountered an internal error that prevented it from fulfilling this request. and Caused by: org.apache.solr.common.SolrException: Index locked for write for core search and Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core search Does anyone have any suggestions as to what I am doing wrong? This is a permissions problem. Tomcat needs to have write permissions on your [dspace]/solr directory and all its subdirectories. Change the permissions and restart tomcat -- hopefully that will solve the issue. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Shibboleth login on DSpace 4.2
Thanks, Tim: I will let you know if I end up solving things on my end. -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Friday, February 27, 2015 11:00 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth login on DSpace 4.2 George, One last tip/hint. I just recalled I had a Sample config for testshib.org testing sitting around. This is untested for some time, but I think it *should* work, and maybe it'll lead you in the right direction. I stuck it in a Gist (off GitHub) just cause it's easier to read there: https://gist.github.com/tdonohue/423f173bfcc2baec76ce If this ends up being helpful let me know...we can always add something similar to the official docs. - Tim On 2/27/2015 9:35 AM, Tim Donohue wrote: Hi George, While I don't know the exact answer you need (as Shibboleth admittedly can be complex and unique to how you have things setup), you may wish to review some of the hints/tips in the DSpace Shibboleth Plugin docs: https://wiki.duraspace.org/display/DSDOC5x/Authentication+Plugins#Auth enticationPlugins-ShibbolethAuthentication Specifically, if your local IdP is not working properly, you could do some initial testing against https://www.testshib.org/ (which provides a sample/demo IdP) just to try and get the basics working. The problem could be in your shibboleth2.xml, or it's even possible you have something misconfigured in your mod_shib settings (which we do have a sample for in our docs) or authentication-shibboleth.cfg. So, it's possible that trying to do testing against https://www.testshib.org/ may help you narrow down the problem area. Just an idea, if you are stumped. If you *do* discover a mistake in our docs, or a clarification we should be making, definitely let us know as we'd love to enhance the docs further for others. - Tim On 2/27/2015 9:08 AM, George Stanley Kozak wrote: Tim: Not a problem. I'm still struggling getting Shibboleth to work, but if I figure it out, I will let everyone know what I found out (it's probably just a simple configuration problem). -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, February 26, 2015 4:43 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth login on DSpace 4.2 Hi George, Apologies, I just responded to the wrong thread. :) This was meant for someone else, as you are obviously using Shibboleth authentication. - Tim On 2/26/2015 3:39 PM, Tim Donohue wrote: Hi George, Sorry for the delayed response. This issue sounds very similar to this bug: https://jira.duraspace.org/browse/DS-2421 Simply put, I'm fairly certain the LDAPAuthentication plugin is not working correctly *unless* you configure either: search.anonymous=true OR specify both: search.user and search.password These are all in the authentication-ldap.cfg configuration file. I'm still searching out a volunteer to help resolve this bug in the code. Unfortunately, I don't have an LDAP locally that I can easily test against. - Tim On 2/23/2015 1:47 PM, George Stanley Kozak wrote: Hi... I'm trying to implement the Shibboleth Login as an option on my DSpace V. 4.2 XMLUI system. I am getting the proper login screen, but after logging in, I get Authentication Failed In the DSPace logs, I see: ERROR org.dspace.authenticate.ShibAuthentication @ Shibboleth authentication was not able to find a NetId, Email, or Tomcat Remote user for which to indentify a user from. ERROR org.dspace.authenticate.ShibAuthentication @ Unable to register new eperson because we are unable to find an email address along with first and last name for the user. NetId Header: 'SHIB-NETID'='null' (Optional) Email Header: 'SHIB-MAIL'='null' First Name Header: 'SHIB-GIVENNAME'='null' Last Name Header: 'SHIB-SURNAME'='null' I'm trying to debug that now. I am wondering if I have the entityID and homeURL set correctly in my shibboleth2.xml file. What is the recommended settings for these values if one is using a DSpace installation? Thank you in advance for any help or suggestions. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 --- -- - Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/os tg .clktrk ___ DSpace-tech mailing list DSpace-tech
Re: [Dspace-tech] Shibboleth login on DSpace 4.2
Tim: Not a problem. I'm still struggling getting Shibboleth to work, but if I figure it out, I will let everyone know what I found out (it's probably just a simple configuration problem). -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, February 26, 2015 4:43 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth login on DSpace 4.2 Hi George, Apologies, I just responded to the wrong thread. :) This was meant for someone else, as you are obviously using Shibboleth authentication. - Tim On 2/26/2015 3:39 PM, Tim Donohue wrote: Hi George, Sorry for the delayed response. This issue sounds very similar to this bug: https://jira.duraspace.org/browse/DS-2421 Simply put, I'm fairly certain the LDAPAuthentication plugin is not working correctly *unless* you configure either: search.anonymous=true OR specify both: search.user and search.password These are all in the authentication-ldap.cfg configuration file. I'm still searching out a volunteer to help resolve this bug in the code. Unfortunately, I don't have an LDAP locally that I can easily test against. - Tim On 2/23/2015 1:47 PM, George Stanley Kozak wrote: Hi... I'm trying to implement the Shibboleth Login as an option on my DSpace V. 4.2 XMLUI system. I am getting the proper login screen, but after logging in, I get Authentication Failed In the DSPace logs, I see: ERROR org.dspace.authenticate.ShibAuthentication @ Shibboleth authentication was not able to find a NetId, Email, or Tomcat Remote user for which to indentify a user from. ERROR org.dspace.authenticate.ShibAuthentication @ Unable to register new eperson because we are unable to find an email address along with first and last name for the user. NetId Header: 'SHIB-NETID'='null' (Optional) Email Header: 'SHIB-MAIL'='null' First Name Header: 'SHIB-GIVENNAME'='null' Last Name Header: 'SHIB-SURNAME'='null' I'm trying to debug that now. I am wondering if I have the entityID and homeURL set correctly in my shibboleth2.xml file. What is the recommended settings for these values if one is using a DSpace installation? Thank you in advance for any help or suggestions. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 - - Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=190641631iu=/4140/ostg .clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Shibboleth login on DSpace 4.2
Tim: Thank you. The EntityID in your example was one of the things I needed. Also, I needed to find the proper value used by our site for the email-header which is defined in the authentication-shibboleth.cfg. So, I have Shibboleth working now. -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Friday, February 27, 2015 11:00 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth login on DSpace 4.2 George, One last tip/hint. I just recalled I had a Sample config for testshib.org testing sitting around. This is untested for some time, but I think it *should* work, and maybe it'll lead you in the right direction. I stuck it in a Gist (off GitHub) just cause it's easier to read there: https://gist.github.com/tdonohue/423f173bfcc2baec76ce If this ends up being helpful let me know...we can always add something similar to the official docs. - Tim On 2/27/2015 9:35 AM, Tim Donohue wrote: Hi George, While I don't know the exact answer you need (as Shibboleth admittedly can be complex and unique to how you have things setup), you may wish to review some of the hints/tips in the DSpace Shibboleth Plugin docs: https://wiki.duraspace.org/display/DSDOC5x/Authentication+Plugins#Auth enticationPlugins-ShibbolethAuthentication Specifically, if your local IdP is not working properly, you could do some initial testing against https://www.testshib.org/ (which provides a sample/demo IdP) just to try and get the basics working. The problem could be in your shibboleth2.xml, or it's even possible you have something misconfigured in your mod_shib settings (which we do have a sample for in our docs) or authentication-shibboleth.cfg. So, it's possible that trying to do testing against https://www.testshib.org/ may help you narrow down the problem area. Just an idea, if you are stumped. If you *do* discover a mistake in our docs, or a clarification we should be making, definitely let us know as we'd love to enhance the docs further for others. - Tim On 2/27/2015 9:08 AM, George Stanley Kozak wrote: Tim: Not a problem. I'm still struggling getting Shibboleth to work, but if I figure it out, I will let everyone know what I found out (it's probably just a simple configuration problem). -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, February 26, 2015 4:43 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Shibboleth login on DSpace 4.2 Hi George, Apologies, I just responded to the wrong thread. :) This was meant for someone else, as you are obviously using Shibboleth authentication. - Tim On 2/26/2015 3:39 PM, Tim Donohue wrote: Hi George, Sorry for the delayed response. This issue sounds very similar to this bug: https://jira.duraspace.org/browse/DS-2421 Simply put, I'm fairly certain the LDAPAuthentication plugin is not working correctly *unless* you configure either: search.anonymous=true OR specify both: search.user and search.password These are all in the authentication-ldap.cfg configuration file. I'm still searching out a volunteer to help resolve this bug in the code. Unfortunately, I don't have an LDAP locally that I can easily test against. - Tim On 2/23/2015 1:47 PM, George Stanley Kozak wrote: Hi... I'm trying to implement the Shibboleth Login as an option on my DSpace V. 4.2 XMLUI system. I am getting the proper login screen, but after logging in, I get Authentication Failed In the DSPace logs, I see: ERROR org.dspace.authenticate.ShibAuthentication @ Shibboleth authentication was not able to find a NetId, Email, or Tomcat Remote user for which to indentify a user from. ERROR org.dspace.authenticate.ShibAuthentication @ Unable to register new eperson because we are unable to find an email address along with first and last name for the user. NetId Header: 'SHIB-NETID'='null' (Optional) Email Header: 'SHIB-MAIL'='null' First Name Header: 'SHIB-GIVENNAME'='null' Last Name Header: 'SHIB-SURNAME'='null' I'm trying to debug that now. I am wondering if I have the entityID and homeURL set correctly in my shibboleth2.xml file. What is the recommended settings for these values if one is using a DSpace installation? Thank you in advance for any help or suggestions. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 --- -- - Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http
[Dspace-tech] Removing side nav bar in Mirage2
Hi... We at Cornell are finally making the move to XMLUI. Right now we are working on a modified Mirage2 theme using DSpace 4.2. One thing that I wanted to do was to remove the side nav bar from the item display, but I haven't figured out how to do that (without removing it from everywhere else). If anyone has done this or if anyone has some suggestions for me, please let me know. Thank you in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] An SQL question
Hi... I have a question for anyone who is familiar with the PostgreSQL tables for DSpace. This is for DSpace 1.8.2. I have a script that runs a series of SQL queries and generates reports at our site. In the reports, I list monthly downloads with the title of the item and the author(s). It turns out that in my reports, I am listing all the contributors for an item as the authors of the item. and I've been asked to just list contributor.author, only. To get the authors, I do the following: select distinct_id from bi_2_dmap where item_id=$item_id; then select value from bi_2_dis where id=$author_id;(where $author_id = distinct_id) I had assumed that these tables held just contributor.author, but it appears that they hold all contributors. Is there somewhere in SQL where the different types of contributors are identified? My thanks in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] An SQL question
Thank you, Adan! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Adan Roman [mailto:aro...@arvo.es] Sent: Monday, November 17, 2014 11:00 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] An SQL question Hi George The tables you need are metadatavalue, that contains all the metadatavalues ot the items and metadatafieldregistry, that hold the type of each metadata. You can join this author_id whith the metadata values. try: select * from metadatafieldregistry mfr, metadatavalue mv where mfr.element='contributor' and mfr.qualifier='author' and mv.metadata_field_id=mfr.metadata_field_id and mv.item_id=$item_id that gives you all the contributor.author of an item. I hope this help [cid:image001.jpg@01D00256.37A15F70] Hi... I have a question for anyone who is familiar with the PostgreSQL tables for DSpace. This is for DSpace 1.8.2. I have a script that runs a series of SQL queries and generates reports at our site. In the reports, I list monthly downloads with the title of the item and the author(s). It turns out that in my reports, I am listing all the contributors for an item as the authors of the item. and I've been asked to just list contributor.author, only. To get the authors, I do the following: select distinct_id from bi_2_dmap where item_id=$item_id; then select value from bi_2_dis where id=$author_id;(where $author_id = distinct_id) I had assumed that these tables held just contributor.author, but it appears that they hold all contributors. Is there somewhere in SQL where the different types of contributors are identified? My thanks in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- [http://static.avast.com/emails/avast-mail-stamp.png]http://www.avast.com/ El software de antivirus Avast ha analizado este correo electrónico en busca de virus. www.avast.comhttp://www.avast.com/ -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question to users of DSpace and how you Use Metadata
David: At Cornell University, we did the following: 1) In the dspace admin I went into Metadata Schema Registry and created a new namespace: ETDSchema 2) In the Schema I added the following elements/qualifiers: a. degree:discipline b. degree:grantor c. degree:level d. degree:name 3) I made changes to the dspace.cfg (webui.itemdisplay.default) and messages.properties so these would display on the item page. Our theses and dissertations are batch loaded in so I made no changes to the input-forms.xml, but I would have made changes to that if I wanted users to input that information. 4) Then a did a re-index It was pretty easy and painless. OAI picks these up OK. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Schuster, David [mailto:dschus...@mail.twu.edu] Sent: Wednesday, September 24, 2014 9:37 AM To: Lista técnica do DSpace Subject: [Dspace-tech] Question to users of DSpace and how you Use Metadata When I installed Dspace 3.x it came with out of the box Dublin Core - I'm kinda new to all of this... It has been fine, but now I am realizing that I don't have the following items Thesis - 0, 1, 2 ??? Department Degree One OAI harvest was looking for this information, but not sure the best way to add it or if I should... Do I need to change my DB schema, is that a problem mid stream? ETD-MS? What indexing would need to be adjusted - ??? what headaches will I get?? Just trying to do the right thing... David Schuster Texas Woman's University Director of Library Information Technology Technical Support Phone: 940-898-3909 dschus...@twu.edumailto:dschus...@twu.edu [Description: emailsignature] -- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Refworks with DSpace
Dear Lewatle Phaladi: What version of DSpace are you using? I have some code borrowed from the University of Wisconsin that incorporates RefWorks in DSpace. It works in DSpace 1.8.2 on down, but I wasn’t able to get it to work in my DSpace 3.2 pilot. Unfortunately, I haven’t had too much time to tinker with it. I do have the code and instructions for a DSpace 1.8.2 install, if you are interested, but if you need this for newer versions of DSpace, I guess the University of Wisconsin is your best hope. I don’t recall who I spoke to there (many years ago), but the author of the code is Rose Smith. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Lewatle Phaladi [mailto:lewatle.phal...@wits.ac.za] Sent: Thursday, July 31, 2014 2:56 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Refworks with DSpace Dear All, Is there any way that I could enable dspace to work with refworks, it can be exporting or any function, any step by step documentation or link to follow. Thanks, Lewatle This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorised signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary. -- Infragistics Professional Build stunning WinForms apps today! Reboot your WinForms applications with our WinForms controls. Build a bridge from your legacy apps to the future. http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Embargo Lifter not working?
Hi... We at Cornell University are running DSpace 1.8.2 (JSPUI) in production. I am getting ready to cut over our Production instance to DSpace 3.3 (JSPUI), but I have run into a problem in my testing. When I run the Embargo Lifter, it removes the Embargo date, but it doesn't set the embargoed bitstreams to the default read of the collection. This works fine in DSpace 1.8.2. I even tried rewriting the Lifter to specifically set the bitstreams to Anonymous Read, but embargoed settings for the bitstreams still remained. There are no errors in the logs. Does anyone have suggestions as to what could be wrong? I'm stumped. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Embargo Lifter not working?
Hilton: Thank you. I think this is it! George Kozak Cornell University Sent from my iPad On Jul 15, 2014, at 5:50 PM, Hilton Gibson hilton.gib...@gmail.commailto:hilton.gib...@gmail.com wrote: Hi George Perhaps this will help: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Embargo_Systems/3.2 Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://scholar.sun.ac.za http://bit.ly/goodir http://library.sun.ac.za http://za.linkedin.com/in/hiltongibson On 15 July 2014 22:33, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi... We at Cornell University are running DSpace 1.8.2 (JSPUI) in production. I am getting ready to cut over our Production instance to DSpace 3.3 (JSPUI), but I have run into a problem in my testing. When I run the Embargo Lifter, it removes the Embargo date, but it doesn't set the embargoed bitstreams to the default read of the collection. This works fine in DSpace 1.8.2. I even tried rewriting the Lifter to specifically set the bitstreams to Anonymous Read, but embargoed settings for the bitstreams still remained. There are no errors in the logs. Does anyone have suggestions as to what could be wrong? I'm stumped. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Problem with Date Range in Discovery Facet
Hi... I am getting ready to cut our DSpace 1.8.2 release over to DSpace 3.2. Our library has decided to go with the JSPUI interface for now (XMLUI, later) which I am running with Discovery. Our testers have found that the Date Range for Discovery Facet seems to off. For instance, on our home page, we see: Date issued 19 - 999 (1) 1000 - 1999 (5935) If you click on the first date range, you see items from 1975-1995 The second date range gives you a more accurate display of dates and ranges, but we do not see any items dated from 2000 on up. Does anyone have any idea what's going on? This does appear to work better with the XMLUI interface. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions Find What Matters Most in Your Big Data with HPCC Systems Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. Leverages Graph Analysis for Fast Processing Easy Data Exploration http://p.sf.net/sfu/hpccsystems___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] JSPUI in 4.1
Thank you, Andrea: This will greatly help. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Bollini a.boll...@cineca.it Sent: Sunday, June 8, 2014 7:09 AM To: George Stanley Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] JSPUI in 4.1 Hi George, yes starting with dspace 4 the jspui switch from a custom heavy table based style to a more clean, tableless layout build on top of bootstrap 3. Almost any jsp page in DSpace has been changed primary removing layout tables. Custom classes has been replaced by bootstrap classes as table instead of miscTable, etc. You can find some tips and the description of the new layout here: http://www.slideshare.net/DuraSpace/2514-dspace-user-interface-innovation-presentation-slides My suggestion is to start from scratch, build a bootstrap css (see slides 30-38) using your institutional palette and hack the header-*.jsp and footer.jsp Hope this help, Andrea Il 06/06/2014 15.39, George Stanley Kozak ha scritto: Hi, I accidentally sent this question first to the dspace-general list. My apologies. That's what I get for doing my email on my smart phone. Here is my question: In the past, we at Cornell University have used our own design and style sheets with the JSPUI. I have successfully migrated this design from release to release modifying the Jsp pages. However, I see that the JSPUI, in 4.1 is radically different. Are the differences in the new JSPUI documented somewhere so I can figure out if our Jsp changes will work? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Andrea Bollini Soluzioni per la Ricerca Istituzionale Cineca Via dei Tizii, 6 00185 Roma, Italy tel. +39 06 44 486 087 - mob. +39 348 82 77 525 http://www.cineca.it -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] JSPUI in 4.1
Hi, I accidentally sent this question first to the dspace-general list. My apologies. That's what I get for doing my email on my smart phone. Here is my question: In the past, we at Cornell University have used our own design and style sheets with the JSPUI. I have successfully migrated this design from release to release modifying the Jsp pages. However, I see that the JSPUI, in 4.1 is radically different. Are the differences in the new JSPUI documented somewhere so I can figure out if our Jsp changes will work? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace becomes unresponsive, and I'm out of ideas
Steve: I am not sure if this is your problem, but I found at our site that we usually have a problem like this if we are being hammered by harvesters. It seems to me that multiple harvesting of DSpace content can trigger a runaway java process (I could be wrong, but that’s my theory). Do you have a robots.txt file set up? Also, do you have a sitemap set up? Either of these can help, but won’t totally fix the problem. Another thing might be to adjust the java opts in your tomcat. I don’t know how much memory to have to play around with, but I am using: JAVA_OPTS=-server -Xms1024m -Xmx2048m -Xmn64m -Dfile.encoding=UTF-8 -XX:+UseParallelGC -verbose:gc -Xloggc:/dspace/dspace/log/gc.log -XX:+HeapDumpOnOutOfMemoryError -XX:PermSize=1024m -XX:MaxPermSize=1024m -XX:-UseGCOverheadLimit These days I am restarting tomcat once a week (usually on Friday evenings) to fix our java heap problems. I know some other DSpace users restart their tomcat every day. By the way, I am running DSpace 1.8.2 using Tomcat 7. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Steve Thomas [mailto:stephen.tho...@adelaide.edu.au] Sent: Wednesday, April 02, 2014 9:25 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] DSpace becomes unresponsive, and I'm out of ideas We're having continuing performance problems with our DSpace server. We're running version 1.6.2 on RHEL 4, so, yeah, everything is old. But service has been reliable, mostly, until recently. The symptom is that DSpace will become unresponsive at the browser. Checking the server, we'll typically find that the java process is running at 170% cpu, so my guess is a runaway process, which explains the slow/no response. But why? Checking the logs, both dspace.log and catalina.out, gives no real clue. dspace.log is typically full of broken pipe errors, but these are,I guess, another symptom. We also get broken pipe errors through the day, even when DSpace is running normally. Possibly unrelated, we also periodically find that dspace.log has filled up all available disk space -- more than 100GB! With a file that large, it's difficult to scroll through, but I've not found any obvious answers there. So I'm out of ideas here as to where to even look for cause. (And yes, I've already had the upgrade idea. Not currently an option I'm afraid.) Can anyone help with suggestions? Stephen Thomas Library Systems Manager Barr Smith Library UNIVERSITY OF ADELAIDE SA 5005 AUSTRALIA Phone: +61 8 831 35190 / Mobile: 0402 069 087 / Fax: +61 8 831 34369 Email: stephen.tho...@adelaide.edu.aumailto:stephen.tho...@adelaide.edu.au CRICOS Provider Number 00123M Please consider the environment before printing. IMPORTANT: This message may contain confidential or legally privileged information. If you think it was sent to you by mistake, please delete all copies and advise the sender. For the purposes of the SPAM Act 2003, this email is authorised by The University of Adelaide. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Java Heap Space Problems
Matt: This is something that I have been struggling with for a long time. Going to DSpace 1.8.2 and tomcat 7 seemed to help for a while. One thing that I found that caused Java heap space errors was the solar statistics button on the Community, Collection and Item pages. This isn't a problem on our test machine, but only affects our production machine, so I am assuming that it is somehow threshold related. We have a lot of records with a lot of downloads. So, I removed the statistics buttons from the JSP pages and that solved a lot of our problems, but now I seem to have a problem every Friday night and I need to reboot tomcat. My current setup for java heap is: JAVA_OPTS=-server -Xms1024m -Xmx2048m -Xmn64m -Dfile.encoding=UTF-8 -XX:+UseParallelGC -verbose:gc -Xloggc:/dspace/dspace/log/gc.log -XX:+HeapDumpOnOutOfMemoryError -XX:PermSize=1024m -XX:MaxPermSize=1024m -XX:-UseGCOverheadLimit So, I expect that I will have to up my memory usage. I think this is a creeping problem and I am not sure if this is fixed in DSpace 3.2 or 4.1. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Matthew Sherman [mailto:matt.r.sher...@gmail.com] Sent: Tuesday, March 25, 2014 3:06 PM To: dspace-tech Subject: [Dspace-tech] Java Heap Space Problems Hi all, I was hoping some one can give some insight to a problem we are having. We are running DSpace 1.8 and every couple of weeks we end up having to reboot the Tomcat because it crashes due to a Java heap space error. We have been trying to correct it since the beginning of the year by incrementally increasing the memory assigned to Java. By now we are at half the server memory, roughly 2 GB, assigned to Java and while it is taking longer we still are having to reboot due to heap space errors. We are not sure what the issue is and we are at loss as to how to fix it because throwing more memory at it is not fixing the problem. I would welcome any thoughts, suggestions, or advice on how to fix this. Thanks for your time and insights. Matt Sherman -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Changing item display to flag embargoed items more clearly in JSPUI
Andrea: What we did at Cornell University was add the Embargo date to the item display (see http://ecommons.library.cornell.edu/handle/1813/29299) and I made a change to the java code that puts up a display based on the group that controls a bitstream. So, here at Cornell, we have our embargo code set up to restrict a bitstream to a specific group embargo which has read access to the bitstream. Click on the bitstream for the item above and you will see the embargo display. I have the code for DSpace 1.8.2 and DSpace 3.2 (JSPUI or XMLUI) that does this . If you are interested in the details, I can send them to you off-list. Credit where credit is due: the java code that I am using is based on code originally created by Terry Owen at the University of Maryland. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Friday, March 21, 2014 12:39 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Changing item display to flag embargoed items more clearly in JSPUI Hi again, On 21/03/14 17:21, Andrea Schweer wrote: On 21/03/14 16:46, Barnes, Hugh wrote: We are implementing the (legacy) embargo functionality in the above environment. Ideally, we think it's better user interface to inform users that the item is embargoed, and even not taunt them with a link until that is lifted. Otherwise, users are denied access without obvious reason (and will probably contact us about it). So we really want to edit the single item display page to mark embargoed items much more clearly for users. My jspui experience is a few years old -- but might it work to change the logic in the displayItem method in HandleServlet, similar to what's done for withdrawn items? See here: https://github.com/DSpace/DSpace/blob/dspace-3_x/dspace-jspui/src/main/java/org/dspace/app/webui/servlet/HandleServlet.java#L298 except you'd have another if clause to check whether the item is embargoed according to your legacy definition of embargoed, which may or may not involve EmbargoManager.getEmbargoTermsAsDate(context,item) != null If that condition is fulfilled, pass the user on to either the same tombstone page as for withdrawn items (or a different one if you prefer) like so: JSPManager.showJSP(request, response, /tombstone.jsp); return; This approach feels a little cleaner to me than messing with extra conditionals in display-item.jsp. Actually, never mind me -- I was going by our local definition of embargo, which means the entire item is suppressed. If you only want to remove the link to the files on the item page of an embargoed item, your best bet is to modify the listBitstreams() method in ItemTag.java: https://github.com/DSpace/DSpace/blob/dspace-3_x/dspace-jspui/src/main/java/org/dspace/app/webui/jsptag/ItemTag.java#L754 -- exactly what you need to do depends on whether you have items where only some files are embargoed but others are visible. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Changing item display to flag embargoed items more clearly in JSPUI
Ooops! I meant to address this to Hugh Barnes instead of Andrea Schweer. My apologies! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George Stanley Kozak Sent: Friday, March 21, 2014 1:33 PM To: 'Andrea Schweer'; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Changing item display to flag embargoed items more clearly in JSPUI Andrea: What we did at Cornell University was add the Embargo date to the item display (see http://ecommons.library.cornell.edu/handle/1813/29299) and I made a change to the java code that puts up a display based on the group that controls a bitstream. So, here at Cornell, we have our embargo code set up to restrict a bitstream to a specific group embargo which has read access to the bitstream. Click on the bitstream for the item above and you will see the embargo display. I have the code for DSpace 1.8.2 and DSpace 3.2 (JSPUI or XMLUI) that does this . If you are interested in the details, I can send them to you off-list. Credit where credit is due: the java code that I am using is based on code originally created by Terry Owen at the University of Maryland. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Friday, March 21, 2014 12:39 AM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Changing item display to flag embargoed items more clearly in JSPUI Hi again, On 21/03/14 17:21, Andrea Schweer wrote: On 21/03/14 16:46, Barnes, Hugh wrote: We are implementing the (legacy) embargo functionality in the above environment. Ideally, we think it's better user interface to inform users that the item is embargoed, and even not taunt them with a link until that is lifted. Otherwise, users are denied access without obvious reason (and will probably contact us about it). So we really want to edit the single item display page to mark embargoed items much more clearly for users. My jspui experience is a few years old -- but might it work to change the logic in the displayItem method in HandleServlet, similar to what's done for withdrawn items? See here: https://github.com/DSpace/DSpace/blob/dspace-3_x/dspace-jspui/src/main/java/org/dspace/app/webui/servlet/HandleServlet.java#L298 except you'd have another if clause to check whether the item is embargoed according to your legacy definition of embargoed, which may or may not involve EmbargoManager.getEmbargoTermsAsDate(context,item) != null If that condition is fulfilled, pass the user on to either the same tombstone page as for withdrawn items (or a different one if you prefer) like so: JSPManager.showJSP(request, response, /tombstone.jsp); return; This approach feels a little cleaner to me than messing with extra conditionals in display-item.jsp. Actually, never mind me -- I was going by our local definition of embargo, which means the entire item is suppressed. If you only want to remove the link to the files on the item page of an embargoed item, your best bet is to modify the listBitstreams() method in ItemTag.java: https://github.com/DSpace/DSpace/blob/dspace-3_x/dspace-jspui/src/main/java/org/dspace/app/webui/jsptag/ItemTag.java#L754 -- exactly what you need to do depends on whether you have items where only some files are embargoed but others are visible. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Linking from DSpace Object to External URL
Stacy: At Cornell University, we are doing something similar to what you are talking about. We are providing streaming video content using an external source kaltura. So, what I have done is once a video is submitted to DSpace, I submit an XML file to Kaltura using the URL to the bitstream. Kaltura uploads the video and creates a streaming version. Once I have the ID for the streaming version, I create an HTML page that uses the formatting of my DSpace pages and place a Kaltura viewer in it with the proper IDs. I then upload the streaming version HTML to my original DSpace item as a bitstream. For an example check out: http://ecommons.library.cornell.edu/handle/1813/33229 You will see the original bitstreams and then if you click on the streaming video version, you will see how I am handling an external viewer. In my development DSpace 3.2 XMLUI version (soon to be in production), I have gone ahead and embedded the viewer on the item page, but I don't think this can be done in the JSPUI. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Pennington_Stacy penning...@rhodes.edu Sent: Friday, March 21, 2014 5:25 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Linking from DSpace Object to External URL Last week, I updated our DSpace from 1.8.2 to 4.1 without many (any?) issues. Kudos to everyone on this list that worked on the DSpace 4.x releases, whether as a developer, contributor, tester, or whatever. Your efforts are appreciated! I'm wondering how to do something that seems pretty simple and can't find any leads in the DSpace docs or wiki on how to do it. I would like to provide a hyperlink from a DSpace object's page (we are using JSPUI) to an external location to showcase that object's bitstream using technology not associated with DSpace. For example, I've got high-resolution images saved as objects in DSpace, so that the lossless TIFF (huge) and lossy JPEG (much smaller) are available in DSpace, complete with lovely DC metadata. I've now got a Djatoka server running with OpenSeaDragon as a viewer, and many of these large images can be viewed on the external Djatoka server using a custom URL for that image. I want to link to that external URL from within the DSpace JSPUI object page in the simplest way possible, without modifying DSpace code. Is this possible? I know that this may be bad form for a repository, but I'm not interested in modifying the JSPUI template pages to load the Javascript viewer on the page or anything like that. I'm willing to store the URL to the zoomable viewer in the object's metadata, which of course I can do now in DC but it doesn't create a hyperlink; the user needs to copy/paste the URL to get to the zoomable viewer. I just need a simple link from the object page, and if that link stops working in the future, that's OK. I can remove it at that time. The bitstreams are the most important thing, but the user would get the most use out of the simple, zoomable, external URL. Does anyone have any advice for me? Again, I'm interested in the simplest, easiest way to do this link, one with the least number of changes to the DSpace source code. Thanks in advance for any ideas! -- Stacy Pennington Information Technology Services Rhodes College 901-843-3968 -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about search highlighting in DSpace 3.2
Thank you for all your help, helix. It's probably my configuration. SInce I am still in development I will redo the installation one more time and see if that fixes things. Thanks! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: ivan.ma...@gmail.com [ivan.ma...@gmail.com] on behalf of helix84 [heli...@centrum.sk] Sent: Friday, August 23, 2013 4:15 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about search highlighting in DSpace 3.2 Well, the only other thing I can think of is some error in configuration. How did you upgrade your configuration to 3.x? Did you take your old one and add new things or did you take the new one and add all your local changes? I'd recommend the second approach. You can try the feature out on our demo server: http://demo.dspace.org/xmlui/ Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about search highlighting in DSpace 3.2
Helix: Thanks. I was able to connect to the Solr Admin and check the Schema Browser and the HL fields are there. So, I'm a bit stumped. Does anyone have an example of Search Highlighting that I can look at that I can compare with my site? I am wondering if this may be a CSS issue? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Thursday, August 22, 2013 5:42 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about search highlighting in DSpace 3.2 I thought it would be enough to get it to work. 1) Try running update-discovery-index -b and test again 2) If it still doesn't work, connect to Solr [1] and use Schema Browser to check whether the search index contains _hl fields, e.g. DC.TITLE_HL, FULLTEXT_HL. [1] https://wiki.duraspace.org/display/DSPACE/Solr Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about search highlighting in DSpace 3.2
Hi... I am using DSpace 3.2 (XMLUI with modified Mirage interface). We are testing it in preparation to migrate to production (Our production is currently DSpace 1.8.2 JSPUI). I have been testing the search snippets, so that I can explain this new feature to our users, but I do not seem to be getting the search highlighting (ie., search term highlighted in the snippet). I assume that I am doing something wrong. Can someone direct me where I should look (ie. Config file?). George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about DSpace 3.2 Authentication
Hello: I just encountered another problem with our DSPace 3.2 (XMLUI Mirage themed installation). I have the authentication (config/modules/authentication.cfg) setup as follows: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.IPAuthentication, \ org.dspace.authenticate.PasswordAuthentication However, when I attempt to login, I see: No Authentication Method Found Does anyone have any suggestions? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about DSpace 3.2 Authentication
Helix: Thank you (again!). Yes, there must have been a white space or something interfering. When I retyped the authentication configuration, it now works! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, August 20, 2013 1:41 PM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about DSpace 3.2 Authentication On Tue, Aug 20, 2013 at 5:31 PM, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: I have the authentication (config/modules/authentication.cfg) setup as follows: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \ org.dspace.authenticate.IPAuthentication, \ org.dspace.authenticate.PasswordAuthentication This looks correct, there must be a typo (the backslash should immediately precede the newline, there can't be other whitespace) or some other gotcha. Try typing it on a single line: plugin.sequence.org.dspace.authenticate.AuthenticationMethod = org.dspace.authenticate.IPAuthentication, org.dspace.authenticate.PasswordAuthentication Also make sure you're looking at [dspace]/config/modules/authentication.cfg, not [dspace-source]/config/modules/authentication.cfg. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about search highlighting in DSpace 3.2
Helix: Thanks for your help! I will run the re-index and check the link. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, August 20, 2013 1:34 PM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about search highlighting in DSpace 3.2 On Tue, Aug 20, 2013 at 5:12 PM, George Stanley Kozak g...@cornell.edu wrote: I have been testing the search snippets, so that I can explain this new feature to our users, but I do not seem to be getting the search highlighting (ie., search term highlighted in the snippet). I assume that I am doing something wrong. Can someone direct me where I should look (ie. Config file?). Hi George, there is no need to configure anything, although you can customize it once you get it working. The two things that may be preventing you from seeing highlighting are: 1) Did you reindex when upgrading? Run update-discovery-index -f to make sure. 2) Did you customize your theme? If you did, some updates are necessary, check the updates Mirage received. To verify that this is not the problem, test with Mirage. [1] https://wiki.duraspace.org/display/DSDOC3x/Discovery#Discovery-Customizinghithighlightingsearchsnippets Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Discover Search Problem/Question with Firefox
Thank you, Kevin. This is will help me in my final report on the testing of my new installation. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: kevin.van.de.ve...@gmail.com [kevin.van.de.ve...@gmail.com] on behalf of Kevin Van de Velde [ke...@mire.be] Sent: Monday, August 19, 2013 3:55 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Discover Search Problem/Question with Firefox Hi George, This is a known bug in DSpace 3.x, a fix is in the works for this. For more information see: https://jira.duraspace.org/browse/DS-1432. Hope this helps, Kind regards, [logo] Kevin Van de Velde @mire 2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010 Esperantolaan 4, Heverlee 3001, Belgium www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=kevinvdv On 16 August 2013 16:46, George Stanley Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi, I found a funny problem which seems to be linked to Firefox and the XMLUI. This problem does not happen with IE or Chrome. I have DSpace 3.2 running with the XMLUI (Mirage Theme). I am seeing something strange with the search results. When I click on item in the search results, I get to the item OK. However, if I next use the “Browser Back” to go back to the Search Results page, and then click on another item, I get: org.apache.cocoon.ResourceNotFoundException: Page cannot be found and I see the URL generated was: http://myserver/dso-displayUrlBlockedError.aspx It only seems to happen when I use the “Browse Back” button to go to the previous Search Results. Also, this does not happen with the JSPUI interface. Has anyone seen this and does anyone have any idea what may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924tel:607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette inline: @mire_web_2.jpg-- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Discover Search Problem/Question with Firefox
Hi, I found a funny problem which seems to be linked to Firefox and the XMLUI. This problem does not happen with IE or Chrome. I have DSpace 3.2 running with the XMLUI (Mirage Theme). I am seeing something strange with the search results. When I click on item in the search results, I get to the item OK. However, if I next use the Browser Back to go back to the Search Results page, and then click on another item, I get: org.apache.cocoon.ResourceNotFoundException: Page cannot be found and I see the URL generated was: http://myserver/dso-displayhttp://%3cmyserver%3e/dso-display It only seems to happen when I use the Browse Back button to go to the previous Search Results. Also, this does not happen with the JSPUI interface. Has anyone seen this and does anyone have any idea what may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Problem with search in DSpace 3.2
Hi, everyone: I just did an upgrade from DSpace 1.8.2 to DSpace 3.2 on a test server. We are planning to switch to the XMLUI interface for the new upgrade so I set my new instance to use the Discovery search. I made the changes in the Config files outlined in the documentation for using Discovery and ran the dspace update-discovery-index command. However, whenever I attempt a search in either the XMLUI or JPSUI, I get no results. The log files show that discovery was access and the results are 0, but no errors appear. Has anyone seen this before and/or any suggestions of where I should look to debug? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Problem with search in DSpace 3.2 - fixed!
Hi, Everyone: I'd like to thank Tim Donohue who was answering Mark Ludwig's problem with Solr. I saw that he suggested doing the update-discovery-index with the -b option. I tried that and that fixed my own problem with searching. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Thursday, August 15, 2013 11:37 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem with search in DSpace 3.2 Hi, everyone: I just did an upgrade from DSpace 1.8.2 to DSpace 3.2 on a test server. We are planning to switch to the XMLUI interface for the new upgrade so I set my new instance to use the Discovery search. I made the changes in the Config files outlined in the documentation for using Discovery and ran the dspace update-discovery-index command. However, whenever I attempt a search in either the XMLUI or JPSUI, I get no results. The log files show that discovery was access and the results are 0, but no errors appear. Has anyone seen this before and/or any suggestions of where I should look to debug? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite! It's a free troubleshooting tool designed for production. Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://pubads.g.doubleclick.net/gampad/clk?id=48897031iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Restricting a specific Metadata field
Hi... I don't recall if this has been discussed before (if so, I apologize), but I was wondering if a specific item metadata field can be restricted from the public and from OAI. So, basically, the rest of the metadata for the item can be harvested or displayed but one particular field will be excluded. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Restricting a specific Metadata field
Kostas:
We are currently using DSpace 1.8.2 (JSPUI interface), but I am beginning a
migration to DSpace 3.1 using the XMLUI interface.
It would be in DSpace 3.1 using the XMLUI interface that I would have a field
that we would want restricted.
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
From: Kostas Stamatis [mailto:kstama...@ekt.gr]
Sent: Tuesday, July 02, 2013 4:28 PM
To: George Stanley Kozak
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Restricting a specific Metadata field
Hello,
Regarding the display of fields, you can modify accordingly the option
webui.itemdisplay.default in the dspace config file located at:
{your_dspace_install_dir}/config/dspace.cfg. This is for the JSPUI web
interface.
Regarding the OAI, please, tell us the version of the DSpace that you are
using. DSpace 3 is using the XOAI implementation which is different from the
one used to previous versions. Thus, I will need to know your version in order
to help you.
Regards,
Kostas
On Jul 2, 2013, at 5:26 PM, George Stanley Kozak
g...@cornell.edumailto:g...@cornell.edu wrote:
Hi...
I don't recall if this has been discussed before (if so, I apologize), but I
was wondering if a specific item metadata field can be restricted from the
public and from OAI. So, basically, the rest of the metadata for the item can
be harvested or displayed but one particular field will be excluded.
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
--
This SF.nethttp://SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Restricting a specific Metadata field
Kostas:
Thank you for time. I suspect that there is a way of getting this done. I
probably should do some more research.
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
From: Kostas Stamatis [mailto:kstama...@ekt.gr]
Sent: Tuesday, July 02, 2013 5:09 PM
To: George Stanley Kozak
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Restricting a specific Metadata field
I am afraid I cannot help you. Both XMLUI and XOAI are out of my scope (for the
moment)... Hope someone else from the community can help you.
Regards,
Kostas
On Jul 2, 2013, at 11:54 PM, George Stanley Kozak
g...@cornell.edumailto:g...@cornell.edu wrote:
Kostas:
We are currently using DSpace 1.8.2 (JSPUI interface), but I am beginning a
migration to DSpace 3.1 using the XMLUI interface.
It would be in DSpace 3.1 using the XMLUI interface that I would have a field
that we would want restricted.
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
From: Kostas Stamatis [mailto:kstama...@ekt.grhttp://ekt.gr]
Sent: Tuesday, July 02, 2013 4:28 PM
To: George Stanley Kozak
Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Restricting a specific Metadata field
Hello,
Regarding the display of fields, you can modify accordingly the option
webui.itemdisplay.default in the dspace config file located at:
{your_dspace_install_dir}/config/dspace.cfg. This is for the JSPUI web
interface.
Regarding the OAI, please, tell us the version of the DSpace that you are
using. DSpace 3 is using the XOAI implementation which is different from the
one used to previous versions. Thus, I will need to know your version in order
to help you.
Regards,
Kostas
On Jul 2, 2013, at 5:26 PM, George Stanley Kozak
g...@cornell.edumailto:g...@cornell.edu wrote:
Hi...
I don't recall if this has been discussed before (if so, I apologize), but I
was wondering if a specific item metadata field can be restricted from the
public and from OAI. So, basically, the rest of the metadata for the item can
be harvested or displayed but one particular field will be excluded.
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
--
This SF.nethttp://SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] text encoding problem with bitstreams in DSpace 3.1
Jim: I had a similar problem recently, but not with DSpace. It happened when I moved some of my websites from a Sun Solaris Server to a LINUX Virtual Machine. Did you, by any chance, migrate to a new server when you upgraded? I found that I had to place AddDefaultCharset Off directive in my Apache Conf file to fix the problem. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Halliday, James Leonard [mailto:jhall...@indiana.edu] Sent: Thursday, June 27, 2013 2:55 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] text encoding problem with bitstreams in DSpace 3.1 Hello all, My problem relates to text encoding. We recently upgraded from DSpace 1.8 to 3.1, and this upgrade broke many of our existing HTML bitstreams, that are UTF-8 encoded. Here is a sample: https://scholarworks.iu.edu/dspace/bitstream/handle/2022/14101/12.01.13.html?sequence=1 This article looked correct in the old version, and the new version garbles the output by forcing ISO-8859. Note that only the bitstreams look incorrect: the metadata pages look just fine, so UTF-8 encoding is working everywhere except within the bitstreams. I've been looking at this for several days now without a solution; does anyone have any tips? Thanks! - Jim Halliday - Programmer/Analyst Indiana University -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Strange error - bad handle sent
Hi... I had a submitter contact me about something I have never seen in the 10 years that I have been working on DSpace. First off, I am using DSpace 1.8.2 using the JSPUI (LINUX). The user submitted an item and received an email with the handle, but it was wrong! I checked and the handle does not exist AND not only that the item he submitted does not exist. I checked the DSpace logs and the handle logs at the time he did the submission and saw no error or anything suspicious. Has anyone encountered this before? This one has me stumped. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Strange error - bad handle sent (UPDATE!)
Hi, Everyone: I think I know what happened with the so called bad handle that I wrote about (below). I checked the handle table in DSpace and I found the handle, but there was no resource_id associated with it. This indicates to me that the item was deleted. I see in the DSpace logs that a number of items were deleted by one of our Sys Admins after this item was submitted. Unfortunately, these deletes are listed in the logs by item_id. I think I'm out of luck tracking this further, but if I am wrong, please let me know. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Saturday, June 01, 2013 10:43 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Strange error - bad handle sent Hi... I had a submitter contact me about something I have never seen in the 10 years that I have been working on DSpace. First off, I am using DSpace 1.8.2 using the JSPUI (LINUX). The user submitted an item and received an email with the handle, but it was wrong! I checked and the handle does not exist AND not only that the item he submitted does not exist. I checked the DSpace logs and the handle logs at the time he did the submission and saw no error or anything suspicious. Has anyone encountered this before? This one has me stumped. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the options for restricting the display of the login box for embargoed files
Kevin: I am not sure if you're interested, but I made some code modifications at Cornell University's dspace instance that puts up an informational display when one clicks on an embargoed bitstream or one that is controlled by IP. The code that I use is based on some code that I borrowed from Terry Owen at the University of Maryland several years ago (Thanks, Terry!). It puts up displays based on the group that controls a bitstream. So, here at Cornell, we have our embargo code set up to restrict a bitstream to a specific group embargo which has read access to the bitstream. I have the code for JPSUI 1.8.2 and XMLUI 1.8.2. If you are interested in the details, I can send them to you. Below are examples: For Embargo, go to http://ecommons.library.cornell.edu/handle/1813/31510 and click on the bitstream to see the display For IP restriction, go to http://ecommons.library.cornell.edu/handle/1813/29540 and clikc on the bitstream to see the display George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: Thursday, May 23, 2013 6:51 PM To: Evans, Kev Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] What are the options for restricting the display of the login box for embargoed files On Thu, May 23, 2013 at 5:03 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: Dspace Version. 1.8.2 Theme: xmlui I'll assume the default Mirage theme. The process normally looks like this: 1) click on an embargoed bitstream, get the following prompt: The file is restricted The file you are attempting to access is a restricted file and requires credentials to view. Please login below to access the file. Sign in to DSpace 2) sign in to dspace as a non-administrative user 3) get the following message: This bitstream is restricted You do not have the credentials to access the restricted bitstream This seems pretty straight-forward to me. I'm not sure how you'd like to make it clearer. Anyway, I added a new feature that appears in DSpace 3 that shows a lock icon for bitstreams that have restricted access (missing Anonymous READ). Since you're on 1.8, you have 2 options if you want this feature: 1) upgrade to DSpace 3 2) apply my patch from this Jira ticket (it's compatible with 1.8): https://jira.duraspace.org/browse/DS-1193 There's a screenshot attached to that ticket showing what it looks like. If I misunderstood and you wanted something else, please explain. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] weird metadata problem
Hi, I have a weird metadata problem that I haven't been able to figure out. I am using DSpace 1.8.2 and my official interface is the JSPUI (we are working on moving to the XMLUI). A week ago, helix84 helped me with a question that I had about the Creative Commons License. I started experimenting with the License and saw something peculiar. If I submit an item in the JSPUI and select a creative commons license, the metadata fields for the Creative Commons license do not show up in the full item display of the submitted item (although the This item under Creative Commons License does appear on the item display). If I submit an item in the XMLUI (using a modified Mirage template) and select a creative commons license, the metadata fields for the Creative Commons license DO show up in the full item display of the submitted item. I have looked over the source code and I'm kind of stumped. I wonder has anyone seen this before? Does anyone have a hint to guide me in the right direction? Thanks in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] weird metadata problem
Hi, helix:
Sorry, I wasn't clear on the text. My apologies for the confusion.
I was talking about the part of display-item.jsp where the Creative Commons
display takes place:
%-- Create Commons Link --%
%
if (cc_url != null)
{
%
p class=submitFormHelpfmt:message key=jsp.display-item.text3/ a
href=%= cc_url %fmt:message key=jsp.display-item.license//abr/
a href=%= cc_url %img src=%= request.getContextPath()
%/image/cc-somerights.gif border=0 alt=Creative Commons //a
/p
!--
%= cc_rdf %
--
%
}
jsp.display-item.text3 starts off with This item is licensed under a
followed by jsp.display-item.license: Creative Commons License
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: Monday, May 13, 2013 10:18 AM
To: George Stanley Kozak
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] weird metadata problem
On Mon, May 13, 2013 at 4:00 PM, George Stanley Kozak g...@cornell.edu wrote:
If I submit an item in the JSPUI and select a creative commons
license, the metadata fields for the Creative Commons license do not
show up in the full item display of the submitted item
You are right, the behaviour of JSPUI seems to differ from XMLUI. I tried it by
submitting a new item from JSPUI here:
http://demo.dspace.org/jspui/handle/10673/11?mode=fullsubmit_simple=Show+full+item+record
(although the “This item under Creative Commons License” does appear
on the item display).
Can you please specify the *exact* text? There doesn't seem to be anything like
this is the DSpace messages file or the source.
Regards,
~~helix84
Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
Learn Graph Databases - Download FREE O'Reilly Book
Graph Databases is the definitive new guide to graph databases and
their applications. This 200-page book is written by three acclaimed
leaders in the field. The early access version is available now.
Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] weird metadata problem
helix: Yes, in DSpace 1.82/JSPUI, under the Admin (Edit) display of the item, I can see: license_url bitstream (org.dspace.license.CreativeCommons) license_text bitstream (org.dspace.license.CreativeCommons) license_rdf bitstream (org.dspace.license.CreativeCommons) But the metadata elements: dc.rights and dc.rights.uri do not appear. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Monday, May 13, 2013 10:18 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] weird metadata problem On Mon, May 13, 2013 at 4:00 PM, George Stanley Kozak g...@cornell.edu wrote: If I submit an item in the JSPUI and select a creative commons license, the metadata fields for the Creative Commons license do not show up in the full item display of the submitted item You are right, the behaviour of JSPUI seems to differ from XMLUI. I tried it by submitting a new item from JSPUI here: http://demo.dspace.org/jspui/handle/10673/11?mode=fullsubmit_simple=Show+full+item+record (although the “This item under Creative Commons License” does appear on the item display). Can you please specify the *exact* text? There doesn't seem to be anything like this is the DSpace messages file or the source. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about Creative Commons License
Hi... I was asked today if the Creative Commons License can be added after an item was submitted and in the system (sort of, after the fact). My gut feeling is no, but I wanted to check first. Also, can batch records have a Creative Commons License applied? (again, I am thinking no). PS: we are using DSpace 1.8.2 with JSPUI interface. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about Creative Commons License
Thanks, helix! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, May 07, 2013 11:00 AM To: George Stanley Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Creative Commons License On Tue, May 7, 2013 at 4:43 PM, George Stanley Kozak g...@cornell.edu wrote: I was asked today if the Creative Commons License can be added after an item was submitted and in the system (sort of, after the fact). My gut feeling is “no”, but I wanted to check first. Also, can batch records have a Creative Commons License applied? (again, I am thinking “no”). Hi George, to answer that, we must first find out what makes a DSpace item a CC item. To find that out, I submitted a new item on demo.dspace.org. Now let's look at both metadata [1] and license bitstreams [2]: [1] http://demo.dspace.org/xmlui/handle/10673/13012?show=full [2] http://demo.dspace.org/xmlui/metadata/handle/10673/13012/mets.xml [3] http://demo.dspace.org/xmlui/bitstream/handle/10673/13012/license_rdf As you can see, metadata contains two fields: dc.rights:Attribution-ShareAlike 3.0 United States dc.rights.uri:http://creativecommons.org/licenses/by-sa/3.0/us/ Also notice that * is a language, which seems unusual, because usually there's either a language code, an empty string or a NULL value. This might or might not matter. Secondly, we can see the METS file pointing to a single bitstream [3]. There's nothing specific to the item there, it's the same for all items with the same type of CC license. Please note, that this bitstream is in the LICENSE bundle (you can upload to this bundle from the web interface, just select it from the dropdown menu). So to answer your questions: * yes, an existing item can be made CC * yes, batch import can create CC items Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Learn Graph Databases - Download FREE O'Reilly Book Graph Databases is the definitive new guide to graph databases and their applications. This 200-page book is written by three acclaimed leaders in the field. The early access version is available now. Download your free book today! http://p.sf.net/sfu/neotech_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Difference with Atom and RSS feeds
Hi, Everyone: I haven't heard from anyone concerning my question on Atom and RSS feeds (see below). So, unless someone wants to chime in at the last minute, I am going to assume that there is no answer.Thanks, anyway. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George Stanley Kozak [mailto:g...@cornell.edu] Sent: Wednesday, May 01, 2013 3:01 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Difference with Atom and RSS feeds This may have been addressed in the past, but I may have missed it. I had a complaint about the atom feed from my DSpace instance. I am using DSpace 1.8.2 using the JSPUI interface. I have my RSS feeds set up as follows in the DSpace Config: webui.feed.item.description = dc.title, dc.contributor.author, dc.contributor.editor, dc.description.abstract, dc.description I think this was the default? At least, I don't remember changing it. The RSS_2.0 feed looks OK, but the Atom_1.0 feed has the author and title repeated in the Summary field (examples below). If I change the above config to: webui.feed.item.description = dc.description.abstract, dc.description The Atom_1.0 feed is now OK, but the RSS_2.0 feed shows up with the Author field missing. Is there a way to configure this so that the data shows up the same for rss_2.0 and atom_1.0? Here is an example of an rss_2.0 feed: item titleEstimating identification disclosure risk using mixed membership models/title linkhttp://hdl.handle.net/1813/33184/linkhttp://hdl.handle.net/1813/33184%3c/link descriptionTitle: Estimating identification disclosure risk using mixed membership models Authors: Manrique-Vallier, Daniel; Reiter, Jerome Abstract: Statistical agencies and other organizations...(rest deleted)/description pubDateSun, 01 Jan 2012 00:00:00 GMT/pubDate guid isPermaLink=falsehttp://hdl.handle.net/1813/33184/guidhttp://hdl.handle.net/1813/33184%3c/guid dc:date2012-01-01T00:00:00Z/dc:date /item Same as an atom_1.0 feed: entry titleEstimating identification disclosure risk using mixed membership models/title link rel=alternate href=http://hdl.handle.net/1813/33184; / author nameManrique-Vallier, Daniel/name /author author nameReiter, Jerome/name /author idhttp://hdl.handle.net/1813/33184/idhttp://hdl.handle.net/1813/33184%3c/id updated2013-04-21T05:01:39Z/updated published2012-01-01T00:00:00Z/published summary type=textTitle: Estimating identification disclosure risk using mixed membership models Authors: Manrique-Vallier, Daniel; Reiter, Jerome Abstract: Statistical agencies and other organizations...(rest deleted)/summary dc:date2012-01-01T00:00:00Z/dc:date /entry George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
