[Dspace-tech] Question about bitstream format registry
Hi... I discovered today that I had a bitstream that was dropped from the bitstream format registry (my fault) when I went from DSpace 1.7.1 to DSpace 1.8.2, so every item using the specific bitstream now shows it as unknown. I fixed things in the bitstream registry and fixed a few records by typing in the correct ID number while the item is in Edit Mode, but I have 226 items to be updated. I was wondering if I did an index update would that automatically fix the bitstreams to show that they are now known or is there some batch way to updated the display of these bitstreams? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester Wave(TM): Endpoint Security, Q1 2013 and remains a good choice in the endpoint security space. For insight on selecting the right partner to tackle endpoint security challenges, access the full report. http://p.sf.net/sfu/symantec-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about bitstream format registry
Brian: Thank you for the advice. I will probably end up using the SQL command (after I back things up!). George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Brian Freels-Stendel [bfre...@unm.edu] Sent: Thursday, March 07, 2013 4:36 PM To: George S Kozak; dspace-tech@lists.sourceforge.net Subject: RE: Question about bitstream format registry Hi George, Did the bitstream_format_id get changed to the “Unknown” type, or is it still the original ID? If it’s still the original ID, I would go into the database table bitstreamformatregistry and change the ID of the new record to the old ID. Then, of course, revert the ID of those few records you updated to the new ID. If it’s not, I’d probably run a SQL query: “update bitstream set bitstream_format_id = [NEW_ID] where bitstream_format_id = [OLD_ID]” And for sure, make a backup of the db before trying either of these. B-- From: George S Kozak [mailto:g...@cornell.edu] Sent: Thursday, March 07, 2013 2:18 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Question about bitstream format registry Hi… I discovered today that I had a bitstream that was dropped from the bitstream format registry (my fault) when I went from DSpace 1.7.1 to DSpace 1.8.2, so every item using the specific bitstream now shows it as “unknown”. I fixed things in the bitstream registry and fixed a few records by typing in the correct ID number while the item is in “Edit” Mode, but I have 226 items to be updated. I was wondering if I did an index update would that automatically fix the bitstreams to show that they are now known or is there some batch way to updated the display of these bitstreams? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester Wave(TM): Endpoint Security, Q1 2013 and remains a good choice in the endpoint security space. For insight on selecting the right partner to tackle endpoint security challenges, access the full report. http://p.sf.net/sfu/symantec-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about bitstream format registry
Brian: It was for bitstream .avi which for some reason was missing from my Bitstream registry. I was sure I had it in my previous version (I have a lot of records with AVI Videos), but I remember doing an extensive rebuild of the bistream registry when I upgraded and I probably accidentally left it out. Every bitstream with an .avi suffix is an ID: 1 unknown. I already found all of the bistreams (and items) that have the .avi suffix through SQL.My next step is to look for all of the bitstreams that have an ID of 1, and separate out all of the ones which are not .avi before doing a global change. Thanks, again, for your advice. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Brian Freels-Stendel [bfre...@unm.edu] Sent: Thursday, March 07, 2013 4:46 PM To: George S Kozak; dspace-tech@lists.sourceforge.net Subject: RE: Question about bitstream format registry Oh, bother. Both of those solutions would require that the ID be the old format ID. I’m kind of counting on that, to be honest. If the ID changed to the “Unknown” format, you could try putting all of the relevant bitstream IDs into an update like “update bitstream set bitstream_format_id = [NEW_ID] where bitstream_id in [BITSTREAM_ID_LIST(COMMA_SEPARATED)]” B-- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Thursday, March 07, 2013 2:37 PM To: George S Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about bitstream format registry Hi George, Did the bitstream_format_id get changed to the “Unknown” type, or is it still the original ID? If it’s still the original ID, I would go into the database table bitstreamformatregistry and change the ID of the new record to the old ID. Then, of course, revert the ID of those few records you updated to the new ID. If it’s not, I’d probably run a SQL query: “update bitstream set bitstream_format_id = [NEW_ID] where bitstream_format_id = [OLD_ID]” And for sure, make a backup of the db before trying either of these. B-- From: George S Kozak [mailto:g...@cornell.edu] Sent: Thursday, March 07, 2013 2:18 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Question about bitstream format registry Hi… I discovered today that I had a bitstream that was dropped from the bitstream format registry (my fault) when I went from DSpace 1.7.1 to DSpace 1.8.2, so every item using the specific bitstream now shows it as “unknown”. I fixed things in the bitstream registry and fixed a few records by typing in the correct ID number while the item is in “Edit” Mode, but I have 226 items to be updated. I was wondering if I did an index update would that automatically fix the bitstreams to show that they are now known or is there some batch way to updated the display of these bitstreams? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester Wave(TM): Endpoint Security, Q1 2013 and remains a good choice in the endpoint security space. For insight on selecting the right partner to tackle endpoint security challenges, access the full report. http://p.sf.net/sfu/symantec-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about restrictions in XMLUI
Thank you, Ivan: The collection in question has the following restrictions: 525 ADD theses_dissertations [Edit] 524 DEFAULT_BITSTREAM_READ theses_dissertations [Edit] 523 DEFAULT_ITEM_READ Anonymous [Edit] The collection is viewable if I am logged in as the Admin. However, average anonymous users can not view the collection homepage in XMLUI, but it is viewable in JSPUI. I guess my question is: does placing any restriction at a collection level on the items result in locking down the collection in XMLUI? PS: I checked this out using the Mirage Theme and the Default Theme. If you'd like to see this on our production system: JSPUI version: http://ecommons.library.cornell.edu/handle/1813/47 (the collection is viewable) XMLUI version: http://ecommons.library.cornell.edu/xmlui/handle/1813/47 (the collection is not viewable) What I'd like to do is make the XMLUI work like the JSPUI (if possible) in this case. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, March 05, 2013 5:42 AM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about restrictions in XMLUI On Mon, Mar 4, 2013 at 10:25 PM, George S Kozak g...@cornell.edu wrote: I am using DSpace 1.82. We are currently using the JSPUI, but I am working on migrating to the XMLUI interface (modified Mirage theme). I have a collection in which all of the bitstreams are restricted, but the metadata can be viewed by anonymous users. I can view the collection homepage fine in JSPUI, but in XMLUI, I see “This collection is restricted” and a request to login before I can view the collection homepage. Is this how the XMLUI interface handles collections with restricted items or do I have something set up wrong? If this is how it works, can someone tell me where I can go in and modify things to work as they do in the JSPUI? Hi George, interesting, I didn't know collections can be made private, but it seems they can now (judging from the message). Try logging in as admin and going here to see if the collection shows up: http://example.com/admin/private I'd expect only items to show up, but who knows. Second thing you can check is to go to the collection and click on Authorizations in the sidebar. It should look like this for a normal collection: ID Action Group 71 READAnonymous [Edit] 72 DEFAULT_ITEM_READ Anonymous [Edit] 73 DEFAULT_BITSTREAM_READ Anonymous [Edit] Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about restrictions in XMLUI
Ivan: Super! That did it. Thank you. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, March 05, 2013 10:16 AM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about restrictions in XMLUI On Tue, Mar 5, 2013 at 4:07 PM, George S Kozak g...@cornell.edu wrote: The collection in question has the following restrictions: 525 ADD theses_dissertations [Edit] 524 DEFAULT_BITSTREAM_READ theses_dissertations [Edit] 523 DEFAULT_ITEM_READ Anonymous [Edit] Yes, seems like you're missing Anonymous READ. I guess my question is: does placing any restriction at a collection level on the items result in locking down the collection in XMLUI? I think so, and I just confirmed it with a brief test - removing the Anonymous READ policy results in the error message. So just re-add the policy. There's a Click here to add a new policy. on the Authorizations screen. P.S. I didn't test with JSPUI, but if it doesn't recognize the missing policy, the new feature (that collections can be made private) wasn't ported to JSPUI just yet, but it should be (for consistency). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about restrictions in XMLUI
Hi... I am using DSpace 1.82. We are currently using the JSPUI, but I am working on migrating to the XMLUI interface (modified Mirage theme). I have a collection in which all of the bitstreams are restricted, but the metadata can be viewed by anonymous users. I can view the collection homepage fine in JSPUI, but in XMLUI, I see This collection is restricted and a request to login before I can view the collection homepage. Is this how the XMLUI interface handles collections with restricted items or do I have something set up wrong? If this is how it works, can someone tell me where I can go in and modify things to work as they do in the JSPUI? Thank you in advance. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Linking to a bookmarked page in a PDF stored in DSpace
Hi... I was asked if it would be possible for someone to link directly into a bookmarked page in a PDF that is stored in DSpace. Before I say no, I just wanted to check to see if anyone has any ideas about this. To be clear, what the user wants is for me to give him/her a URL that will take him/her directly into a specific bookmarked page in the PDF that is stored in DSpace. BTW: I am using DSpace 1.8.2 and JSPUI interface (working on bringing XMLUI interface up) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Linking to a bookmarked page in a PDF stored in DSpace
Thanks, Everyone. We'll do some more playing around with this. So far, when we try this, we only get the first page of the PDF, but we are using IE and Firefox (our Desktop Services Dept. does not trust us with Chrome :-) ) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: Tuesday, December 11, 2012 12:49 PM To: Mark Ehle Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Linking to a bookmarked page in a PDF stored in DSpace Mark, why the extra indirection? The link is all that's needed. http://yourdspace.com/xmlui/bitstream/handle/123456789/1234/yourfile.pdf#page=4 It's supported by the Acrobat browser plugin and natively in Chrome. It may not work with other plugins, but it won't break anything. Here's the official documentation of that feature: http://helpx.adobe.com/acrobat/kb/link-html-pdf-page-acrobat.html Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Linking to a bookmarked page in a PDF stored in DSpace
Ivan: We are using Acrobat's plug-in, so I guess from what you said, this should work for us. I guess I need to do a little more playing around to see why it doesn't seem to work for us. I may test this from home where I have more control over my PC. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 218 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, December 11, 2012 1:00 PM To: George S Kozak Cc: Mark Ehle; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Linking to a bookmarked page in a PDF stored in DSpace On Tue, Dec 11, 2012 at 6:57 PM, George S Kozak g...@cornell.edu wrote: We'll do some more playing around with this. So far, when we try this, we only get the first page of the PDF, but we are using IE and Firefox (our Desktop Services Dept. does not trust us with Chrome :-) ) Like I said, it's the Acrobat plugin's business, it doesn't matter which browser you're using. It's just that Chrome has a PDF-viewer built-in, that's why I mentioned it separately. And of course, you can't control what your visitors have installed, that's why I mentioned it won't hurt those who won't benefit from it. So which browser plugin are you using? Regards, ~~helix84 -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about altering item-view in XMLUI
Thank you, Hilton (and helix84!). George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Monday, November 12, 2012 5:49 AM To: Ivan Masár Cc: George S Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about altering item-view in XMLUI Perhaps this will help: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Asset_Presentation#Use_unique_icons_for_digital_format_types_in_item_view On 9 November 2012 23:37, helix84 heli...@centrum.skmailto:heli...@centrum.sk wrote: Hi George, it's very simple, really. Copy this template over to your custom theme, replacing this one line: https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/themes/Mirage/lib/xsl/aspect/artifactbrowser/item-view.xsl#L407 with: xsl:choose xsl:when test=current()/@MIMETYPE = 'application/pdf' img alt=Icon src={concat($theme-path, '/images/your_pdf_icon.png')} style=height: {$thumbnail.maxheight}px;/ /xsl:when xsl:when test=current()/@MIMETYPE = 'image/jpeg' img alt=Icon src={concat($theme-path, '/images/your_jpg_icon.png')} style=height: {$thumbnail.maxheight}px;/ /xsl:when xsl:otherwise img alt=Icon src={concat($theme-path, '/images/mime.png')} style=height: {$thumbnail.maxheight}px;/ /xsl:otherwise /xsl:choose Fill in your images and add more mimetypes - you get the idea. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Hilton Gibson Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://library.sun.ac.za http://scholar.sun.ac.za -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about locally modified code
Hi... This may have been addressed already in the forum, so my apologies if it has. I have been running the JSPUI interface (Dspace 1.8.2) and have some locally modified modules, specifically: BitstreamServlet.java Bitstream.java DefaultEmbargoSetter.java (all three altered to handle our locally customized embargo process) And in dspace-1.8.2-src-release/dspace-jspui/dspace-jspui-api/src/main/java/ I have added edu/wisc to handle some code from Wisconsin that allows a user to upload information into RefWorks on the item level. Now, I am working on migrating to the XMLUI interface, and I am wondering how to do that. Are there any guidelines for migrating jspui java code changes to xmlui? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about locally modified code
helix: Once again, many thanks!! I will update the wiki (once I have everything running) :-) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: ivan.ma...@gmail.com [ivan.ma...@gmail.com] on behalf of helix84 [heli...@centrum.sk] Sent: Monday, November 12, 2012 5:17 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about locally modified code Hi George, Bitstream.java and DefaultEmbargoSetter.java are both part of dspace-api, so you shouldn't need to change anything there. As for BitstreamServlet.java, that seems to deal mostly with preparing the bitstream for feeding to the user interface. You might be able to reuse some code, but you will definitely need to start with that again. Java code in XMLUI is found in Aspects, so you may have to write one or modify an existing one. I can tell you that documentation on writing aspects is definitely lacking. Please, do take notes along and publish them on the wiki when you're done, it would be very helpful. I could also share with you the one aspect I wrote, just for reference (file locations and such) - it's some glue code to our very specific systems so it's useless by itself for anyone else. Here are some resources to get you started on customizing XMLUI and developing an Aspect: [1] http://smartech.gatech.edu/handle/1853/28482 [2] https://wiki.duraspace.org/pages/viewpage.action?pageId=19006128 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Thumbnails not showing, filter script missing?
Ron: Filter-media was once a separate binary, but now it is executed by running /dspace/bin/dspace filter-media. Once it runs you should see your thumbnails George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Ronn Raszetnik [mailto:vistar...@yahoo.com] Sent: Friday, November 09, 2012 3:04 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Thumbnails not showing, filter script missing? Hi everyone, I am running dspace 1.8.2 on Linux. I've edited dspace.cfg so that thumbnails of my JPEGs should appear on search pages, however I don't see them. Reading around on the web, it appears that I should be able to run filter-media from dspace/bin but it isn't there. Am I doing something wrong? Thanks, Ronn -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about altering item-view in XMLUI
Thank you, helix84: I was getting bogged down in a morass of my own making. This really helps!! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: ivan.ma...@gmail.com [ivan.ma...@gmail.com] on behalf of helix84 [heli...@centrum.sk] Sent: Friday, November 09, 2012 4:37 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about altering item-view in XMLUI Hi George, it's very simple, really. Copy this template over to your custom theme, replacing this one line: https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/webapp/themes/Mirage/lib/xsl/aspect/artifactbrowser/item-view.xsl#L407 with: xsl:choose xsl:when test=current()/@MIMETYPE = 'application/pdf' img alt=Icon src={concat($theme-path, '/images/your_pdf_icon.png')} style=height: {$thumbnail.maxheight}px;/ /xsl:when xsl:when test=current()/@MIMETYPE = 'image/jpeg' img alt=Icon src={concat($theme-path, '/images/your_jpg_icon.png')} style=height: {$thumbnail.maxheight}px;/ /xsl:when xsl:otherwise img alt=Icon src={concat($theme-path, '/images/mime.png')} style=height: {$thumbnail.maxheight}px;/ /xsl:otherwise /xsl:choose Fill in your images and add more mimetypes - you get the idea. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about Google Scholar Metadata Mappings
Hi... I was asked to turn on the Google Scholar Metadata Mappings feature in our DSpace 1.8.2 setup (I am using JSPUI). I set the flag: google-metadata.enable = true The DSpace documentation, then states: Once the feature is enabled, the mapping is configured by a separate configuration file located here: ${dspace.dir}/config/google-metadata.properties So, I don't see this file in my config directory. I am assuming that I need to create it? If so, is there a mapping of the Google Scholar to DSpace Metadata fields more extensive than what is mentioned in the documentation? Thanks! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about Google Scholar Metadata Mappings
Helix: Got it! Thanks! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, October 10, 2012 2:25 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Google Scholar Metadata Mappings On Wed, Oct 10, 2012 at 8:20 PM, George S Kozak g...@cornell.edu wrote: The DSpace documentation, then states: “Once the feature is enabled, the mapping is configured by a separate configuration file located here: ${dspace.dir}/config/google-metadata.properties” Hi George, that was correct in DSpace 1.7. In 1.8, it moved to [dspace]/config/crosswalks/google-metadata.properties I'll update the docs to reflect that. Regards, ~~helix84 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about Google Scholar Metadata Mappings
Hi... One additional question: So I have the flag set; I have the google-metdata.properties file defined; I have tomcat restarted, but I don't see the meta tags in the HTML headers for the item fields. Is there something else that I'm missing? Do I need to do a maven rebuild or an ant update? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, October 10, 2012 2:25 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Google Scholar Metadata Mappings On Wed, Oct 10, 2012 at 8:20 PM, George S Kozak g...@cornell.edu wrote: The DSpace documentation, then states: “Once the feature is enabled, the mapping is configured by a separate configuration file located here: ${dspace.dir}/config/google-metadata.properties” Hi George, that was correct in DSpace 1.7. In 1.8, it moved to [dspace]/config/crosswalks/google-metadata.properties I'll update the docs to reflect that. Regards, ~~helix84 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about Google Scholar Metadata Mappings
Helix: Yes, I updated [dspace]/config/crosswalks/google-metadata.properties. I guess I will do another restart and see what I get. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, October 10, 2012 2:53 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Google Scholar Metadata Mappings On Wed, Oct 10, 2012 at 8:44 PM, George S Kozak g...@cornell.edu wrote: One additional question: So I have the flag set; I have the google-metdata.properties file defined; I have tomcat restarted, but I don't see the meta tags in the HTML headers for the item fields. Is there something else that I'm missing? Do I need to do a maven rebuild or an ant update? I never used this particular configuration file, but it should be the same like with others - restart is enough. May I ask you to verify that you updated the [dspace]/config/crosswalks/google-metadata.properties and not the [dspace-src]/dspace/config/crosswalks/google-metadata.properties file? If you updated only the latter, then it would be indeed necessary to redeploy DSpace. Or simply copy the file to the former location and restart Tomcat. Another culprit if you're using XMLUI can be the Cocoon cache. Clear it: https://wiki.duraspace.org/display/DSPACE/TechnicalFaq#TechnicalFaq-ClearingCocoon(XMLUI)cache Regards, ~~helix84 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about Google Scholar Metadata Mappings
Helix (et al.): I think I figured out my problem! If I go to my xmlui interface (which I am not officially using), the metadata tags DO appear in the HTML headers. So, it appears that the JSPUI is not displaying the google metadata tags but the XMLUI is. We made a bunch of changes to the JSPUI a few years ago which I have migrated from one release to another. In doing a careful compare of the header-default.jsp, I see that the modified version that we have is missing the call: meta name=Generator content=%= generator % / among a few other things...so, this is my problem. I missed some changes to the JSPUI when I migrated our local mods. More reasons to go to an XMLUI interface! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, October 10, 2012 4:00 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about Google Scholar Metadata Mappings That's strange. It sounds like you did everything that was necessary. I checked the source code for JSPUI. I do not see any errors in the log files. Any ideas, anyone? Exactly, if the google-metadata.config wasn't loaded, you'd see an ERROR message: https://github.com/DSpace/DSpace/blob/dspace-1_8_x/dspace-api/src/main/java/org/dspace/app/util/GoogleMetadata.java#L132 The google-metadata.enable property should be the only other thing needed: https://github.com/DSpace/DSpace/blob/dspace-1_8_x/dspace-jspui/dspace-jspui-api/src/main/java/org/dspace/app/webui/servlet/HandleServlet.java#L359 I'm not sure what to do next. Regards, ~~helix84 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about XMLUI
Hi, everyone: I recently upgraded to DSpace 1.8.2 (using JSPUI interface). After a number of false starts, I am starting to look at the XMLUI interface. On my test server, I was looking at all of the Interfaces that come ready-made. I have looked at the Default Theme and the Classic Theme, but when I tried to look at the Mirage Theme, I received the following error: org.xml.sax.SAXParseException: The entity copy was referenced, but not declared. context:/jndi:/test-ir.library.cornell.edu/xmlui/themes/Mirage/lib/xsl/core/page-structure.xsl - 515:27 Also, when I tried the Table Theme, I received the error: java.io.FileNotFoundException: jndi:/test-ir.library.cornell.edu/xmlui/themes/TableTheme/sitemap.xmap I am pretty sure that I was able to view these themes when I was at DSpace 1.7.1. What could be wrong with my setup? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about XMLUI
Tim: That's it! It's the test customizations that I made back in DSpace 1.7.1. I didn't think I migrated them when I went to DSpace 1.8.2, but I must have, by accident. In fact, I know exactly what the copy entity is!! Thank you for clearing things up for me! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Wednesday, October 03, 2012 3:29 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about XMLUI Hi George, This actually doesn't sound like out-of-the-box DSpace 1.8.2. Are you using a customized version of the XMLUI? * There's no TableTheme in DSpace 1.8.2: https://github.com/DSpace/DSpace/tree/dspace-1_8_x/dspace-xmlui/dspace-xmlui-webapp/src/main/webapp/themes * Also, in DSpace 1.8.2, there's no copy entity (copy;) on that line of that Mirage XSLT. Instead, the copyright system (c) is represented by #169;. So, I'm not sure why that error is occurring, unless someone added a copy; to line 515 in the page-structure.xsl file. https://github.com/DSpace/DSpace/blob/dspace-1_8_x/dspace-xmlui/dspace-xmlui-webapp/src/main/webapp/themes/Mirage/lib/xsl/core/page-structure.xsl#L515 So, I guess I'm wondering whether the errors you are running across are actually customizations from somewhere else? Or perhaps they are minor customizations someone made in your DSpace 1.7.1 and they are now erroring out after the upgrade to DSpace 1.8.2? - Tim On 10/3/2012 1:56 PM, George S Kozak wrote: Hi, everyone: I recently upgraded to DSpace 1.8.2 (using JSPUI interface). After a number of false starts, I am starting to look at the XMLUI interface. On my test server, I was looking at all of the Interfaces that come ready-made. I have looked at the Default Theme and the Classic Theme, but when I tried to look at the Mirage Theme, I received the following error: org.xml.sax.SAXParseException: The entity copy was referenced, but not declared. context:/jndi:/test-ir.library.cornell.edu/xmlui/themes/Mirage/lib/xsl /core/page-structure.xsl - 515:27 Also, when I tried the Table Theme, I received the error: java.io.FileNotFoundException: jndi:/test-ir.library.cornell.edu/xmlui/themes/TableTheme/sitemap.xmap I am pretty sure that I was able to view these themes when I was at DSpace 1.7.1. What could be wrong with my setup? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about XMLUI
Thanks, will do! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Wednesday, October 03, 2012 3:43 PM To: Tim Donohue Cc: George S Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about XMLUI On Wed, Oct 3, 2012 at 9:29 PM, Tim Donohue tdono...@duraspace.org wrote: So, I guess I'm wondering whether the errors you are running across are actually customizations from somewhere else? Or perhaps they are minor customizations someone made in your DSpace 1.7.1 and they are now erroring out after the upgrade to DSpace 1.8.2? Anyway, the solution should be simple, just replace the themes folder with its counterpart from DSpace 1.8.2 and clear the Cocoon cache: https://wiki.duraspace.org/display/DSPACE/TechnicalFaq#TechnicalFaq-ClearingCocoon(XMLUI)cache Regards, ~~helix84 -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Bitstreams being viewed
Hi... I am using DSpace 1.8.2. I have been asked if there is a way of controlling the viewing of a bitstream. Currently, when one clicks on a bitstream, it opens up in a new browser window. Is there an option to have the bitstream open up in the same window? I don't think so, but I have been wrong in the past :) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bitstreams being viewed
Thanks helix84: Yes, I am JSPUI...sorry, I should have said that. Thanks for the tip on editing the ItemTag file. I thought it was somewhere in the Java Code, but I wasn't sure if this was a flag that I was missing in the Config file. Again, Thank you! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, September 11, 2012 10:11 AM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Bitstreams being viewed On Tue, Sep 11, 2012 at 3:57 PM, George S Kozak g...@cornell.edu wrote: I am using DSpace 1.8.2. I have been asked if there is a way of controlling the viewing of a bitstream. Currently, when one clicks on a bitstream, it opens up in a new browser window. Is there an option to have the bitstream open up in the same window? I don’t think so, but I have been wrong in the past J Hi George, I'd guess you're using JSPUI, not XMLUI (please, always list this information along with your DSpace version). As you can see on the demo site which illustrates the defaults without any customization, clicking on a bitstream in XMLUI opens the bitstream in the same window, whereas in JSPUI it opens it in a new window. However, this is easy to change (although I didn't test it). Edit dspace-jspui-api/src/main/java/org/dspace/app/webui/jsptag/ItemTag.java, line 817 and remove the target attribute, so the line should read: out.print(a href=\); Then rebuild and redeploy DSpace and restart your servlet container. Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Ingesting large data set
Bill: Normally, at Cornell, we discourage files that are greater than 2GB. The problem isn’t that DSPace can’t handle it, the problem is in the time in uploading the file at submission time and downloading by a user. A lot of times, people’s browsers just time out. That said, we do have some large files and what I usually do with them is submit them using the item import application. I upload the file to DSpace using SFTP (as a background job). Once it’s on the server, I create an import directory with the Dublin core needed and then run the batch importer. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Ingram, William A [mailto:wingr...@illinois.edu] Sent: Thursday, August 30, 2012 11:54 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Ingesting large data set I apologize if a similar questuon has been answered in a prior thread. We have a student needing to submit a 150 GB data set into DSpace. Is this even possible? Are there any tips or workarounds I should try? Cheers, Bill -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Generating a list of bitstream URLs
Hi... I am not sure if this has been addressed before, but I would like to generate a list of bitstream URLS for certain collections in DSpace. For instance, an item: http://ecommons.library.cornell.edu/handle/1813/29648 has a bitstream: Brutsaert_Parlange_Symposium_Photo_Album_10Aug12Reduced.pdf with a URL of /bitstream/1813/29648/2/Brutsaert_Parlange_Symposium_Photo_Album_10Aug12Reduced.pdfview-source:http://ecommons.library.cornell.edu/bitstream/1813/29648/2/Brutsaert_Parlange_Symposium_Photo_Album_10Aug12Reduced.pdf I have SQL scripts that will get me the handles for an item and the bitstream names, so, I can almost build the URL to the bitstream. The only missing piece for me is the bitstream number (2, 3, etc.). Is there a way from the SQL tables to determine this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Generating a list of bitstream URLs
Helix84: Thanks! I should have recognized that, but for some reason, it slipped past me! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, August 14, 2012 8:38 AM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Generating a list of bitstream URLs On Tue, Aug 14, 2012 at 2:29 PM, George S Kozak g...@cornell.edu wrote: I have SQL scripts that will get me the handles for an item and the bitstream names, so, I can almost build the URL to the bitstream. The only missing piece for me is the bitstream number (“2”, “3”, etc.). Is there a way from the SQL tables to determine this? Hi George, it's the sequence_id column in the bitstream table. Will you manage it from here? Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about Solr Statistics
Hi... I just converted from DSpace 1.7.1 to DSpace 1.8.2. When I try and look at the Solr Statistics, I get the message: Authorization Required This server could not verify that you are authorized to access the document requested. Either you supplied the wrong credentials (e.g., bad password), or your browser doesn't understand how to supply the credentials required. I originally had the flag set in solr-statistics.cfg to: authorization.admin=true Now I can log in as an Admin when I go to /dspace-admin, but even then, I get the error above when I try to look at the Solr Stats. I have tried setting the flag in solr-statistics.cfg to false, but I still get the same error when trying to view the statistics. Any ideas what I am doing wrong? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about Solr Statistics (update)
Sorry... Forget my earlier posting. I forgot I had some local authorization code that I was using to lock down the Solr Stats and I didn't have that set up properly on my new test server. My apologies for sending this to the list. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George S Kozak [mailto:g...@cornell.edu] Sent: Wednesday, June 27, 2012 2:47 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Question about Solr Statistics Hi... I just converted from DSpace 1.7.1 to DSpace 1.8.2. When I try and look at the Solr Statistics, I get the message: Authorization Required This server could not verify that you are authorized to access the document requested. Either you supplied the wrong credentials (e.g., bad password), or your browser doesn't understand how to supply the credentials required. I originally had the flag set in solr-statistics.cfg to: authorization.admin=true Now I can log in as an Admin when I go to /dspace-admin, but even then, I get the error above when I try to look at the Solr Stats. I have tried setting the flag in solr-statistics.cfg to false, but I still get the same error when trying to view the statistics. Any ideas what I am doing wrong? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about compiling in DSpace 1.8.2
Hi I am finally working on migrating my DSpace 1.7.1 site to DSpace 1.8.2. I made all of my local mods which includes using Wisconsin's code for allowing exporting of metadata to RefWorks. Everything compiled OK, but I am having a problem which I did not experience in the past. Part of getting the RefWorks module to work requires changing: dspace-source/dspace-jspui/dspace-jspui-webapp/src/main/webapp/WEB-INF/dspace-tags.tld (and) web.xml After I compile things, I find that tomcat/webapps/jspui/WEB-INF/ dspace-tags.tld (and) web.xml do not have the changes that I placed in the source code. I know this worked in DSpace 1.7.1. Does someone know why the changes are not making it into the jspui? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Question about compiling in DSpace 1.8.2
Thanks, helix84: That's what I get for not reading my emails more carefully :-) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, June 26, 2012 4:24 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Question about compiling in DSpace 1.8.2 On Tue, Jun 26, 2012 at 10:10 PM, George S Kozak g...@cornell.edu wrote: After I compile things, I find that tomcat/webapps/jspui/WEB-INF/ dspace-tags.tld (and) web.xml do not have the changes that I placed in the source code. Hi George, sounds exactly like this problem answered today. Candidate for a FAQ. http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg17632.html Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Virtual vs. physical environment
Kristian: We (at Cornell University) went from a physical Sun Server running Solaris to a VM running LINUX several months ago. We have actually found that performance is actually much better with faster response times. Our repository is around 500GB in size and we usually run in the 100,000+ downloads per month. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Kristian Roberto Salcedo [mailto:k.r.salc...@ub.uio.no] Sent: Tuesday, January 31, 2012 5:14 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Virtual vs. physical environment Hi all, Does anyone have good experience with running large, high-load DSpace instances in virtual environments? I tend to go with physical and although the virtual solution seems ok in theory I'm a bit skeptical... regards, Kristian Salcedo University of Oslo Library -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Uploading large files to Dspace
Ian: At our site, the only solution that we have come up with is to have people give us (the Admins) the files and we move them to our server (using SFTP) and then set up a batch load of the item(s) into DSpace. It is not efficient, but it does save on User frustration in uploading huge files. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Wellaway, Ian [mailto:i.j.wella...@exeter.ac.uk] Sent: Friday, January 20, 2012 6:44 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Uploading large files to Dspace Hi, We want to allow users to upload large files to our DSpace repository - maybe 10 GB or more. Although I can up the max size in the dspace.cfg, it takes a long time. Has anyone found a quicker way, maybe such as zipping up files and then unzipping them once uploaded to Dspace? Please let me know. Thanks Ian Ian Wellaway Senior System Support Development Officer Academic Systems Exeter IT Room 909, Laver Building University of Exeter EX4 4QE UK tel +44 1392 722852 Follow Exeter IT on Twitter [t_logo-a]http://twitter.com/#!/UoE_IT inline: image001.png-- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Internal System Error
Fabiana: I think the problem is with your database.I don't know which kind you are using Postgres or Oracle, but you should check to see if it is running. Also, if it is running, you should check to see that the permissions are set so that the dspace user can read and write to the database. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Fabiana Zollo [mailto:picc...@hotmail.it] Sent: Wednesday, December 14, 2011 6:59 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Internal System Error Hi everybody, I'm having a problem when I try to access to the DSpace Home Page. The message is this below: Internal System Error The system has experienced an internal error. Please try to do what you were doing again, and if problem persists, please contact us so we can fix the problem. I checked the log files in the DSpace directory, and this below is the content of the dspace .log file. Could anyone help me? I haven't made any changes and the system was perfectly running before. Thanks in advance, Fabiana 2011-12-14 12:51:08,187 WARN org.dspace.storage.rdbms.DataSourceInit @ Exception initializing DB pool java.lang.ClassNotFoundException: at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Unknown Source) at org.dspace.storage.rdbms.DataSourceInit.getDatasource(DataSourceInit.java:38) at org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1513) at org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:585) at org.dspace.core.Context.init(Context.java:95) at org.dspace.app.webui.util.UIUtil.obtainContext(UIUtil.java:98) at org.apache.jsp.index_jsp._jspService(index_jsp.java:109) at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:928) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:539) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:298) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) 2011-12-14 12:51:08,187 WARN org.dspace.jsp @ anonymous:no_context:database_error:java.sql.SQLException\colon; java.lang.ClassNotFoundException\colon; java.sql.SQLException: java.lang.ClassNotFoundException: at org.dspace.storage.rdbms.DataSourceInit.getDatasource(DataSourceInit.java:149) at org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1513) at org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:585) at org.dspace.core.Context.init(Context.java:95) at org.dspace.app.webui.util.UIUtil.obtainContext(UIUtil.java:98) at org.apache.jsp.index_jsp._jspService(index_jsp.java:109)
Re: [Dspace-tech] pdf over https in ie8
Barrie: There is a similar problem with older versions of Firefox (I don't recall which releases, but it crosses http and https) and PDFs that are greater than 5MB. That's something that we encountered at Cornell University. One thing you may want to consider is setting the Content Inline Disposition Threshold in the dspace.cfg to force the users to download the bitstream instead of viewing it inline. That wouldn't fix your problem, but at least the content would be available to anyone no matter what browser they are using. At Cornell University we have set this value to: webui.content_disposition_threshold = 500 xmlui.content_disposition_threshold = 500 so that anyone trying to view a PDF greater than 5MB gets a message asking them if they want to view the item or download it. You could set that number lower to handle all your PDFs. I know that's not a perfect situation, but it could give you a temporary workaround until some better solution comes up. Best wishes George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: barries [mailto:barr...@uj.ac.za] Sent: Thursday, December 01, 2011 12:15 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] pdf over https in ie8 I dont seem to be getting any feedback. I presume nobody has experienced this yet? -- View this message in context: http://dspace.2283337.n4.nabble.com/pdf-over-https-in-ie8-tp4106520p4126994.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Running filter-media script via cron
Ian: Does that happen with all of your bitstreams or with just a few particular ones? I have found that certain bitstreams cannot be filtered. Sometimes the PDFs are locked so that the filter-media program can't read them or there are PDFs of page images and so there is nothing to read. I have also encountered problems with certain images as well. I'm not sure what version of DSpace your using, but if this is a PDF giving you this error, you could try switching from using PDFBox as the conversion program in Filter-media for PDFs to another program xpdf2text. This was suggested to me a while ago and I ran my DSpace 1.6.2 instance with it. I am now running using DSpace 1.7.1 and using the newer version of pdfbox that came with it. If you're interested in the xpdf2text solution there is a link: https://jira.duraspace.org/secure/attachment/10527/xpdf-filters.html that I have used in the past. There may be newer information out there, so hopefully, better minds than mine will chime in :) George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Wellaway, Ian [mailto:i.j.wella...@exeter.ac.uk] Sent: Wednesday, November 30, 2011 5:48 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Running filter-media script via cron Hi, Every time the filter-media script runs via the crontab, I get a lot of the following: ERROR filtering, skipping bitstream: Item Handle: 10036/3175 Bundle Name: ORIGINAL File Size: 180131 Checksum: b8b5c0b847ee01c404e0623a42aae1b2 (MD5) Asset Store: 0 java.lang.NullPointerException java.lang.NullPointerException at org.pdfbox.pdmodel.PDPageNode.getAllKids(PDPageNode.java:194) at org.pdfbox.pdmodel.PDPageNode.getAllKids(PDPageNode.java:182) at org.pdfbox.pdmodel.PDDocumentCatalog.getAllPages(PDDocumentCatalog.java:226) at org.pdfbox.util.PDFTextStripper.writeText(PDFTextStripper.java:216) at org.dspace.app.mediafilter.PDFFilter.getDestinationStream(PDFFilter.java:139) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:674) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:575) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:525) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:493) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:432) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:363) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:212) Any idea how I can fix this? Thanks Ian Ian Wellaway Senior System Support Development Officer Academic Systems Exeter IT Room 909, Laver Building University of Exeter EX4 4QE UK tel +44 1392 722852 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Turning off SOLR stats
Michael: Our Solr Stats at Cornell University, also, began to give us troubles, so what I did to (sort of) shut them down is simply remove the button from the Community, Collection and Item pages. That way, the Solr stats run in the background but since no one is requesting any reports, the CPU usage is normal and we no longer have any problems. I am not sure if this will be of help to you or whether you are using the XMLUI or JSPUI, but I found it fairly easy in the JSPUI to remove the buttons requesting statistics and can give you the exact lines to remove, if you want. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Michael White [mailto:michael.wh...@stir.ac.uk] Sent: Monday, November 28, 2011 7:38 AM To: DSpace-tech@lists.sourceforge.net Subject: [Dspace-tech] Turning off SOLR stats Hi, Our SOLR stats have been flaky for a while but have now reached the point where they are bringing our server down, so I want to turn them off completely (until I can find time to work on it and get them working properly), but this doesn't seem as simple as I hoped it would be! It was a long time ago that I set this up, so can't remember how I turned them on (and can't find anything specific in the documentation). I've tried a couple of things in dspace.cfg (e.g. commenting out solr.log.server), but, although this seems to have stopped the errors, I still see LoggerUsageEventListener lines in the logs, and the View Statistics button is still there (using JSPUI). Anyone have any pointers how to completely disable the SOLR stats (so that DSpace isn't trying to log events, and, perhaps more importantly, so that the View Statistics button disappears)? Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Turning off SOLR stats
Michael: If you don't have the source, what you could do, in the time being, is go into your tomcat directory tomcat/webapps/jspui/ Then you can modify collection-home.jsp community-home.jsp display-item.jsp I would backup each file first and then go into each JSP and remove lines similar to what I have listed below (which are somewhere near the bottom of each listing): div align=center form method=get action=%= request.getContextPath() %/displaystats input type=hidden name=handle value=%= collection.getHandle() %/ input type=submit name=submit_simple value=fmt:message key=jsp.collection-home.display-statistics/ / /form /div You don't need to restart tomcat. This will take effect immediately, and you can see if this helps. If not, you can simply replace the jsp files back to what they were before with the copies you made. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Michael White [mailto:michael.wh...@stir.ac.uk] Sent: Monday, November 28, 2011 10:09 AM To: George S Kozak; DSpace-tech@lists.sourceforge.net Subject: RE: Turning off SOLR stats Thanks George, so what I did to (sort of) shut them down is simply remove the button from the Community, Collection and Item pages OK - I had hoped that I could get rid of these via Configuration, but I'm guessing not :-( One problem I have is that one of our sys admins recently deleted the DSpace source code from my server (he thought he was helping to clear disk space, not realising that I have substantially customised our DSpace source code! Oh, and he deleted it from both DEV and PRODUCTION - don't ask!), so, until I have time to reconstruct my customised code I am a little handicapped in what I can do - I guess I could just update these JSPs in the expanded WAR file though (Yuck!) . . . Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -Original Message- From: George S Kozak [mailto:g...@cornell.edu] Sent: 28 November 2011 14:53 To: Michael White; DSpace-tech@lists.sourceforge.net Subject: RE: Turning off SOLR stats Michael: Our Solr Stats at Cornell University, also, began to give us troubles, so what I did to (sort of) shut them down is simply remove the button from the Community, Collection and Item pages. That way, the Solr stats run in the background but since no one is requesting any reports, the CPU usage is normal and we no longer have any problems. I am not sure if this will be of help to you or whether you are using the XMLUI or JSPUI, but I found it fairly easy in the JSPUI to remove the buttons requesting statistics and can give you the exact lines to remove, if you want. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Michael White [mailto:michael.wh...@stir.ac.uk] Sent: Monday, November 28, 2011 7:38 AM To: DSpace-tech@lists.sourceforge.net Subject: [Dspace-tech] Turning off SOLR stats Hi, Our SOLR stats have been flaky for a while but have now reached the point where they are bringing our server down, so I want to turn them off completely (until I can find time to work on it and get them working properly), but this doesn't seem as simple as I hoped it would be! It was a long time ago that I set this up, so can't remember how I turned them on (and can't find anything specific in the documentation). I've tried a couple of things in dspace.cfg (e.g. commenting out solr.log.server), but, although this seems to have stopped the errors, I still see LoggerUsageEventListener lines in the logs, and the View Statistics button is still there (using JSPUI). Anyone have any pointers how to completely disable the SOLR stats (so that DSpace isn't trying to log events, and, perhaps more importantly, so that the View Statistics button disappears)? Cheers, Mike Michael White Research Management System (RMS) Project Information Services S8, Library University of Stirling Stirling SCOTLAND FK9 4LA Email: michael.wh...@stir.ac.uk Tel: +44 (0) 1786 466877 Fax: +44 (0) 1786 466880 http://www.is.stir.ac.uk/aboutis/teams/aldt/eld.php -- The Sunday Times Scottish University of the Year 2009/2010 The University of Stirling is a charity registered in Scotland, number SC 011159. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers
Re: [Dspace-tech] checker error when run as a cron job
Debashree: I ran into a similar problem. I had to place the checker into a script that explicitly invoked the Class Paths and library paths. For some reason, cron was not picking these up even though I was invoking it under the DSpace userid. This cropped up after we moved from Solaris to Linux. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Debashree Pati [dp...@ohiolink.edu] Sent: Tuesday, November 08, 2011 2:57 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] checker error when run as a cron job Hi, When I run checker from the command line, it works fine. However, when I set it up as a cron job, it logs the following error: Problem listing checksum results codes: java.lang.ClassNotFoundException: java.sql.SQLException: java.lang.ClassNotFoundException: at org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1711) at org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:618) at org.dspace.checker.ChecksumResultDAO.listAllCodes(ChecksumResultDAO.java:131) at org.dspace.checker.ResultsPruner.prune(ResultsPruner.java:258) at org.dspace.app.checker.ChecksumChecker.main(ChecksumChecker.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:212) Anybody has had similar problem? Can someone help explain the cause. Thanks, Debashree OhioLINK -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Turning an item into a collection
Hi... I have a collections which has items that contain multiple PDF bitstreams. We are thinking of breaking these items up so that I have multiple items with a single bitstream, to make searching easier for the user. I know how to do that, but the other thing I have been asked to do, I am not so sure about. I was asked to take the existing collection and turn it into a sub-community with the same handle as the original collection. Also, to take the existing items and turn them into collections with the same handles as the original items. So, if a I have a collection: Cornell Reports with handle 1813/7754 and an item: Cornell Reports Vol. 1, No. 1 - No. 4, 1967 with handle 1813/7755, I would like to create a sub-community called Cornell Reports with the handle 1813/7754 and a collection called Cornell Reports Vol. 1, No. 1 - No. 4, 1967 with the handle 1813/7755. Can I do that in postgres? I am not sure how to link an old handle to a new collection or to move a collection into the community table and an item into the collection table. Any suggestions? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Turning an item into a collection
Brian: Thanks! Yes, this makes sense. Thank you very much. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Thursday, October 20, 2011 2:56 PM To: George S Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Turning an item into a collection Hi George, I'm rather conservative about this sort of thing, so I may take a longer route than is necessary. But here's what I'd try: -Create new sub-community -Create new collections -Create new items inside the appropriate (new) collections -Delete old items and collection -Update handle.handle, replacing new collection handles with old item handles and new sub-community handle with old collection handle (be sure to also update handle.resource_type_id (sub-community = 4, collection = 3) and resource_id (available from the community and collection tables) Then re-index, of course, or all kinds of ugliness will explode. As always, backup the db, and test on a not-production server, in case I missed a step. B-- On 10/20/2011 at 12:30 PM, in message 80e7a9b9f3ffc3438ef3b5ad26c299a1adb...@mbxa-02.exchange.cornell.edu, George S Kozak g...@cornell.edu wrote: Hi... I have a collections which has items that contain multiple PDF bitstreams. We are thinking of breaking these items up so that I have multiple items with a single bitstream, to make searching easier for the user. I know how to do that, but the other thing I have been asked to do, I am not so sure about. I was asked to take the existing collection and turn it into a sub-community with the same handle as the original collection. Also, to take the existing items and turn them into collections with the same handles as the original items. So, if a I have a collection: Cornell Reports with handle 1813/7754 and an item: Cornell Reports Vol. 1, No. 1 - No. 4, 1967 with handle 1813/7755, I would like to create a sub-community called Cornell Reports with the handle 1813/7754 and a collection called Cornell Reports Vol. 1, No. 1 - No. 4, 1967 with the handle 1813/7755. Can I do that in postgres? I am not sure how to link an old handle to a new collection or to move a collection into the community table and an item into the collection table. Any suggestions? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Turning an item into a collection
Thanks, Jose: You confirmed what Brian Freels-Stendel said. Looks like I have my work cut out or me. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Blanco, Jose [mailto:blan...@umich.edu] Sent: Thursday, October 20, 2011 2:59 PM To: George S Kozak; dspace-tech@lists.sourceforge.net Subject: RE: Turning an item into a collection George, This is a bit tricky, but I think it can be done. Perhaps someone else can OK this since I've never done it. If you have a test environment, try it there and see how it works first. (1)Make a collection a community. I would create an new community and give it the name of the collection. Now, that new community will have a handle but you want the handle to be the one from the collection. So go into the handle table and update the handle value so that the new community has the handle of the collection. You'll need to know the community_id which will be the same as resource_id in the handle table to do this. Now go into Dspace and delete the collection you just put in the community. Hopefully that will work just fine. (2)Make an item into a collection Create a new collection, and make it look like the item ( I guess you don't care about the bitstream ) To give the collection the same handle as the item, go into the handle table and give the new collection the handle value of the item. Again, resource_id = collection_id. Now go into Dspace and remove the item. Then run ./dspace idex-init You'll have created handles which will not exists in your system, but I think that's just the price you have to pay to do this. I think this makes sense to me, but if anyone sees some fault in this please let George and me know. -Jose From: George S Kozak [mailto:g...@cornell.edu] Sent: Thursday, October 20, 2011 2:30 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Turning an item into a collection Hi... I have a collections which has items that contain multiple PDF bitstreams. We are thinking of breaking these items up so that I have multiple items with a single bitstream, to make searching easier for the user. I know how to do that, but the other thing I have been asked to do, I am not so sure about. I was asked to take the existing collection and turn it into a sub-community with the same handle as the original collection. Also, to take the existing items and turn them into collections with the same handles as the original items. So, if a I have a collection: Cornell Reports with handle 1813/7754 and an item: Cornell Reports Vol. 1, No. 1 - No. 4, 1967 with handle 1813/7755, I would like to create a sub-community called Cornell Reports with the handle 1813/7754 and a collection called Cornell Reports Vol. 1, No. 1 - No. 4, 1967 with the handle 1813/7755. Can I do that in postgres? I am not sure how to link an old handle to a new collection or to move a collection into the community table and an item into the collection table. Any suggestions? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Strange problem with searching
Hi, helix84: Yes, I did run things in the correct order. That's what has stumped me. I can't figure out why these specific records are not searchable while other records are searchable. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Thursday, October 13, 2011 6:07 AM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Strange problem with searching On Wed, Oct 12, 2011 at 20:25, George S Kozak g...@cornell.edu wrote: I have tried running index-init and deleting the extracted text and re-running filter-media, but still no luck with the searches for this collection. Hi, just to make sure - did you run filter-media before or after index-init/index-update? Because filter-media creates text files from media and index-* indexes them. So in case you didn't run index-init or index-update after filter-media, they won't be indexed. Regards, ~~helix84 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Strange problem with searching - More and disturbing information!
Hi. Everyone: After a bit of digging what I have discovered is that any item that has multiple bitstreams of PDFs, only the first bitstream added is searchable. The other bitstreams in the item seem to be ignored by the indexer. I have checked and the extracted Texts are there, so it is not an issue with the filter-media program. We (at Cornell) have many items with multiple bitstreams of PDFs, and so far all of my testing indicates only the first bitstream of the item is being indexed by the Dspace search engine. Is this a known issue? Is there something wrong in my configuration files that may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Strange problem with searching - More and disturbing information!
Susan: I am running DSpace 1.7.1...I think Tim may be right about my config settings (thanks for the suggestions, Tim). I am going to test that out and I will let everyone know. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, October 13, 2011 1:04 PM To: Tim Donohue; George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Strange problem with searching - More and disturbing information! What version of DSpace are you running? I just tested something completely unrelated this morning, but it involved adding a second document to an Item, then running filter media, then doing a search to do if the text in the second document was found - it WAS. We are running DSpace 1.7.1. JSPUI. Sue Sue Walker-Thornton (757) 864-2368 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, October 13, 2011 12:50 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Strange problem with searching - More and disturbing information! Hi George, Hmm..that's a bit odd. It's definitely not a known issue. In fact, looking at the DSIndexer class (which is the class which creates/updates the Lucene search index), it should be doing what you expect. The 'buildDocumentForItem()' method is the one that takes care of indexing all Item content into a Lucene Document. https://fisheye3.atlassian.com/browse/~br=trunk/dspace/dspace/trunk/dspace-api/src/main/java/org/dspace/search/DSIndexer.java?hb=true#to1040 Specifically, it should be doing the following: 1. Initialize the Lucene Document for the Item 2. Index all Item Metadata 3. Add in all various sort options (so you can sort search results) 4. Locate the TEXT Bundle in the Item and index *all* Bitstreams in that Bundle. If you turn on Debugging you should actually see the DSIndexer report *every* Bitstream that it adds to the index. So, I'm a bit at a loss as to what may be happening. It sounds like your TEXT bundle is getting all the right Bitstreams added (by filter-media). I'm assuming there is only *one* TEXT Bundle, right? (if there are multiple that may be the issue -- but DSpace itself should only be generating one TEXT bundle). The only other thing I can think of is that your 'search.maxfieldlength' setting is too small. In your dspace.cfg you should see: # Maximum number of terms indexed for a single field in Lucene. # Default is 10,000 words - often not enough for full-text indexing. # If you change this, you'll need to re-index for the change # to take effect on previously added items. # -1 = unlimited (Integer.MAX_VALUE) search.maxfieldlength = 1 So, it could be possible that these PDFs are larger, and Lucene just stops indexing content after 10,000 words. You can set this to -1 if you want to disable any word-based limit. Not sure if that helps or not! :) - Tim On 10/13/2011 11:28 AM, George S Kozak wrote: Hi. Everyone: After a bit of digging what I have discovered is that any item that has multiple bitstreams of PDFs, only the first bitstream added is searchable. The other bitstreams in the item seem to be ignored by the indexer. I have checked and the extracted Texts are there, so it is not an issue with the filter-media program. We (at Cornell) have many items with multiple bitstreams of PDFs, and so far all of my testing indicates only the first bitstream of the item is being indexed by the Dspace search engine. Is this a known issue? Is there something wrong in my configuration files that may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace
Re: [Dspace-tech] Strange problem with searching - More and disturbing information!
Tim: You were right! I changed the config file and now my searches are working for other bitstreams! Thank you, very much!! This clears up a problem that I have had for a long time. Now I wonder what other old and now bad setting that I have! George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, October 13, 2011 12:50 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Strange problem with searching - More and disturbing information! Hi George, Hmm..that's a bit odd. It's definitely not a known issue. In fact, looking at the DSIndexer class (which is the class which creates/updates the Lucene search index), it should be doing what you expect. The 'buildDocumentForItem()' method is the one that takes care of indexing all Item content into a Lucene Document. https://fisheye3.atlassian.com/browse/~br=trunk/dspace/dspace/trunk/dspace-api/src/main/java/org/dspace/search/DSIndexer.java?hb=true#to1040 Specifically, it should be doing the following: 1. Initialize the Lucene Document for the Item 2. Index all Item Metadata 3. Add in all various sort options (so you can sort search results) 4. Locate the TEXT Bundle in the Item and index *all* Bitstreams in that Bundle. If you turn on Debugging you should actually see the DSIndexer report *every* Bitstream that it adds to the index. So, I'm a bit at a loss as to what may be happening. It sounds like your TEXT bundle is getting all the right Bitstreams added (by filter-media). I'm assuming there is only *one* TEXT Bundle, right? (if there are multiple that may be the issue -- but DSpace itself should only be generating one TEXT bundle). The only other thing I can think of is that your 'search.maxfieldlength' setting is too small. In your dspace.cfg you should see: # Maximum number of terms indexed for a single field in Lucene. # Default is 10,000 words - often not enough for full-text indexing. # If you change this, you'll need to re-index for the change # to take effect on previously added items. # -1 = unlimited (Integer.MAX_VALUE) search.maxfieldlength = 1 So, it could be possible that these PDFs are larger, and Lucene just stops indexing content after 10,000 words. You can set this to -1 if you want to disable any word-based limit. Not sure if that helps or not! :) - Tim On 10/13/2011 11:28 AM, George S Kozak wrote: Hi. Everyone: After a bit of digging what I have discovered is that any item that has multiple bitstreams of PDFs, only the first bitstream added is searchable. The other bitstreams in the item seem to be ignored by the indexer. I have checked and the extracted Texts are there, so it is not an issue with the filter-media program. We (at Cornell) have many items with multiple bitstreams of PDFs, and so far all of my testing indicates only the first bitstream of the item is being indexed by the Dspace search engine. Is this a known issue? Is there something wrong in my configuration files that may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad date problem in DSpace 1.7.1
Thanks, Mark. I will check if there is already a JIRA task or not. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: mdigg...@gmail.com [mailto:mdigg...@gmail.com] On Behalf Of Mark Diggory Sent: Friday, August 19, 2011 1:38 PM To: George S Kozak Cc: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Bad date problem in DSpace 1.7.1 George, I would say that it could be more gracefully handled in the UI so that there are not parsing errors. But, the larger challenge is that its not a problem with the UI, the expectation is that the dates are ISO format, putting other values into that field is invalid. If anything were to be fixed, the fields should be properly typed and validated on submission / item edit / import to stop such values getting into there in the first place. I would recommend starting a JIRA task (if one does not already exist) about the topic if its something that you would like to see fixed in the future. Mark On Thu, Aug 18, 2011 at 11:48 AM, George S Kozak g...@cornell.edumailto:g...@cornell.edu wrote: Hi, Susan: I reported the same problem back in May. I was told to exported the metadata for the problem records and then reimport them after fixing them. That worked, but I never heard anyone saying that the problem was going to be fixed. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924tel:607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov] Sent: Thursday, August 18, 2011 12:13 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Bad date problem in DSpace 1.7.1 Hi, I am in the process of upgrading from DSpace 1.5.1 to 1.7.1. I am almost done and am running index-init, but I’ve just noticed a problem. With previous versions of DSpace, if a “bad” date was encountered in one of the date fields (issue date, accession date, publication date), DSpace just ignored it. Now, it seems it is unable to either display the Item page or the Browse screen if encounters one of these records. Here’s an example: One of our items has the following invalid issue and publication date that our Users have never gotten around to correcting: Washington, D.C. :1955. If I try to display the Item, the screen is blank and the following message displays in the dspace.log file: 2011-08-18 12:07:14,232 WARN org.dspace.content.DCDate @ Mangled date: Washington, D.C. :1955. ..failed all attempts to parse as date. The same message displays if I try to browse by issue date. I know the “right” thing to do is to clean up our data, but I also know we have quite a few of these old bad dates and am wondering why DSpace is now having a problem with it. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074tel:%28757%29%20224-4074 Mobile: (757) 506-9903tel:%28757%29%20506-9903 Fax: (757) 224-4001tel:%28757%29%20224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Mark R. Diggory @mire - www.atmire.comhttp://www.atmire.com/ 2888 Loker Avenue East - Suite 305 - Carlsbad - CA - 92010 Esperantolaan 4 - Heverlee 3001 - Belgium -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Bad date problem in DSpace 1.7.1
Bram: Yes, this is exactly the problem that I am seeing and which (I think) Susan is reporting. Thanks for pointing this out to us. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: Friday, August 19, 2011 4:29 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: George S Kozak; dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Bad date problem in DSpace 1.7.1 For what it's worth, this sounds related to this discussion here: https://jira.duraspace.org/browse/DS-815 If you have additional information I think it would be valuable if you could log it there as well. with kindest regards, Bram Luyten @mire Esperantolaan 4 - 3001 Heverlee - Belgium 2888 Loker Avenue East, Suite 305 - Carlsbad, CA 92010 - USA atmire.comhttp://atmire.com/ - Institutional Repository Solutions On Thu, Aug 18, 2011 at 10:39 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Thanks a bunch George. I heard from someone else who said they also had the same problem. Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract (757) 224-4074tel:%28757%29%20224-4074 -Original Message- From: George S Kozak [mailto:g...@cornell.edumailto:g...@cornell.edu] Sent: Thursday, August 18, 2011 2:48 PM To: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: RE: Bad date problem in DSpace 1.7.1 Hi, Susan: I reported the same problem back in May. I was told to exported the metadata for the problem records and then reimport them after fixing them. That worked, but I never heard anyone saying that the problem was going to be fixed. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924tel:607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov] Sent: Thursday, August 18, 2011 12:13 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Bad date problem in DSpace 1.7.1 Hi, I am in the process of upgrading from DSpace 1.5.1 to 1.7.1. I am almost done and am running index-init, but I've just noticed a problem. With previous versions of DSpace, if a bad date was encountered in one of the date fields (issue date, accession date, publication date), DSpace just ignored it. Now, it seems it is unable to either display the Item page or the Browse screen if encounters one of these records. Here's an example: One of our items has the following invalid issue and publication date that our Users have never gotten around to correcting: Washington, D.C. :1955. If I try to display the Item, the screen is blank and the following message displays in the dspace.log file: 2011-08-18 12:07:14,232 WARN org.dspace.content.DCDate @ Mangled date: Washington, D.C. :1955. ..failed all attempts to parse as date. The same message displays if I try to browse by issue date. I know the right thing to do is to clean up our data, but I also know we have quite a few of these old bad dates and am wondering why DSpace is now having a problem with it. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074tel:%28757%29%20224-4074 Mobile: (757) 506-9903tel:%28757%29%20506-9903 Fax: (757) 224-4001tel:%28757%29%20224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] DSpace / Kaltura integration
This is posted on behalf of David Ruddy, who coordinates activities related to our institutional repository at Cornell. - Cornell's central campus IT has recently begun working with Kaltura to provide video services across campus. In the Library, we'd like to see some degree of integration between our DSpace IR and Kaltura, such as streaming capabilities for video content in our IR. We're just beginning to explore such integration and wondering if others in the DSpace community have already done so, or are interested in collaborating. If you operate both DSpace and Kaltura and have attempted integration, or are interested in integration, please let me know. Thanks, David Ruddy d...@cornell.edu 607.255.6803 George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Get a FREE DOWNLOAD! and learn more about uberSVN rich system, user administration capabilities and model configuration. Take the hassle out of deploying and managing Subversion and the tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id)
Susan: What I am doing at Cornell University is taking inactive persons and unchecking the Can Log In in dspace-admin/edit-epeople and putting Inactive in the Phone field. I can then search on them in the database using select * from eperson where can_log_in='f' and phone='Inactive'; I know that's not perfect, but it might help as a work around until something else is developed. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Friday, July 22, 2011 11:21 AM To: bfre...@unm.edu; George S Kozak; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id) Here at NASA, we have a revalidation process that requires us to determine on a annual basis if a User still needs access to our repository. We have to have some way to remove them if they don't. Perhaps a new column - something like eperson_status - could be added to the EPerson table. So when a User leaves, we can mark them as Inactive instead of deleting them and potentially causing problems in the data if they previously submitted an Item to the repository. I can see other uses for a column like that as well. As an alternative, I suppose we could create a group entitled Inactive. Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract (757) 224-4074 -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Thursday, July 21, 2011 10:53 AM To: George S Kozak; dspace-tech@lists.sourceforge.net; Thornton, Susan M. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id) Morning, There doesn't seem to be a solid reason in the codebase that epeople who've submitted can't be deleted; it seems to be something that was decided on a database level. It makes sense, though, to keep it, on that level. Otherwise, you have database fields that point nowhere, and that can't be good. For general mass submissions, a workaround might be to use the original admin account (assuming that's not a person who might later want to be deleted.) For things like theses/dissertations, I think we have to be stuck with having those one-shot accounts pile up year after year. There might be some filter feature added so we don't have to look at accounts that are locked, but with the search functionality, I'm not sure that would be necessary. B-- On 7/21/2011 at 7:32 AM, in message a3e58c957c81584e933f5da65fd9680606494fe...@mbxa.exchange.cornell.edu, George S Kozak g...@cornell.edu wrote: Susan: I have run into the same problem, but in my case I was trying to delete the ids of graduate students who left the University, but who had submitted Theses and Dissertations to DSpace. I ended up disabling their logins, but could find no way to actually delete them. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Wednesday, July 20, 2011 6:33 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id) I ran into a problem I wanted to report in one of our DSpace instances. I was trying to delete an Eperson record as an Administrator, and I kept getting an Internal Server Error. The error message in the dspace.log file didn’t really give me too much to go on, but I finally figured out that I couldn’t delete that person because that person (me!) was the person who had added every Item to the repository and every single row in the Item table had that eperson_id in column “submitter_id”. I don’t think there should be any referential integrity between eperson.eperson_id and item.submitter_id, because it would certainly be possible and appropriate that the person who originally loaded the Items might eventually leave. I suppose something would have to be done in that case or you might end up with an eperson_id in “submitter_id” in the Item rows that no longer exists in the eperson table, but maybe in that instance a generic eperson_id could be used. Does anyone have thoughts on this? I’m not sure if this has been addressed in a subsequent release of DSpace (we’re in the process of implementing version 1.7.1 in our main Production DSpace instance). Thanks and Best regards, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research
Re: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id)
Susan: I have run into the same problem, but in my case I was trying to delete the ids of graduate students who left the University, but who had submitted Theses and Dissertations to DSpace. I ended up disabling their logins, but could find no way to actually delete them. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Wednesday, July 20, 2011 6:33 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Problem in DSpace 1.5.1 deleting an eperson who is also a previous Item submitter (item.submitter_id) I ran into a problem I wanted to report in one of our DSpace instances. I was trying to delete an Eperson record as an Administrator, and I kept getting an Internal Server Error. The error message in the dspace.log file didn’t really give me too much to go on, but I finally figured out that I couldn’t delete that person because that person (me!) was the person who had added every Item to the repository and every single row in the Item table had that eperson_id in column “submitter_id”. I don’t think there should be any referential integrity between eperson.eperson_id and item.submitter_id, because it would certainly be possible and appropriate that the person who originally loaded the Items might eventually leave. I suppose something would have to be done in that case or you might end up with an eperson_id in “submitter_id” in the Item rows that no longer exists in the eperson table, but maybe in that instance a generic eperson_id could be used. Does anyone have thoughts on this? I’m not sure if this has been addressed in a subsequent release of DSpace (we’re in the process of implementing version 1.7.1 in our main Production DSpace instance). Thanks and Best regards, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov -- 5 Ways to Improve Secure Unified Communications Unified Communications promises greater efficiencies for business. UC can improve internal communications as well as offer faster, more efficient ways to interact with customers and streamline customer service. Learn more! http://www.accelacomm.com/jaw/sfnl/114/51426253/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about Primary Bitstream
Hi, Everyone: OK...I've been working on DSpace since 2003, so I know that I should know the answer to this...but I don't! I set the Primary Bitstream flag for an item, but now I want to remove it, but I can't seem to figure out how to get rid of it. Does anyone know? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Solr stats and XMLUI
Hi... I have written to the group in the past about 2 particular problems: my Solr Statistics not working right and using the XMLUI interface not working properly...in particular the Home page would not display. I just wanted to report that these problems now appear to be fixed. We just upgraded to DSpace 1.7.1 and I upgraded Tomcat to 7.0.14 and the problems that I had with DSpace 1.6.2 running under Tomcat 5.5.26 have gone away. My message here is that if you are having problems with Solr or with the XMLUI, I think you might consider upgrading the latest Tomcat. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about tomcat 6 or 7
Hi... I am running DSpace 1.7.1 with apache-tomcat-5.5.26 and jdk1.6.0_07. Everything works fine except to the Solr Stats. If I do a http://localhost:8080/solr/statistics/admin, I get an error display and clicking on the View Statistics button results in an error like Error using query type: 3 AND id:431 So, I tried switching to apache-tomcat-6.0.32. I was able now to execute the http://localhost:8080/solr/statistics/admin, but if I try to view a Collection or an Item, I get a java.lang.OutOfMemoryError: PermGen space Error I tried apache-tomcat-7.0.14, and I got the same error. I was using JAVA_OPTS=-server -Xms1024m -Xmx2048m -Xmn64m -Dfile.encoding=UTF-8 -XX:+UseParallelGC -verbose:gc -Xloggc:/dspace/dspace/log/gc.log I also tried CATALINA_OPTS=-Xms256m -Xmx1028m -XX:MaxPermSize=256m But neither of those helped. I know a lot has been written about memory leaks and what can be done, but I think I'm doing teh right stuff, but nothhing seems to be working. ANy idea would be appreciated. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about tomcat 6 or 7 - follow up!
Hi... As is always the case...after I sent out an email in final desperation, I find the solution!. I had left out some of my JAVA_OPTS parameters to handle the java OutofMemory problem. Sorry to bother everyone. Here is what fixed things: JAVA_OPTS=-server -Xms1024m -Xmx2048m -Xmn64m -Dfile.encoding=UTF-8 -XX:+UseParallelGC -verbose:gc -Xloggc:/dspace/dspace/log/gc.log -XX:+HeapDumpOnOutOfMemoryError -XX:PermSize=1024m -XX:MaxPermSize=1024m -XX:-UseGCOverheadLimit George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: George S Kozak [g...@cornell.edu] Sent: Thursday, May 26, 2011 1:20 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Question about tomcat 6 or 7 Hi... I am running DSpace 1.7.1 with apache-tomcat-5.5.26 and jdk1.6.0_07. Everything works fine except to the Solr Stats. If I do a http://localhost:8080/solr/statistics/admin, I get an error display and clicking on the View Statistics button results in an error like Error using query type: 3 AND id:431 So, I tried switching to apache-tomcat-6.0.32. I was able now to execute the http://localhost:8080/solr/statistics/admin, but if I try to view a Collection or an Item, I get a java.lang.OutOfMemoryError: PermGen space Error I tried apache-tomcat-7.0.14, and I got the same error. I was using JAVA_OPTS=-server -Xms1024m -Xmx2048m -Xmn64m -Dfile.encoding=UTF-8 -XX:+UseParallelGC -verbose:gc -Xloggc:/dspace/dspace/log/gc.log I also tried CATALINA_OPTS=-Xms256m -Xmx1028m -XX:MaxPermSize=256m But neither of those helped. I know a lot has been written about memory leaks and what can be done, but I think I'm doing teh right stuff, but nothhing seems to be working. ANy idea would be appreciated. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CULIT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] How large files can one ingest using the web user interface?
Magnus: I usually tell my users that the larger the files the less chance there is of successfully uploading them in the web user interface. The problem isn't DSpace but involves the browser timing out. I have had users upload 1-2GB files sucessfully, but our local guidelines state that we prefer files that are 50MB or less.If a file is greater than 500MB, I ask people to give me the files to load using the batch loader. As for downloading, people downloading (depending on the speed of their internet providers) could take a long time getting the item downloaded, and their browser could timeout in the process. I know that @MIRE had some streaming options for certain files that would probably help with this. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 From: Magnus Norberg [mailto:mango_pa...@hotmail.com] Sent: Monday, May 23, 2011 5:44 AM To: DSpace techlist techlist Subject: [Dspace-tech] How large files can one ingest using the web user interface? Hello everyone, I got two questions: 1) How large files (GB) can one ingest into DSpace using the web user interface? 2) How large files (GB) can one download from DSpace using the web user interface? Thanks! /Magnus -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech